Starting Hawkular Services ------------------------------------ Generating the self-signed certificate Certificate fingerprint (SHA1): EC:60:35:A7:CA:6F:78:AF:8D:61:5B:1B:4D:A4:D0:8C:EB:D1:30:E0 ------------------------------------ Certificate stored in file Certificate was added to keystore ========================================================================= JBoss Bootstrap Environment JBOSS_HOME: /opt/jboss/wildfly JAVA: /usr/lib/jvm/java/bin/java JAVA_OPTS: -server -Xms64m -Xmx512m -XX:MetaspaceSize=96M -XX:MaxMetaspaceSize=256m -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman,org.jboss.logmanager -Djava.awt.headless=true -Djava.util.logging.manager=org.jboss.logmanager.LogManager -javaagent:/opt/jboss/wildfly/bin/hawkular-javaagent.jar=config=/opt/jboss/wildfly/standalone/configuration/hawkular-javaagent-config.yaml,delay=10 ========================================================================= 16:20:43,911 INFO [org.jboss.modules] (main) JBoss Modules version 1.5.2.Final 16:20:44,442 INFO [org.jboss.msc] (main) JBoss MSC version 1.2.6.Final 16:20:44,625 INFO [org.jboss.as] (MSC service thread 1-7) WFLYSRV0049: Hawkular 0.40.0.Final-SNAPSHOT (WildFly Core 2.2.0.Final) starting 16:20:46,282 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 26) HAWKBUS130015: Initializing Nest subsystem 16:20:46,616 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 31) HAWKBUS130008: [7] deployments found 16:20:46,620 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 31) HAWKBUS130009: 1. Deploying [hawkular-command-gateway-war.war] 16:20:46,621 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 31) HAWKBUS130009: 2. Deploying [hawkular-inventory-service.war] 16:20:46,622 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 31) HAWKBUS130009: 3. Deploying [hawkular-inventory-ui.war] 16:20:46,623 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 31) HAWKBUS130009: 4. Deploying [hawkular-metrics.ear] 16:20:46,624 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 31) HAWKBUS130009: 5. Deploying [hawkular-rest-api.war] 16:20:46,625 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 31) HAWKBUS130009: 6. Deploying [hawkular-status.war] 16:20:46,626 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 31) HAWKBUS130009: 7. Deploying [hawkular-wildfly-agent-download.war] 16:20:46,655 INFO [org.jboss.as.repository] (ServerService Thread Pool -- 31) WFLYDR0001: Content added at location /var/opt/hawkular/data/content/d1/fdfd2b26daa3e194b9f46375ec0c6cfc56eb12/content 16:20:47,080 INFO [org.jboss.as.repository] (ServerService Thread Pool -- 31) WFLYDR0001: Content added at location /var/opt/hawkular/data/content/4f/996528011f0af0b066ffcb9e6dc66a3b242409/content 16:20:47,104 INFO [org.jboss.as.repository] (ServerService Thread Pool -- 31) WFLYDR0001: Content added at location /var/opt/hawkular/data/content/ef/bb056a636b672f6cfd7e4e989ef67feafbe597/content 16:20:47,758 INFO [org.jboss.as.repository] (ServerService Thread Pool -- 31) WFLYDR0001: Content added at location /var/opt/hawkular/data/content/c3/19b275b837412f4a0d0b662033d371bd9f25b2/content 16:20:47,798 INFO [org.jboss.as.repository] (ServerService Thread Pool -- 31) WFLYDR0001: Content added at location /var/opt/hawkular/data/content/86/fd323a0882dc2cdf6cd7c473e73d09011ae7b3/content 16:20:47,802 INFO [org.jboss.as.repository] (ServerService Thread Pool -- 31) WFLYDR0001: Content added at location /var/opt/hawkular/data/content/23/8134b2664b1cbc51af59863af77a664973c1ca/content 16:20:47,806 INFO [org.jboss.as.repository] (ServerService Thread Pool -- 31) WFLYDR0001: Content added at location /var/opt/hawkular/data/content/d4/ca9bcff704d29720d3e3983205c960df723578/content 16:20:47,836 INFO [org.jboss.as.server] (Controller Boot Thread) WFLYSRV0040: Creating http management service using secure-socket-binding (management-https) 16:20:47,876 INFO [org.xnio] (MSC service thread 1-7) XNIO version 3.4.0.Final 16:20:47,894 INFO [org.xnio.nio] (MSC service thread 1-7) XNIO NIO Implementation Version 3.4.0.Final 16:20:47,969 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 48) WFLYNAM0001: Activating Naming Subsystem 16:20:47,970 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 56) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique. 16:20:47,971 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 40) WFLYCLINF0001: Activating Infinispan subsystem. 16:20:47,971 INFO [org.hawkular.nest.extension.log] (ServerService Thread Pool -- 61) HAWKBUS130014: Nest is enabled and will be deployed 16:20:47,984 INFO [org.wildfly.extension.io] (ServerService Thread Pool -- 39) WFLYIO001: Worker 'default' has auto-configured to 48 core threads with 384 task threads based on your 24 available processors 16:20:47,989 INFO [org.jboss.as.webservices] (ServerService Thread Pool -- 58) WFLYWS0002: Activating WebServices Extension 16:20:47,994 INFO [org.jboss.as.security] (ServerService Thread Pool -- 55) WFLYSEC0002: Activating Security Subsystem 16:20:48,000 INFO [org.hawkular.nest.extension.log] (MSC service thread 1-5) HAWKBUS130000: Nest service starting 16:20:48,001 INFO [org.hawkular.nest.extension.log] (MSC service thread 1-5) HAWKBUS130004: Nest name=[hawkular-services-2-vgsd2] 16:20:48,001 INFO [org.hawkular.nest.extension.log] (MSC service thread 1-5) HAWKBUS130001: Nest service started 16:20:48,038 INFO [org.jboss.as.security] (MSC service thread 1-6) WFLYSEC0001: Current PicketBox version=4.9.6.Final 16:20:48,068 INFO [org.jboss.as.jsf] (ServerService Thread Pool -- 46) WFLYJSF0007: Activated the following JSF Implementations: [main] 16:20:48,106 INFO [org.wildfly.extension.undertow] (MSC service thread 1-4) WFLYUT0003: Undertow 1.4.0.Final starting 16:20:48,140 INFO [org.jboss.as.connector] (MSC service thread 1-2) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.3.4.Final) 16:20:48,206 INFO [org.jboss.remoting] (MSC service thread 1-1) JBoss Remoting version 4.0.21.Final 16:20:48,247 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 35) WFLYJCA0004: Deploying JDBC-compliant driver class org.h2.Driver (version 1.3) 16:20:48,265 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-3) WFLYJCA0018: Started Driver service with driver-name = h2 16:20:48,272 INFO [org.jboss.as.naming] (MSC service thread 1-6) WFLYNAM0003: Starting Naming Service 16:20:48,290 INFO [org.jboss.as.mail.extension] (MSC service thread 1-8) WFLYMAIL0001: Bound mail session [java:jboss/mail/Default] 16:20:48,480 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 57) WFLYUT0014: Creating file handler for path '/opt/jboss/wildfly/hawkular-welcome-content' with options [directory-listing: 'false', follow-symlink: 'false', case-sensitive: 'true', safe-symlink-paths: '[]'] 16:20:48,502 INFO [org.wildfly.extension.undertow] (MSC service thread 1-1) WFLYUT0012: Started server default-server. 16:20:48,507 INFO [org.wildfly.extension.undertow] (MSC service thread 1-1) WFLYUT0018: Host default-host starting 16:20:48,572 INFO [org.jboss.as.ejb3] (MSC service thread 1-7) WFLYEJB0482: Strict pool mdb-strict-max-pool is using a max instance size of 96 (per class), which is derived from the number of CPUs on this host. 16:20:48,573 INFO [org.jboss.as.ejb3] (MSC service thread 1-8) WFLYEJB0481: Strict pool slsb-strict-max-pool is using a max instance size of 384 (per class), which is derived from thread worker pool sizing. 16:20:48,665 INFO [org.wildfly.extension.undertow] (MSC service thread 1-2) WFLYUT0006: Undertow HTTP listener default listening on 0.0.0.0:8080 16:20:48,865 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-5) WFLYJCA0001: Bound data source [java:jboss/datasources/ExampleDS] 16:20:49,084 INFO [org.wildfly.extension.messaging-activemq] (MSC service thread 1-7) WFLYMSGAMQ0075: AIO wasn't located on this platform, it will fall back to using pure Java NIO. Your platform is Linux, install LibAIO to enable the AIO journal and achieve optimal performance. 16:20:49,239 WARN [org.jboss.as.domain.management.security] (MSC service thread 1-6) WFLYDM0111: Keystore /opt/jboss/wildfly/standalone/configuration/application.keystore not found, it will be auto generated on first use with a self signed certificate for host localhost 16:20:49,269 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0027: Starting deployment of "hawkular-metrics.ear" (runtime-name: "hawkular-metrics.ear") 16:20:49,293 INFO [org.jboss.as.server.deployment.scanner] (MSC service thread 1-6) WFLYDS0013: Started FileSystemDeploymentService for directory /opt/jboss/wildfly/standalone/deployments 16:20:49,294 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0027: Starting deployment of "hawkular-inventory-ui.war" (runtime-name: "hawkular-inventory-ui.war") 16:20:49,295 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0027: Starting deployment of "hawkular-wildfly-agent-download.war" (runtime-name: "hawkular-wildfly-agent-download.war") 16:20:49,298 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0027: Starting deployment of "hawkular-command-gateway-war.war" (runtime-name: "hawkular-command-gateway-war.war") 16:20:49,300 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0027: Starting deployment of "hawkular-inventory-service.war" (runtime-name: "hawkular-inventory-service.war") 16:20:49,301 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0027: Starting deployment of "hawkular-rest-api.war" (runtime-name: "hawkular-rest-api.war") 16:20:49,302 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0027: Starting deployment of "hawkular-status.war" (runtime-name: "hawkular-status.war") 16:20:49,327 INFO [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-2) ISPN000128: Infinispan version: Infinispan 'Chakra' 8.2.4.Final 16:20:49,369 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221000: live Message Broker is starting with configuration Broker Configuration (clustered=false,journalDirectory=/var/opt/hawkular/data/activemq/journal,bindingsDirectory=/var/opt/hawkular/data/activemq/bindings,largeMessagesDirectory=/var/opt/hawkular/data/activemq/largemessages,pagingDirectory=/var/opt/hawkular/data/activemq/paging) 16:20:49,413 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221013: Using NIO Journal 16:20:49,787 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 73) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated. 16:20:49,790 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 73) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated. 16:20:49,787 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 75) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated. 16:20:49,801 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 75) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated. 16:20:49,894 INFO [org.wildfly.extension.undertow] (MSC service thread 1-6) WFLYUT0006: Undertow HTTPS listener https listening on 0.0.0.0:8443 16:20:49,967 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221043: Protocol module found: [artemis-server]. Adding protocol support for: CORE 16:20:49,984 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221043: Protocol module found: [artemis-amqp-protocol]. Adding protocol support for: AMQP 16:20:50,018 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221043: Protocol module found: [artemis-hornetq-protocol]. Adding protocol support for: HORNETQ 16:20:50,023 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221043: Protocol module found: [artemis-stomp-protocol]. Adding protocol support for: STOMP 16:20:50,054 INFO [org.jboss.ws.common.management] (MSC service thread 1-4) JBWS022052: Starting JBossWS 5.1.5.Final (Apache CXF 3.1.6) 16:20:50,449 WARN [org.jboss.as.dependency.private] (MSC service thread 1-6) WFLYSRV0018: Deployment "deployment.hawkular-command-gateway-war.war" is using a private module ("org.wildfly.extension.messaging-activemq:main") which may be changed or removed in future versions without notice. 16:20:50,490 INFO [org.wildfly.extension.messaging-activemq] (MSC service thread 1-8) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor-throughput acceptor 16:20:50,491 INFO [org.wildfly.extension.messaging-activemq] (MSC service thread 1-3) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor-throughput acceptor 16:20:50,492 INFO [org.wildfly.extension.messaging-activemq] (MSC service thread 1-6) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor acceptor 16:20:50,508 INFO [org.wildfly.extension.messaging-activemq] (MSC service thread 1-8) WFLYMSGAMQ0016: Registered HTTP upgrade for activemq-remoting protocol handled by http-acceptor acceptor 16:20:50,612 INFO [org.jboss.weld.deployer] (MSC service thread 1-3) WFLYWELD0003: Processing weld deployment hawkular-command-gateway-war.war 16:20:50,651 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221007: Server is now live 16:20:50,651 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221001: Apache ActiveMQ Artemis Message Broker version 1.1.0.wildfly-017 [nodeID=76954796-b9a0-11e7-914b-cdd387d455e3] 16:20:50,664 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 62) AMQ221003: trying to deploy queue jms.topic.HawkularAlertData 16:20:50,724 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "hawkular-alerts.war") 16:20:50,724 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0207: Starting subdeployment (runtime-name: "hawkular-alerts-action-webhook.war") 16:20:50,725 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "hawkular-metrics.war") 16:20:50,725 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "hawkular-metrics-alerter.war") 16:20:50,726 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "hawkular-alerts-action-elasticsearch.war") 16:20:50,724 INFO [org.jboss.as.server.deployment] (MSC service thread 1-7) WFLYSRV0207: Starting subdeployment (runtime-name: "hawkular-elasticsearch-alerter.war") 16:20:50,725 INFO [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0207: Starting subdeployment (runtime-name: "hawkular-alerts-action-email.war") 16:20:50,904 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 73) AMQ221003: trying to deploy queue jms.queue.hawkular/metrics/gauges/new 16:20:50,958 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 76) AMQ221003: trying to deploy queue jms.queue.ExpiryQueue 16:20:50,963 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 74) AMQ221003: trying to deploy queue jms.queue.HawkularAlertsPluginsQueue 16:20:50,969 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 71) AMQ221003: trying to deploy queue jms.queue.hawkular/metrics/counters/new 16:20:50,975 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 66) AMQ221003: trying to deploy queue jms.queue.DLQ 16:20:50,978 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 64) AMQ221003: trying to deploy queue jms.queue.hawkular/metrics/availability/new 16:20:50,982 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 70) AMQ221003: trying to deploy queue jms.queue.HawkularAlertsActionsResponseQueue 16:20:50,994 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 68) AMQ221003: trying to deploy queue jms.topic.HawkularCommandEvent 16:20:51,009 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 69) AMQ221003: trying to deploy queue jms.topic.HawkularTopic 16:20:51,022 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 65) AMQ221003: trying to deploy queue jms.topic.HawkularAlertsActionsTopic 16:20:51,026 INFO [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 67) AMQ221003: trying to deploy queue jms.topic.HawkularQueue 16:20:51,474 INFO [org.wildfly.extension.messaging-activemq] (ServerService Thread Pool -- 72) WFLYMSGAMQ0002: Bound messaging object to jndi name java:/ConnectionFactory 16:20:51,476 INFO [org.wildfly.extension.messaging-activemq] (ServerService Thread Pool -- 72) WFLYMSGAMQ0002: Bound messaging object to jndi name java:/HawkularBusConnectionFactory 16:20:51,481 INFO [org.apache.activemq.artemis.jms.server] (ServerService Thread Pool -- 75) AMQ121005: Invalid "host" value "0.0.0.0" detected for "http-connector" connector. Switching to "hawkular-services-2-vgsd2". If this new address is incorrect please manually configure the connector to use the proper one. 16:20:51,483 INFO [org.wildfly.extension.messaging-activemq] (ServerService Thread Pool -- 75) WFLYMSGAMQ0002: Bound messaging object to jndi name java:jboss/exported/jms/RemoteConnectionFactory 16:20:51,594 INFO [org.hibernate.validator.internal.util.Version] (MSC service thread 1-3) HV000001: Hibernate Validator 5.2.4.Final 16:20:51,736 INFO [org.jboss.as.connector.deployment] (MSC service thread 1-4) WFLYJCA0007: Registered connection factory java:/JmsXA 16:20:51,982 INFO [org.apache.activemq.artemis.ra] (MSC service thread 1-4) Resource adaptor started 16:20:51,984 INFO [org.jboss.as.connector.services.resourceadapters.ResourceAdapterActivatorService$ResourceAdapterActivator] (MSC service thread 1-4) IJ020002: Deployed: file://RaActivatoractivemq-ra 16:20:52,004 INFO [org.jboss.weld.deployer] (MSC service thread 1-4) WFLYWELD0003: Processing weld deployment hawkular-status.war 16:20:52,011 INFO [org.jboss.weld.deployer] (MSC service thread 1-7) WFLYWELD0003: Processing weld deployment hawkular-wildfly-agent-download.war 16:20:52,018 INFO [org.jboss.as.connector.deployment] (MSC service thread 1-1) WFLYJCA0002: Bound JCA ConnectionFactory [java:/JmsXA] 16:20:52,019 INFO [org.wildfly.extension.messaging-activemq] (MSC service thread 1-1) WFLYMSGAMQ0002: Bound messaging object to jndi name java:jboss/DefaultJMSConnectionFactory 16:20:52,494 INFO [org.jboss.weld.Version] (MSC service thread 1-3) WELD-000900: 2.3.5 (Final) 16:20:54,974 WARN [org.jboss.as.server.deployment] (MSC service thread 1-6) WFLYSRV0001: /content/hawkular-metrics.ear/hawkular-metrics.war/WEB-INF/jboss-deployment-structure.xml in subdeployment ignored. jboss-deployment-structure.xml is only parsed for top level deployments. 16:20:55,370 INFO [org.hawkular.agent.javaagent.JavaAgentEngine] (Hawkular Java Agent Start Thread) HAWKJAVAAGENT010000: Loaded configuration file [/opt/jboss/wildfly/standalone/configuration/hawkular-javaagent-config.yaml] 16:20:55,380 INFO [org.hawkular.agent.monitor.service.AgentCoreEngine] (Hawkular Java Agent Start Thread) HAWKAGENT010084: Hawkular Agent: Javaagent version 2.0.0.Alpha1-SRC-revision-5a4c645c9974e6978f5fa73d2f701364998bd780 16:20:55,381 INFO [org.hawkular.agent.monitor.service.AgentCoreEngine] (Hawkular Java Agent Start Thread) HAWKAGENT010000: Starting Hawkular Agent 16:20:55,404 INFO [io.undertow.websockets.jsr] (ServerService Thread Pool -- 72) UT026003: Adding annotated server endpoint class org.hawkular.cmdgw.command.ws.server.UIClientWebSocket for path /ui/ws 16:20:55,434 INFO [io.undertow.websockets.jsr] (ServerService Thread Pool -- 72) UT026003: Adding annotated server endpoint class org.hawkular.cmdgw.command.ws.server.FeedWebSocket for path /feed/{feedId} 16:20:55,625 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 72) WFLYUT0021: Registered web context: /hawkular/command-gateway 16:20:55,629 INFO [io.undertow.servlet] (ServerService Thread Pool -- 70) org.hawkular.component.wildflymonitor.WildFlyAgentServlet: Starting the WildFly Agent download servlet 16:20:55,630 INFO [io.undertow.servlet] (ServerService Thread Pool -- 70) org.hawkular.component.wildflymonitor.WildFlyAgentServlet: Latest Agent Module File: /opt/jboss/wildfly/standalone/configuration/hawkular-wildfly-agent-wf-extension.zip 16:20:55,630 INFO [io.undertow.servlet] (ServerService Thread Pool -- 70) org.hawkular.component.wildflymonitor.WildFlyAgentServlet: EAP6 Agent Module File: /opt/jboss/wildfly/standalone/configuration/hawkular-wildfly-agent-wf-extension-eap6.zip 16:20:55,630 INFO [io.undertow.servlet] (ServerService Thread Pool -- 70) org.hawkular.component.wildflymonitor.WildFlyAgentServlet: Agent Installer File: /opt/jboss/wildfly/standalone/configuration/hawkular-wildfly-agent-installer.jar 16:20:55,631 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 70) WFLYUT0021: Registered web context: /hawkular/wildfly-agent 16:20:55,748 INFO [org.jboss.weld.deployer] (MSC service thread 1-1) WFLYWELD0003: Processing weld deployment hawkular-inventory-service.war 16:20:55,759 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'InventoryConfig' in deployment unit 'deployment "hawkular-inventory-service.war"' are as follows: java:global/hawkular-inventory-service/InventoryConfig!org.hawkular.inventory.service.InventoryConfig java:app/hawkular-inventory-service/InventoryConfig!org.hawkular.inventory.service.InventoryConfig java:module/InventoryConfig!org.hawkular.inventory.service.InventoryConfig java:global/hawkular-inventory-service/InventoryConfig java:app/hawkular-inventory-service/InventoryConfig java:module/InventoryConfig 16:20:55,761 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'InventoryServiceIspn' in deployment unit 'deployment "hawkular-inventory-service.war"' are as follows: java:global/hawkular-inventory-service/InventoryServiceIspn!org.hawkular.inventory.api.InventoryService java:app/hawkular-inventory-service/InventoryServiceIspn!org.hawkular.inventory.api.InventoryService java:module/InventoryServiceIspn!org.hawkular.inventory.api.InventoryService java:global/hawkular-inventory-service/InventoryServiceIspn java:app/hawkular-inventory-service/InventoryServiceIspn java:module/InventoryServiceIspn 16:20:55,761 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'InventoryStats' in deployment unit 'deployment "hawkular-inventory-service.war"' are as follows: java:global/hawkular-inventory-service/InventoryStats!org.hawkular.inventory.service.InventoryStatsMBean java:app/hawkular-inventory-service/InventoryStats!org.hawkular.inventory.service.InventoryStatsMBean java:module/InventoryStats!org.hawkular.inventory.service.InventoryStatsMBean java:global/hawkular-inventory-service/InventoryStats java:app/hawkular-inventory-service/InventoryStats java:module/InventoryStats 16:20:55,898 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated. 16:20:55,899 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 70) ISPN000152: Passivation configured without an eviction policy being selected. Only manually evicted entities will be passivated. 16:20:55,991 WARN [org.jboss.as.dependency.private] (MSC service thread 1-1) WFLYSRV0018: Deployment "deployment.hawkular-metrics.ear" is using a private module ("org.infinispan:main") which may be changed or removed in future versions without notice. 16:20:56,136 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 71) RESTEASY002225: Deploying javax.ws.rs.core.Application: class org.hawkular.services.rest.HawkularServicesStatusApp$Proxy$_$$_WeldClientProxy 16:20:56,168 WARN [org.jboss.as.dependency.private] (MSC service thread 1-3) WFLYSRV0018: Deployment "deployment.hawkular-metrics.ear.hawkular-alerts.war" is using a private module ("com.google.guava:main") which may be changed or removed in future versions without notice. 16:20:56,191 INFO [org.jboss.weld.deployer] (MSC service thread 1-2) WFLYWELD0003: Processing weld deployment hawkular-metrics.ear 16:20:56,270 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 71) WFLYUT0021: Registered web context: /hawkular 16:20:56,285 INFO [org.jboss.weld.deployer] (MSC service thread 1-1) WFLYWELD0003: Processing weld deployment hawkular-alerts-action-elasticsearch.war 16:20:56,285 INFO [org.jboss.weld.deployer] (MSC service thread 1-4) WFLYWELD0003: Processing weld deployment hawkular-elasticsearch-alerter.war 16:20:56,285 INFO [org.jboss.weld.deployer] (MSC service thread 1-8) WFLYWELD0003: Processing weld deployment hawkular-alerts-action-email.war 16:20:56,285 INFO [org.jboss.weld.deployer] (MSC service thread 1-6) WFLYWELD0003: Processing weld deployment hawkular-alerts-action-webhook.war 16:20:56,319 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-6) WFLYEJB0473: JNDI bindings for session bean named 'StandaloneActionPluginRegister' in deployment unit 'subdeployment "hawkular-alerts-action-webhook.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts-action-webhook/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:app/hawkular-alerts-action-webhook/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:module/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:global/hawkular-metrics/hawkular-alerts-action-webhook/StandaloneActionPluginRegister java:app/hawkular-alerts-action-webhook/StandaloneActionPluginRegister java:module/StandaloneActionPluginRegister 16:20:56,319 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-4) WFLYEJB0473: JNDI bindings for session bean named 'ElasticsearchAlerter' in deployment unit 'subdeployment "hawkular-elasticsearch-alerter.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-elasticsearch-alerter/ElasticsearchAlerter!org.hawkular.alerter.elasticsearch.ElasticsearchAlerter java:app/hawkular-elasticsearch-alerter/ElasticsearchAlerter!org.hawkular.alerter.elasticsearch.ElasticsearchAlerter java:module/ElasticsearchAlerter!org.hawkular.alerter.elasticsearch.ElasticsearchAlerter java:global/hawkular-metrics/hawkular-elasticsearch-alerter/ElasticsearchAlerter java:app/hawkular-elasticsearch-alerter/ElasticsearchAlerter java:module/ElasticsearchAlerter 16:20:56,319 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-8) WFLYEJB0473: JNDI bindings for session bean named 'StandaloneActionPluginRegister' in deployment unit 'subdeployment "hawkular-alerts-action-email.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts-action-email/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:app/hawkular-alerts-action-email/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:module/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:global/hawkular-metrics/hawkular-alerts-action-email/StandaloneActionPluginRegister java:app/hawkular-alerts-action-email/StandaloneActionPluginRegister java:module/StandaloneActionPluginRegister 16:20:56,320 INFO [org.jboss.weld.deployer] (MSC service thread 1-2) WFLYWELD0003: Processing weld deployment hawkular-metrics-alerter.war 16:20:56,320 INFO [org.jboss.weld.deployer] (MSC service thread 1-5) WFLYWELD0003: Processing weld deployment hawkular-metrics.war 16:20:56,320 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'StandaloneActionPluginRegister' in deployment unit 'subdeployment "hawkular-alerts-action-elasticsearch.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts-action-elasticsearch/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:app/hawkular-alerts-action-elasticsearch/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:module/StandaloneActionPluginRegister!org.hawkular.alerts.actions.standalone.StandaloneActionPluginRegister java:global/hawkular-metrics/hawkular-alerts-action-elasticsearch/StandaloneActionPluginRegister java:app/hawkular-alerts-action-elasticsearch/StandaloneActionPluginRegister java:module/StandaloneActionPluginRegister 16:20:56,324 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-2) WFLYEJB0473: JNDI bindings for session bean named 'ConditionManager' in deployment unit 'subdeployment "hawkular-metrics-alerter.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-metrics-alerter/ConditionManager!org.hawkular.metrics.alerter.ConditionManager java:app/hawkular-metrics-alerter/ConditionManager!org.hawkular.metrics.alerter.ConditionManager java:module/ConditionManager!org.hawkular.metrics.alerter.ConditionManager java:global/hawkular-metrics/hawkular-metrics-alerter/ConditionManager java:app/hawkular-metrics-alerter/ConditionManager java:module/ConditionManager 16:20:56,324 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-2) WFLYEJB0473: JNDI bindings for session bean named 'GroupTriggerManager' in deployment unit 'subdeployment "hawkular-metrics-alerter.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-metrics-alerter/GroupTriggerManager!org.hawkular.metrics.alerter.groups.GroupTriggerManager java:app/hawkular-metrics-alerter/GroupTriggerManager!org.hawkular.metrics.alerter.groups.GroupTriggerManager java:module/GroupTriggerManager!org.hawkular.metrics.alerter.groups.GroupTriggerManager java:global/hawkular-metrics/hawkular-metrics-alerter/GroupTriggerManager java:app/hawkular-metrics-alerter/GroupTriggerManager java:module/GroupTriggerManager 16:20:56,328 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-5) WFLYEJB0473: JNDI bindings for session bean named 'MetricsJNDIPublisher' in deployment unit 'subdeployment "hawkular-metrics.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-metrics/MetricsJNDIPublisher!org.hawkular.metrics.component.MetricsJNDIPublisher java:app/hawkular-metrics/MetricsJNDIPublisher!org.hawkular.metrics.component.MetricsJNDIPublisher java:module/MetricsJNDIPublisher!org.hawkular.metrics.component.MetricsJNDIPublisher java:global/hawkular-metrics/hawkular-metrics/MetricsJNDIPublisher java:app/hawkular-metrics/MetricsJNDIPublisher java:module/MetricsJNDIPublisher 16:20:56,445 INFO [org.jboss.weld.deployer] (MSC service thread 1-7) WFLYWELD0003: Processing weld deployment hawkular-alerts.war 16:20:56,453 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'DroolsRulesEngineImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/DroolsRulesEngineImpl!org.hawkular.alerts.engine.service.RulesEngine java:app/hawkular-alerts/DroolsRulesEngineImpl!org.hawkular.alerts.engine.service.RulesEngine java:module/DroolsRulesEngineImpl!org.hawkular.alerts.engine.service.RulesEngine java:global/hawkular-metrics/hawkular-alerts/DroolsRulesEngineImpl java:app/hawkular-alerts/DroolsRulesEngineImpl java:module/DroolsRulesEngineImpl 16:20:56,454 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'CepEngineImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/CepEngineImpl!org.hawkular.alerts.extensions.CepEngine java:app/hawkular-alerts/CepEngineImpl!org.hawkular.alerts.extensions.CepEngine java:module/CepEngineImpl!org.hawkular.alerts.extensions.CepEngine java:global/hawkular-metrics/hawkular-alerts/CepEngineImpl java:app/hawkular-alerts/CepEngineImpl java:module/CepEngineImpl 16:20:56,454 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'PropertiesServiceImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/PropertiesServiceImpl!org.hawkular.alerts.api.services.PropertiesService java:app/hawkular-alerts/PropertiesServiceImpl!org.hawkular.alerts.api.services.PropertiesService java:module/PropertiesServiceImpl!org.hawkular.alerts.api.services.PropertiesService java:global/hawkular-metrics/hawkular-alerts/PropertiesServiceImpl java:app/hawkular-alerts/PropertiesServiceImpl java:module/PropertiesServiceImpl 16:20:56,454 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'IncomingDataManagerImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/IncomingDataManagerImpl!org.hawkular.alerts.engine.service.IncomingDataManager java:app/hawkular-alerts/IncomingDataManagerImpl!org.hawkular.alerts.engine.service.IncomingDataManager java:module/IncomingDataManagerImpl!org.hawkular.alerts.engine.service.IncomingDataManager java:global/hawkular-metrics/hawkular-alerts/IncomingDataManagerImpl java:app/hawkular-alerts/IncomingDataManagerImpl java:module/IncomingDataManagerImpl 16:20:56,454 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'AlertsContext' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/AlertsContext!org.hawkular.alerts.engine.impl.AlertsContext java:app/hawkular-alerts/AlertsContext!org.hawkular.alerts.engine.impl.AlertsContext java:module/AlertsContext!org.hawkular.alerts.engine.impl.AlertsContext java:global/hawkular-metrics/hawkular-alerts/AlertsContext java:app/hawkular-alerts/AlertsContext java:module/AlertsContext 16:20:56,455 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'AlertsEngineImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/AlertsEngineImpl!org.hawkular.alerts.engine.service.AlertsEngine java:app/hawkular-alerts/AlertsEngineImpl!org.hawkular.alerts.engine.service.AlertsEngine java:module/AlertsEngineImpl!org.hawkular.alerts.engine.service.AlertsEngine java:global/hawkular-metrics/hawkular-alerts/AlertsEngineImpl java:app/hawkular-alerts/AlertsEngineImpl java:module/AlertsEngineImpl 16:20:56,455 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'CassActionsServiceImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/CassActionsServiceImpl!org.hawkular.alerts.api.services.ActionsService java:app/hawkular-alerts/CassActionsServiceImpl!org.hawkular.alerts.api.services.ActionsService java:module/CassActionsServiceImpl!org.hawkular.alerts.api.services.ActionsService java:global/hawkular-metrics/hawkular-alerts/CassActionsServiceImpl java:app/hawkular-alerts/CassActionsServiceImpl java:module/CassActionsServiceImpl 16:20:56,455 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'PartitionManagerImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/PartitionManagerImpl!org.hawkular.alerts.engine.service.PartitionManager java:app/hawkular-alerts/PartitionManagerImpl!org.hawkular.alerts.engine.service.PartitionManager java:module/PartitionManagerImpl!org.hawkular.alerts.engine.service.PartitionManager java:global/hawkular-metrics/hawkular-alerts/PartitionManagerImpl java:app/hawkular-alerts/PartitionManagerImpl java:module/PartitionManagerImpl 16:20:56,455 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'CassAlertsServiceImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/CassAlertsServiceImpl!org.hawkular.alerts.api.services.AlertsService java:app/hawkular-alerts/CassAlertsServiceImpl!org.hawkular.alerts.api.services.AlertsService java:module/CassAlertsServiceImpl!org.hawkular.alerts.api.services.AlertsService java:global/hawkular-metrics/hawkular-alerts/CassAlertsServiceImpl java:app/hawkular-alerts/CassAlertsServiceImpl java:module/CassAlertsServiceImpl 16:20:56,456 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'StatusServiceImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/StatusServiceImpl!org.hawkular.alerts.api.services.StatusService java:app/hawkular-alerts/StatusServiceImpl!org.hawkular.alerts.api.services.StatusService java:module/StatusServiceImpl!org.hawkular.alerts.api.services.StatusService java:global/hawkular-metrics/hawkular-alerts/StatusServiceImpl java:app/hawkular-alerts/StatusServiceImpl java:module/StatusServiceImpl 16:20:56,456 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'StreamWatcher' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/StreamWatcher!org.hawkular.alerts.rest.StreamWatcher java:app/hawkular-alerts/StreamWatcher!org.hawkular.alerts.rest.StreamWatcher java:module/StreamWatcher!org.hawkular.alerts.rest.StreamWatcher java:global/hawkular-metrics/hawkular-alerts/StreamWatcher java:app/hawkular-alerts/StreamWatcher java:module/StreamWatcher 16:20:56,456 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'PublishCacheManager' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/PublishCacheManager!org.hawkular.alerts.engine.cache.PublishCacheManager java:app/hawkular-alerts/PublishCacheManager!org.hawkular.alerts.engine.cache.PublishCacheManager java:module/PublishCacheManager!org.hawkular.alerts.engine.cache.PublishCacheManager java:global/hawkular-metrics/hawkular-alerts/PublishCacheManager java:app/hawkular-alerts/PublishCacheManager java:module/PublishCacheManager 16:20:56,457 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'DataDrivenGroupCacheManager' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/DataDrivenGroupCacheManager!org.hawkular.alerts.engine.impl.DataDrivenGroupCacheManager java:app/hawkular-alerts/DataDrivenGroupCacheManager!org.hawkular.alerts.engine.impl.DataDrivenGroupCacheManager java:module/DataDrivenGroupCacheManager!org.hawkular.alerts.engine.impl.DataDrivenGroupCacheManager java:global/hawkular-metrics/hawkular-alerts/DataDrivenGroupCacheManager java:app/hawkular-alerts/DataDrivenGroupCacheManager java:module/DataDrivenGroupCacheManager 16:20:56,457 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'ExtensionsServiceImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/ExtensionsServiceImpl!org.hawkular.alerts.api.services.ExtensionsService java:app/hawkular-alerts/ExtensionsServiceImpl!org.hawkular.alerts.api.services.ExtensionsService java:module/ExtensionsServiceImpl!org.hawkular.alerts.api.services.ExtensionsService java:global/hawkular-metrics/hawkular-alerts/ExtensionsServiceImpl java:app/hawkular-alerts/ExtensionsServiceImpl java:module/ExtensionsServiceImpl 16:20:56,457 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'EventsAggregationExtension' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/EventsAggregationExtension!org.hawkular.alerts.api.services.EventExtension java:app/hawkular-alerts/EventsAggregationExtension!org.hawkular.alerts.api.services.EventExtension java:module/EventsAggregationExtension!org.hawkular.alerts.api.services.EventExtension java:global/hawkular-metrics/hawkular-alerts/EventsAggregationExtension java:app/hawkular-alerts/EventsAggregationExtension java:module/EventsAggregationExtension 16:20:56,457 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'CassCluster' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/CassCluster!org.hawkular.alerts.engine.impl.CassCluster java:app/hawkular-alerts/CassCluster!org.hawkular.alerts.engine.impl.CassCluster java:module/CassCluster!org.hawkular.alerts.engine.impl.CassCluster java:global/hawkular-metrics/hawkular-alerts/CassCluster java:app/hawkular-alerts/CassCluster java:module/CassCluster 16:20:56,458 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'CassDefinitionsServiceImpl' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/CassDefinitionsServiceImpl!org.hawkular.alerts.api.services.DefinitionsService java:app/hawkular-alerts/CassDefinitionsServiceImpl!org.hawkular.alerts.api.services.DefinitionsService java:module/CassDefinitionsServiceImpl!org.hawkular.alerts.api.services.DefinitionsService java:global/hawkular-metrics/hawkular-alerts/CassDefinitionsServiceImpl java:app/hawkular-alerts/CassDefinitionsServiceImpl java:module/CassDefinitionsServiceImpl 16:20:56,458 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-7) WFLYEJB0473: JNDI bindings for session bean named 'ActionsCacheManager' in deployment unit 'subdeployment "hawkular-alerts.war" of deployment "hawkular-metrics.ear"' are as follows: java:global/hawkular-metrics/hawkular-alerts/ActionsCacheManager!org.hawkular.alerts.engine.cache.ActionsCacheManager java:app/hawkular-alerts/ActionsCacheManager!org.hawkular.alerts.engine.cache.ActionsCacheManager java:module/ActionsCacheManager!org.hawkular.alerts.engine.cache.ActionsCacheManager java:global/hawkular-metrics/hawkular-alerts/ActionsCacheManager java:app/hawkular-alerts/ActionsCacheManager java:module/ActionsCacheManager 16:20:56,533 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 70) WFLYCLINF0002: Started client-mappings cache from ejb container 16:20:56,701 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 70) WFLYCLINF0002: Started triggers cache from hawkular-alerts container 16:20:56,702 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 68) WFLYCLINF0002: Started globalActions cache from hawkular-alerts container 16:20:56,708 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 64) WFLYCLINF0002: Started publish cache from hawkular-alerts container 16:20:56,708 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 72) WFLYCLINF0002: Started data cache from hawkular-alerts container 16:20:56,708 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 65) WFLYCLINF0002: Started schema cache from hawkular-alerts container 16:20:56,709 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 71) WFLYCLINF0002: Started partition cache from hawkular-alerts container 16:20:56,710 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 66) WFLYCLINF0002: Started dataIds cache from hawkular-alerts container 16:20:57,782 INFO [org.infinispan.factories.GlobalComponentRegistry] (ServerService Thread Pool -- 71) ISPN000128: Infinispan version: Infinispan 'Bastille' 9.1.1.Final 16:20:57,924 INFO [org.hawkular.alerts.engine.log] (ServerService Thread Pool -- 70) HAWKALERT220014: Hawkular Alerts deployed in single node mode 16:20:57,925 INFO [org.hawkular.alerts.engine.log] (ServerService Thread Pool -- 73) HAWKALERT220023: Init Actions Cache 16:20:57,931 INFO [org.hawkular.alerts.extensions.EventsAggregationExtension] (ServerService Thread Pool -- 62) Registering Distributed Trigger listener 16:20:57,932 WARN [org.hawkular.alerts.engine.log] (ServerService Thread Pool -- 76) HAWKALERT220021: Clear Publish Cache 16:20:57,932 INFO [org.hawkular.alerts.engine.log] (ServerService Thread Pool -- 76) HAWKALERT220020: Init Publish Cache 16:20:57,970 INFO [com.datastax.driver.core.GuavaCompatibility] (ServerService Thread Pool -- 63) Detected Guava < 19 in the classpath, using legacy compatibility layer 16:20:57,980 INFO [com.datastax.driver.core.Native] (ServerService Thread Pool -- 63) Could not load JNR C Library, native system calls through this library will not be available (set this logger level to DEBUG to see the full stack trace). 16:20:57,980 INFO [com.datastax.driver.core.ClockFactory] (ServerService Thread Pool -- 63) Using java.lang.System clock to generate timestamps. 16:20:58,036 INFO [com.datastax.driver.core.NettyUtil] (ServerService Thread Pool -- 63) Found Netty's native epoll transport in the classpath, using it 16:20:58,317 INFO [org.infinispan.query.impl.LifecycleManager] (ServerService Thread Pool -- 71) ISPN014003: Registering Query interceptor for cache resource 16:20:58,365 INFO [org.hibernate.search.engine.Version] (ServerService Thread Pool -- 71) HSEARCH000034: Hibernate Search 5.8.0.Final 16:20:58,393 INFO [org.hibernate.annotations.common.Version] (ServerService Thread Pool -- 71) HCANN000001: Hibernate Commons Annotations {5.0.1.Final} 16:20:59,197 INFO [org.infinispan.query.impl.LifecycleManager] (ServerService Thread Pool -- 71) ISPN014003: Registering Query interceptor for cache resource_type 16:20:59,334 INFO [org.hawkular.inventory.service.InventoryConfig] (ServerService Thread Pool -- 71) HAWKINV100003: Inventory is reindexing caches 16:20:59,525 INFO [org.infinispan.query.impl.massindex.IndexUpdater] (DefaultExecutorService--p24-t1) ISPN014016: Purging instances of 'org.hawkular.inventory.service.ispn.IspnResource' from the index 16:20:59,531 INFO [org.infinispan.query.impl.massindex.IndexUpdater] (DefaultExecutorService--p25-t1) ISPN014016: Purging instances of 'org.hawkular.inventory.service.ispn.IspnResourceType' from the index 16:20:59,619 INFO [org.infinispan.query.impl.massindex.IndexUpdater] (DefaultExecutorService--p25-t1) ISPN014017: Flushing index 'org.hawkular.inventory.service.ispn.IspnResourceType' 16:20:59,619 INFO [org.infinispan.query.impl.massindex.IndexUpdater] (DefaultExecutorService--p24-t1) ISPN014017: Flushing index 'org.hawkular.inventory.service.ispn.IspnResource' 16:20:59,622 INFO [org.hawkular.inventory.service.InventoryConfig] (ServerService Thread Pool -- 71) HAWKINV100004: Inventory finished reindexing in [287] ms 16:20:59,623 INFO [org.hawkular.inventory.service.InventoryConfig] (ServerService Thread Pool -- 71) HAWKINV100000: Inventory App Started 16:20:59,725 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 64) RESTEASY002225: Deploying javax.ws.rs.core.Application: class org.hawkular.inventory.handlers.InventoryApp$Proxy$_$$_WeldClientProxy 16:20:59,781 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 64) WFLYUT0021: Registered web context: /hawkular/inventory 16:20:59,842 INFO [org.jboss.weld.deployer] (MSC service thread 1-7) WFLYWELD0003: Processing weld deployment hawkular-inventory-ui.war 16:21:00,147 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 72) WFLYUT0021: Registered web context: /hawkular/inventory/ui 16:21:01,289 WARN [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Could not connect to Cassandra cluster - assuming is not up yet. Cause: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: hawkular-cassandra/172.30.23.124:9042 (com.datastax.driver.core.exceptions.TransportException: [hawkular-cassandra/172.30.23.124:9042] Cannot connect)) 16:21:01,290 WARN [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) [15] Retrying connecting to Cassandra cluster in [3000]ms... 16:21:04,290 INFO [com.datastax.driver.core.ClockFactory] (ServerService Thread Pool -- 63) Using java.lang.System clock to generate timestamps. 16:21:04,806 INFO [com.datastax.driver.core.policies.DCAwareRoundRobinPolicy] (ServerService Thread Pool -- 63) Using data-center name 'datacenter1' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) 16:21:04,809 INFO [com.datastax.driver.core.Cluster] (ServerService Thread Pool -- 63) New Cassandra host hawkular-cassandra/172.30.23.124:9042 added 16:21:04,879 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Checking Schema existence for keyspace: hawkular_alerts 16:21:06,372 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Executing [script:vfs:/content/hawkular-metrics.ear/hawkular-alerts.war/WEB-INF/lib/hawkular-alerts-engine-1.6.2.Final.jar/org/hawkular/alerts/schema/cassalog.groovy, tags:[], vars:[keyspace:hawkular_alerts, reset:false, session:com.datastax.driver.core.SessionManager@99b70c3, logger:org.jboss.logging.JBossLogManagerLogger@20126a0a]] 16:21:07,302 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table triggers 16:21:07,525 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table triggers_actions 16:21:07,682 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table conditions 16:21:08,112 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table dampenings 16:21:08,404 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table action_plugins 16:21:08,498 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table actions_definitions 16:21:08,646 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table actions_history 16:21:08,818 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table actions_history_actions 16:21:08,950 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table actions_history_alerts 16:21:09,084 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table actions_history_ctimes 16:21:09,217 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table actions_history_results 16:21:09,360 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table tags 16:21:09,504 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table alerts 16:21:09,634 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table alerts_triggers 16:21:09,777 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table alerts_ctimes 16:21:09,960 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table alerts_statuses 16:21:10,110 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table alerts_severities 16:21:10,257 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table alerts_lifecycle 16:21:10,384 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table events 16:21:10,514 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table events_triggers 16:21:10,649 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table events_ctimes 16:21:10,773 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Creating table events_categories 16:21:11,231 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Creating change log table hawkular_alerts.cassalog 16:21:11,466 WARN [com.datastax.driver.core.Cluster] (cluster2-worker-10) Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='UPDATE hawkular_alerts.cassalog SET applied_at = ? WHERE bucket = ? AND revision = ?' 16:21:11,488 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: set-keyspace USE hawkular_alerts -- 16:21:11,573 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: set-keyspace USE hawkular_alerts -- 16:21:11,586 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: 1.0 CREATE TABLE sys_config ( config_id text, name text, value text, PRIMARY KEY (config_id, name) ) -- 16:21:11,722 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: set-keyspace USE hawkular_alerts -- 16:21:11,732 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: 2.0 ALTER TABLE conditions ADD interval bigint -- 16:21:11,871 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: set-keyspace USE hawkular_alerts -- 16:21:11,880 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: 3.0 DROP TABLE alerts_statuses -- 16:21:12,131 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: 3.1 DROP TABLE alerts_severities -- 16:21:12,299 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: set-keyspace USE hawkular_alerts -- 16:21:12,307 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: 4.0 ALTER TABLE conditions ADD activeRules set -- 16:21:12,445 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: 4.1 ALTER TABLE conditions ADD sampleSize int -- 16:21:12,570 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: set-keyspace USE hawkular_alerts -- 16:21:12,578 INFO [org.cassalog.core.CassalogImpl] (ServerService Thread Pool -- 63) Applying ChangeSet -- version: 5.0 CREATE TABLE alerts_stimes ( tenantId text, alertId text, stime bigint, PRIMARY KEY (tenantId, stime, alertId) ) -- 16:21:12,808 INFO [org.hawkular.alerts.engine.impl.CassCluster] (ServerService Thread Pool -- 63) Done creating Schema for keyspace: hawkular_alerts 16:21:12,813 INFO [org.hawkular.alerts.engine.impl.ExtensionsServiceImpl] (ServerService Thread Pool -- 62) Adding EventExtension org.hawkular.alerts.extensions.EventsAggregationExtension@2e9bc68f 16:21:12,854 INFO [org.drools.compiler.kie.builder.impl.ClasspathKieProject] (EE-ManagedExecutorService-default-Thread-1) Found kmodule: vfs:/content/hawkular-metrics.ear/hawkular-alerts.war/WEB-INF/lib/hawkular-alerts-engine-1.6.2.Final.jar/META-INF/kmodule.xml 16:21:12,858 INFO [org.drools.compiler.kie.builder.impl.ClasspathKieProject] (EE-ManagedExecutorService-default-Thread-1) Virtual file physical path = /opt/jboss/wildfly/standalone/tmp/vfs/deployment/deploymentabc0a126504ab08b/hawkular-alerts-engine-1.6.2.Final.jar-a54bc4e3f5bac83d/hawkular-alerts-engine-1.6.2.Final.jar 16:21:12,923 INFO [javax.enterprise.resource.webcontainer.jsf.config] (ServerService Thread Pool -- 73) Initializing Mojarra 2.2.13.SP1 20160303-1204 for context '/hawkular/alerts' 16:21:13,340 INFO [org.drools.compiler.kie.builder.impl.KieRepositoryImpl] (EE-ManagedExecutorService-default-Thread-1) KieModule was added: ZipKieModule[releaseId=org.hawkular.alerts:hawkular-alerts-engine:1.6.2.Final,file=/opt/jboss/wildfly/standalone/tmp/vfs/deployment/deploymentabc0a126504ab08b/hawkular-alerts-engine-1.6.2.Final.jar-a54bc4e3f5bac83d/hawkular-alerts-engine-1.6.2.Final.jar] 16:21:15,357 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 73) RESTEASY002225: Deploying javax.ws.rs.core.Application: class org.hawkular.alerts.rest.HawkularAlertsApp$Proxy$_$$_WeldClientProxy 16:21:16,010 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 73) WFLYUT0021: Registered web context: /hawkular/alerts 16:21:16,094 INFO [org.hawkular.alerts.engine.log] (ServerService Thread Pool -- 76) HAWKALERT220006: ActionListener [org.hawkular.alerts.actions.standalone.StandaloneActionPluginListener@ae57df8] registered 16:21:16,094 INFO [org.hawkular.alerts.actions.standalone] (ServerService Thread Pool -- 76) HAWKALERT270001: Action plugin [elasticsearch] registered 16:21:16,112 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 76) WFLYUT0021: Registered web context: /hawkular/actions/elasticsearch 16:21:16,569 INFO [org.hawkular.alerts.engine.log] (ServerService Thread Pool -- 76) HAWKALERT220006: ActionListener [org.hawkular.alerts.actions.standalone.StandaloneActionPluginListener@1ff42ea9] registered 16:21:16,570 INFO [org.hawkular.alerts.actions.standalone] (ServerService Thread Pool -- 76) HAWKALERT270001: Action plugin [email] registered 16:21:16,588 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 76) WFLYUT0021: Registered web context: /hawkular/actions/email 16:21:16,653 INFO [org.hawkular.alerts.engine.log] (ServerService Thread Pool -- 76) HAWKALERT220006: ActionListener [org.hawkular.alerts.actions.standalone.StandaloneActionPluginListener@750cb9f8] registered 16:21:16,653 INFO [org.hawkular.alerts.actions.standalone] (ServerService Thread Pool -- 76) HAWKALERT270001: Action plugin [webhook] registered 16:21:16,702 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 76) RESTEASY002225: Deploying javax.ws.rs.core.Application: class org.hawkular.alerts.actions.webhook.WebHookApp 16:21:16,710 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 76) WFLYUT0021: Registered web context: /hawkular/actions/webhook 16:21:16,781 INFO [javax.enterprise.resource.webcontainer.jsf.config] (ServerService Thread Pool -- 72) Initializing Mojarra 2.2.13.SP1 20160303-1204 for context '/hawkular/__alerter-elasticsearch' 16:21:17,131 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 72) WFLYUT0021: Registered web context: /hawkular/__alerter-elasticsearch 16:21:17,164 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 72) WFLYCLINF0002: Started locks cache from hawkular-metrics container 16:21:17,274 INFO [org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] (ServerService Thread Pool -- 64) Hawkular Metrics version: 0.26.1.Final 16:21:17,277 INFO [org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] (metricsservice-lifecycle-thread) HAWKMETRICS200002: Initializing metrics service 16:21:17,281 INFO [com.datastax.driver.core.ClockFactory] (metricsservice-lifecycle-thread) Using java.lang.System clock to generate timestamps. 16:21:17,282 INFO [javax.enterprise.resource.webcontainer.jsf.config] (ServerService Thread Pool -- 64) Initializing Mojarra 2.2.13.SP1 20160303-1204 for context '/hawkular/metrics' 16:21:17,391 INFO [com.datastax.driver.core.policies.DCAwareRoundRobinPolicy] (metricsservice-lifecycle-thread) Using data-center name 'datacenter1' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) 16:21:17,392 INFO [com.datastax.driver.core.Cluster] (metricsservice-lifecycle-thread) New Cassandra host hawkular-cassandra/172.30.23.124:9042 added 16:21:17,535 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Executing [script:vfs:/content/hawkular-metrics.ear/hawkular-metrics.war/WEB-INF/lib/hawkular-metrics-schema-0.26.1.Final.jar/org/hawkular/schema/cassalog.groovy, tags:[0.15.x, 0.18.x, 0.19.x, 0.20.x, 0.21.x, 0.23.x, 0.26.x], vars:[keyspace:hawkular_metrics, reset:false, session:com.datastax.driver.core.SessionManager@512b917d, replicationFactor:1, logger:org.jboss.logging.JBossLogManagerLogger@16589449]] 16:21:17,719 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating table tenants 16:21:17,829 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating type aggregation_template 16:21:17,913 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating table tenants_by_time 16:21:18,067 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating type aggregate_data 16:21:18,185 INFO [org.hawkular.metrics.api.jaxrs.HawkularMetricsRestApp] (ServerService Thread Pool -- 64) HAWKMETRICS200001: Hawkular Metrics starting 16:21:18,185 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 64) RESTEASY002225: Deploying javax.ws.rs.core.Application: class org.hawkular.metrics.api.jaxrs.HawkularMetricsRestApp 16:21:18,251 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating table data 16:21:18,378 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating table metrics_tags_idx 16:21:18,453 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating table metrics_idx 16:21:18,540 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating table retentions_idx 16:21:18,630 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating type trigger_def 16:21:18,647 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 64) WFLYUT0021: Registered web context: /hawkular/metrics 16:21:18,728 INFO [org.hawkular.metrics.alerter.groups.GroupTriggerManager] (ServerService Thread Pool -- 62) Starting Hawkular Metrics Group Trigger Manager, distributed=false 16:21:18,729 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating table tasks 16:21:18,730 INFO [org.hawkular.metrics.alerter.ConditionManager] (ServerService Thread Pool -- 76) Starting Hawkular Metrics External Alerter, distributed=false 16:21:18,837 INFO [org.hawkular.metrics.alerter.ConditionManager] (ServerService Thread Pool -- 76) Registering Trigger UPDATE/REMOVE listener 16:21:18,839 INFO [org.hawkular.metrics.alerter.groups.GroupTriggerManager] (ServerService Thread Pool -- 62) Registering Trigger UPDATE/REMOVE listener 16:21:18,854 INFO [javax.enterprise.resource.webcontainer.jsf.config] (ServerService Thread Pool -- 62) Initializing Mojarra 2.2.13.SP1 20160303-1204 for context '/hawkular/__alerter-metrics' 16:21:18,907 INFO [org.hawkular.metrics.schema.SchemaService] (metricsservice-lifecycle-thread) Creating table leases 16:21:19,052 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 62) WFLYUT0021: Registered web context: /hawkular/__alerter-metrics 16:21:19,134 WARN [org.jboss.as.dependency.private] (MSC service thread 1-6) WFLYSRV0018: Deployment "deployment.hawkular-rest-api.war" is using a private module ("com.google.guava:main") which may be changed or removed in future versions without notice. 16:21:19,135 WARN [org.jboss.as.dependency.private] (MSC service thread 1-6) WFLYSRV0018: Deployment "deployment.hawkular-rest-api.war" is using a private module ("org.infinispan:main") which may be changed or removed in future versions without notice. 16:21:19,169 INFO [org.jboss.weld.deployer] (MSC service thread 1-4) WFLYWELD0003: Processing weld deployment hawkular-rest-api.war 16:21:19,210 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-4) WFLYEJB0473: JNDI bindings for session bean named 'BackfillCacheManager' in deployment unit 'deployment "hawkular-rest-api.war"' are as follows: java:global/hawkular-rest-api/BackfillCacheManager!org.hawkular.listener.cache.BackfillCache java:app/hawkular-rest-api/BackfillCacheManager!org.hawkular.listener.cache.BackfillCache java:module/BackfillCacheManager!org.hawkular.listener.cache.BackfillCache java:global/hawkular-rest-api/BackfillCacheManager java:app/hawkular-rest-api/BackfillCacheManager java:module/BackfillCacheManager 16:21:19,351 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 62) WFLYCLINF0002: Started backfill cache from hawkular-services container 16:21:19,436 INFO [org.jboss.as.ejb3] (MSC service thread 1-2) WFLYEJB0042: Started message driven bean 'HawkularTopicListener' with 'activemq-ra.rar' resource adapter 16:21:19,437 INFO [org.jboss.as.ejb3] (MSC service thread 1-3) WFLYEJB0042: Started message driven bean 'FeedAvailabilityDataListener' with 'activemq-ra.rar' resource adapter 16:21:19,438 INFO [org.jboss.as.ejb3] (MSC service thread 1-8) WFLYEJB0042: Started message driven bean 'CommandEventListener' with 'activemq-ra.rar' resource adapter 16:21:19,441 INFO [org.jboss.as.ejb3] (MSC service thread 1-6) WFLYEJB0042: Started message driven bean 'HawkularQueueListener' with 'activemq-ra.rar' resource adapter 16:21:19,570 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Creating change log table hawkular_metrics.cassalog 16:21:19,706 WARN [com.datastax.driver.core.Cluster] (cluster3-worker-6) Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='UPDATE hawkular_metrics.cassalog SET applied_at = ? WHERE bucket = ? AND revision = ?' 16:21:19,728 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: set-keyspace USE hawkular_metrics -- 16:21:19,739 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 1.0 CREATE TABLE sys_config ( config_id text, name text, value text, PRIMARY KEY (config_id, name) ) WITH compaction = { 'class': 'LeveledCompactionStrategy' } -- 16:21:19,912 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 1.1 ALTER TABLE data WITH gc_grace_seconds = 86400 -- 16:21:20,005 INFO [org.hawkular.listener.cache.BackfillCacheManager] (ServerService Thread Pool -- 73) Initializing Standalone Availability Cache 16:21:20,022 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 1.2 ALTER TABLE data ADD tags map -- 16:21:20,060 INFO [javax.enterprise.resource.webcontainer.jsf.config] (ServerService Thread Pool -- 72) Initializing Mojarra 2.2.13.SP1 20160303-1204 for context '/hawkular/api' 16:21:20,137 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 1.3 ALTER TABLE data ADD s_value text -- 16:21:20,280 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 1.4 INSERT INTO sys_config (config_id, name, value) VALUES ('org.hawkular.metrics', 'string-size', '2048') -- 16:21:20,305 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: set-keyspace USE hawkular_metrics -- 16:21:20,336 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 2.0 CREATE TABLE locks ( name text PRIMARY KEY, value text, ) WITH compaction = { 'class': 'LeveledCompactionStrategy' } -- 16:21:20,454 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 2.1 CREATE TABLE jobs ( id uuid PRIMARY KEY, type text, name text, params map, trigger frozen ) WITH compaction = { 'class': 'LeveledCompactionStrategy' } -- 16:21:20,603 INFO [org.apache.activemq.artemis.ra] (default-threads - 4) AMQ151000: awaiting topic/queue creation HawkularQueue 16:21:20,608 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 2.2 CREATE TABLE scheduled_jobs_idx ( time_slice timestamp, job_id uuid, PRIMARY KEY (time_slice, job_id) ) WITH compaction = { 'class': 'LeveledCompactionStrategy' } -- 16:21:20,618 INFO [org.apache.activemq.artemis.ra] (default-threads - 2) AMQ151000: awaiting topic/queue creation HawkularCommandEvent 16:21:20,752 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 2.3 CREATE TABLE finished_jobs_idx ( time_slice timestamp, job_id uuid, PRIMARY KEY (time_slice, job_id) ) WITH compaction = { 'class': 'LeveledCompactionStrategy' } -- 16:21:20,769 INFO [org.hawkular.rest] (ServerService Thread Pool -- 72) HAWKULAR005500: Hawkular REST Api is starting... 16:21:20,770 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 72) RESTEASY002225: Deploying javax.ws.rs.core.Application: class org.hawkular.rest.HawkularRestApi$Proxy$_$$_WeldClientProxy 16:21:20,771 INFO [org.hawkular.rest] (ServerService Thread Pool -- 72) HAWKULAR005500: Hawkular REST Api is starting... 16:21:20,788 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 72) WFLYUT0021: Registered web context: /hawkular/api 16:21:20,901 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61) WFLYSRV0010: Deployed "hawkular-wildfly-agent-download.war" (runtime-name : "hawkular-wildfly-agent-download.war") 16:21:20,902 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61) WFLYSRV0010: Deployed "hawkular-status.war" (runtime-name : "hawkular-status.war") 16:21:20,902 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61) WFLYSRV0010: Deployed "hawkular-rest-api.war" (runtime-name : "hawkular-rest-api.war") 16:21:20,902 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61) WFLYSRV0010: Deployed "hawkular-metrics.ear" (runtime-name : "hawkular-metrics.ear") 16:21:20,902 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61) WFLYSRV0010: Deployed "hawkular-inventory-ui.war" (runtime-name : "hawkular-inventory-ui.war") 16:21:20,902 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61) WFLYSRV0010: Deployed "hawkular-inventory-service.war" (runtime-name : "hawkular-inventory-service.war") 16:21:20,903 INFO [org.jboss.as.server] (ServerService Thread Pool -- 61) WFLYSRV0010: Deployed "hawkular-command-gateway-war.war" (runtime-name : "hawkular-command-gateway-war.war") 16:21:20,974 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 2.4 CREATE TABLE active_time_slices ( time_slice timestamp PRIMARY KEY ) WITH compaction = { 'class' : 'LeveledCompactionStrategy' } -- 16:21:21,234 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0061: Http management interface listening on https://0.0.0.0:9993/management 16:21:21,235 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0052: Admin console listening on https://0.0.0.0:9993 16:21:21,235 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0025: Hawkular 0.40.0.Final-SNAPSHOT (WildFly Core 2.2.0.Final) started in 37909ms - Started 2269 of 2758 services (859 services are lazy, passive or on-demand) 16:21:21,304 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 3.0 ALTER TABLE hawkular_metrics.data WITH COMPRESSION = {'sstable_compression': 'DeflateCompressor'}; -- 16:21:21,449 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 3.1 ALTER TABLE data WITH compaction = {'class': 'DateTieredCompactionStrategy'} AND default_time_to_live = 604800 -- 16:21:21,549 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 3.2 ALTER TABLE data DROP aggregates -- 16:21:21,686 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 3.3 DROP TYPE aggregate_data -- 16:21:21,775 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 3.4 ALTER TABLE data DROP data_retention -- 16:21:21,913 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 3.5 DROP TYPE aggregation_template -- 16:21:21,991 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 3.6 DROP TABLE tenants_by_time -- 16:21:22,210 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: set-keyspace USE hawkular_metrics -- 16:21:22,216 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 4.0 CREATE TABLE data_compressed ( tenant_id text, type tinyint, metric text, dpart bigint, time timestamp, c_value blob, ts_value blob, tags blob, PRIMARY KEY ((tenant_id, type, metric, dpart), time) ) WITH CLUSTERING ORDER BY (time DESC) -- 16:21:22,359 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 4.1 ALTER TABLE data WITH COMPRESSION = {'sstable_compression': 'LZ4Compressor'}; -- 16:21:22,447 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 5.0 ALTER TABLE scheduled_jobs_idx ADD job_name text -- 16:21:22,575 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 5.1 ALTER TABLE scheduled_jobs_idx ADD job_params frozen> -- 16:21:22,606 INFO [org.apache.activemq.artemis.ra] (default-threads - 4) AMQ151001: Attempting to reconnect org.apache.activemq.artemis.ra.inflow.ActiveMQActivationSpec(ra=org.apache.activemq.artemis.ra.ActiveMQResourceAdapter@78712571 destination=HawkularQueue destinationType=javax.jms.Queue ack=Auto-acknowledge durable=false clientID=null user=null maxSession=15) 16:21:22,623 INFO [org.apache.activemq.artemis.ra] (default-threads - 2) AMQ151001: Attempting to reconnect org.apache.activemq.artemis.ra.inflow.ActiveMQActivationSpec(ra=org.apache.activemq.artemis.ra.ActiveMQResourceAdapter@78712571 destination=HawkularCommandEvent destinationType=javax.jms.Queue ack=Auto-acknowledge durable=false clientID=null user=null maxSession=15) 16:21:22,680 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 5.2 ALTER TABLE scheduled_jobs_idx ADD trigger frozen -- 16:21:22,796 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 5.3 ALTER TABLE scheduled_jobs_idx ADD job_type text -- 16:21:22,906 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 5.4 ALTER TABLE scheduled_jobs_idx ADD status tinyint -- 16:21:23,007 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 5.5 INSERT INTO sys_config (config_id, name, value) VALUES ('org.hawkular.metrics', 'gc_grace_seconds', '604800') -- 16:21:23,016 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 5.6 BEGIN UNLOGGED BATCH INSERT INTO sys_config (config_id, name, value) VALUES ('org.hawkular.metrics', 'ingestion.retry.max-retries', '5'); INSERT INTO sys_config (config_id, name, value) VALUES ('org.hawkular.metrics', 'ingestion.retry.max-delay', '30000'); APPLY BATCH; -- 16:21:23,033 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 6.0 ALTER TABLE data_compressed WITH compaction = { 'class': 'TimeWindowCompactionStrategy', 'compaction_window_unit': 'DAYS', 'compaction_window_size': '1' } -- 16:21:23,125 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 6.1 ALTER TABLE data WITH compaction = {'class': 'SizeTieredCompactionStrategy'} -- 16:21:23,238 INFO [org.cassalog.core.CassalogImpl] (metricsservice-lifecycle-thread) Applying ChangeSet -- version: 7.0 CREATE TABLE metrics_expiration_idx ( tenant_id text, type tinyint, metric text, time timestamp, PRIMARY KEY ((tenant_id, type), metric) ) -- 16:21:23,465 INFO [org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] (metricsservice-lifecycle-thread) The keyspace hawkular_metrics is using a replication_factor of 1 16:21:23,789 INFO [org.hawkular.metrics.core.service.MetricsServiceImpl] (metricsservice-lifecycle-thread) HAWKMETRICS100001: Using a key space of 'hawkular_metrics' 16:21:23,912 INFO [org.hawkular.metrics.core.service.MetricsServiceImpl] (metricsservice-lifecycle-thread) HAWKMETRICS100008: Using max size of 2048 for string metrics 16:21:23,913 INFO [org.hawkular.metrics.core.service.MetricsServiceImpl] (metricsservice-lifecycle-thread) HAWKMETRICS100009: Using max number of retries 5 and max retry delay of 30000 ms for inserting data points 16:21:23,999 INFO [org.hawkular.metrics.core.service.MetricsServiceImpl] (metricsservice-lifecycle-thread) HAWKMETRICS100007: Using default data retention of 1209600 seconds 16:21:24,014 INFO [org.hawkular.metrics.core.dropwizard.MetricsInitializer] (metricsservice-lifecycle-thread) Creating metrics 16:21:24,344 INFO [org.hawkular.metrics.core.dropwizard.MetricsInitializer] (RxComputationScheduler-2) Finished creating metrics in 329 ms 16:21:24,483 WARN [com.datastax.driver.core.Cluster] (cluster3-worker-16) Re-preparing already prepared query is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once. Query='SELECT DISTINCT tenant_id, tname FROM metrics_tags_idx' 16:21:24,530 INFO [org.hawkular.metrics.core.jobs.JobsServiceImpl] (metricsservice-lifecycle-thread) Preparing to create and schedule COMPRESS_DATA job 16:21:24,656 INFO [org.hawkular.metrics.core.jobs.JobsServiceImpl] (metricsservice-lifecycle-thread) Created and scheduled JobDetails{jobId=0483bb97-dfa7-4ac2-83f9-bc5f3a48eb55, jobType=COMPRESS_DATA, jobName=COMPRESS_DATA, parameters={}, trigger=RepeatingTrigger{triggerTime=1508950800000, interval=7200000, delay=60000}, status=NONE} 16:21:24,669 INFO [org.hawkular.metrics.core.jobs.JobsServiceImpl] (metricsservice-lifecycle-thread) Preparing to create and schedule DELETE_EXPIRED_METRICS job 16:21:24,687 INFO [org.hawkular.metrics.core.jobs.JobsServiceImpl] (metricsservice-lifecycle-thread) Created and scheduled JobDetails{jobId=e0fa9d8d-c35e-48d8-89a2-e2c1624dcae7, jobType=DELETE_EXPIRED_METRICS, jobName=DELETE_EXPIRED_METRICS, parameters={}, trigger=RepeatingTrigger{triggerTime=1508976000000, interval=604800000, delay=60000}, status=NONE} 16:21:24,709 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (metricsservice-lifecycle-thread) Checking tables in hawkular_metrics to see if gc_grace_seconds needs to be updated 16:21:24,721 INFO [org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] (metricsservice-lifecycle-thread) HAWKMETRICS200005: Metrics service started 16:21:24,722 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-16) gc_grace_seconds for active_time_slices is set to 864000. Resetting to 0 16:21:24,728 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-16) gc_grace_seconds for cassalog is set to 864000. Resetting to 0 16:21:24,728 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-16) gc_grace_seconds for data is set to 86400. Resetting to 0 16:21:24,847 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-19) gc_grace_seconds for data_compressed is set to 864000. Resetting back to zero. 16:21:24,925 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-1) gc_grace_seconds for finished_jobs_idx is set to 864000. Resetting to 0 16:21:25,002 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-2) gc_grace_seconds for jobs is set to 864000. Resetting to 0 16:21:25,081 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-3) gc_grace_seconds for leases is set to 864000. Resetting to 0 16:21:25,162 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-5) gc_grace_seconds for locks is set to 864000. Resetting to 0 16:21:25,241 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-6) gc_grace_seconds for metrics_expiration_idx is set to 864000. Resetting to 0 16:21:25,305 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-7) gc_grace_seconds for metrics_idx is set to 864000. Resetting to 0 16:21:25,370 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-24) gc_grace_seconds for metrics_tags_idx is set to 864000. Resetting to 0 16:21:25,429 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-20) gc_grace_seconds for retentions_idx is set to 864000. Resetting to 0 16:21:25,492 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-23) gc_grace_seconds for scheduled_jobs_idx is set to 864000. Resetting to 0 16:21:25,561 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-21) gc_grace_seconds for sys_config is set to 864000. Resetting to 0 16:21:25,622 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-8) gc_grace_seconds for tasks is set to 864000. Resetting to 0 16:21:25,719 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-13) gc_grace_seconds for tenants is set to 864000. Resetting to 0 16:21:25,911 INFO [org.hawkular.metrics.core.util.GCGraceSecondsManager] (RxComputationScheduler-9) Finished gc_grace_seconds updates in 1201 ms 16:21:26,294 INFO [org.hawkular.agent.monitor.service.AgentCoreEngine] (Hawkular Java Agent Start Thread) Hawkular Metrics is ready: {"MetricsService":"STARTED","Implementation-Version":"0.26.1.Final","Built-From-Git-SHA1":"45b148c834ed62018f153c23187b4436ae4208fe","Cassandra":"up"} 16:21:26,325 INFO [org.hawkular.agent.monitor.service.AgentCoreEngine] (Hawkular Java Agent Start Thread) Hawkular Inventory is ready: {"Implementation-Version":"0.9.8.Final-SRC-revision-ce866b1ade2d7413f055f461eb36d004ff2888d8","Built-From-Git-SHA1":"ce866b1ade2d7413f055f461eb36d004ff2888d8","status":"UP"} 16:21:26,394 INFO [org.hawkular.agent.monitor.cmd.FeedCommProcessor] (Hawkular Java Agent Start Thread) HAWKAGENT010039: The command-gateway URL is [wss://127.0.0.1:8443/hawkular/command-gateway/feed/hawkular-services-2-vgsd2] 16:21:26,464 INFO [org.hawkular.agent.monitor.scheduler.SchedulerService] (Hawkular Java Agent Start Thread) HAWKAGENT010012: Starting scheduler 16:21:26,484 INFO [org.hawkular.agent.monitor.protocol.ProtocolServices] (Hawkular Java Agent Start Thread) HAWKAGENT010019: Managed server [Local DMR] is disabled. It will not be monitored. 16:21:26,523 INFO [org.hawkular.agent.monitor.cmd.FeedCommProcessor] (OkHttp https://127.0.0.1:8443/...) HAWKAGENT010034: Opened feed WebSocket connection to endpoint [wss://127.0.0.1:8443/hawkular/command-gateway/feed/hawkular-services-2-vgsd2] 16:21:26,599 INFO [org.hawkular.cmdgw.command.ws.server.FeedWebSocket] (default task-42) HAWKFEEDCOMM000013: WebSocket session [hawkular-services-2-vgsd2] opened for endpoint [/feed/{feedId}] 16:21:26,699 INFO [org.xnio] (Hawkular Java Agent Start Thread) XNIO version 3.3.4.Final 16:21:26,732 INFO [org.xnio.nio] (Hawkular Java Agent Start Thread) XNIO NIO Implementation Version 3.3.4.Final 16:21:26,815 INFO [org.jboss.remoting] (Hawkular Java Agent Start Thread) JBoss Remoting version 4.0.18.Final 16:21:27,556 INFO [org.hawkular.agent.monitor.protocol.ProtocolServices] (Hawkular Java Agent Start Thread) HAWKAGENT010057: Auto-discovery scans will be performed every [600] seconds 16:21:27,600 INFO [org.hawkular.agent.monitor.util.Util] (Hawkular WildFly Agent Full Discovery Scan-platform-1) Machine ID was explicitly set to [hawkular-services-2-vgsd2] 16:27:41,010 ERROR [org.hawkular.agent.monitor.protocol.EndpointService] (Hawkular-WildFly-Agent-Scheduler-Avail-3) HAWKAGENT010009: An availability check failed: org.hawkular.agent.monitor.protocol.ProtocolException: Error fetching DMR attribute [server-state] at org.hawkular.agent.monitor.protocol.dmr.DMRDriver.fetchAttribute(DMRDriver.java:149) at org.hawkular.agent.monitor.protocol.EndpointService.measureAvails(EndpointService.java:516) at org.hawkular.agent.monitor.scheduler.AvailsCollector.run(AvailsCollector.java:60) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at org.shaded.jboss.threads.JBossThread.run(JBossThread.java:320) Caused by: org.hawkular.dmr.api.DmrApiException: java.io.IOException: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.hawkular.dmr.api.OperationBuilder$AbstractOperationBuilder.execute(OperationBuilder.java:86) at org.hawkular.agent.monitor.protocol.dmr.DMRDriver.fetchAttribute(DMRDriver.java:146) ... 8 more Caused by: java.io.IOException: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:149) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:75) at org.hawkular.dmr.api.OperationBuilder$AbstractOperationBuilder.execute(OperationBuilder.java:84) ... 9 more Caused by: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.shaded.jboss.as.protocol.ProtocolConnectionUtils.connectSync(ProtocolConnectionUtils.java:124) at org.shaded.jboss.as.protocol.ProtocolConnectionManager$EstablishingConnection.connect(ProtocolConnectionManager.java:257) at org.shaded.jboss.as.protocol.ProtocolConnectionManager.connect(ProtocolConnectionManager.java:71) at org.shaded.jboss.as.protocol.mgmt.FutureManagementChannel$Establishing.getChannel(FutureManagementChannel.java:212) at org.shaded.jboss.as.controller.client.impl.RemotingModelControllerClient.getOrCreateChannel(RemotingModelControllerClient.java:146) at org.shaded.jboss.as.controller.client.impl.RemotingModelControllerClient$1.getChannel(RemotingModelControllerClient.java:65) at org.shaded.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:147) at org.shaded.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:122) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeRequest(AbstractModelControllerClient.java:263) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:168) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:147) ... 11 more 17:00:24,739 INFO [org.hawkular.metrics.core.jobs.CompressData] (RxIoScheduler-3) Starting compression of timestamps (UTC) between 1508940000000 - 1508947199999 17:00:26,561 INFO [org.hawkular.metrics.core.jobs.CompressData] (RxComputationScheduler-24) Finished compressing data in 1822 ms 17:15:59,136 INFO [org.jboss.as.protocol] (management task-9) WFLYPRT0057: cancelled task by interrupting thread Thread[management-handler-thread - 4,5,management-handler-thread] 17:19:25,194 INFO [org.jboss.as.protocol] (management task-6) WFLYPRT0057: cancelled task by interrupting thread Thread[management-handler-thread - 2,5,management-handler-thread] 17:23:58,112 INFO [org.jboss.as.protocol] (management task-5) WFLYPRT0057: cancelled task by interrupting thread Thread[management-handler-thread - 2,5,management-handler-thread] 17:26:30,116 INFO [org.jboss.as.protocol] (management task-7) WFLYPRT0057: cancelled task by interrupting thread Thread[management-handler-thread - 3,5,management-handler-thread] 17:54:33,092 ERROR [io.undertow.request] (default task-326) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:55:46,164 ERROR [io.undertow.request] (default task-277) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:54:33,092 ERROR [io.undertow.request] (default task-365) UT005071: Undertow request failed HttpServerExchange{ DELETE /hawkular/inventory/resources/feed-9fb1e3d5-a02e-4187-8d81-9f121b3ccee3-NewApp.war request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[0], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:55:46,164 ERROR [io.undertow.request] (default task-285) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:55:46,841 ERROR [io.undertow.request] (default task-325) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:11,438 ERROR [io.undertow.request] (default task-336) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:55:46,841 ERROR [io.undertow.request] (default task-300) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:39,323 ERROR [io.undertow.request] (default task-319) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:55:46,837 ERROR [io.undertow.request] (default task-316) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:30,110 ERROR [org.xnio.listener] (default I/O-12) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:31,110 ERROR [io.undertow.request] (default task-289) UT005071: Undertow request failed HttpServerExchange{ DELETE /hawkular/inventory/resources/feed-e2a1bdc0-37de-4df2-8086-03c457f7c56f-NewApp.war request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.129.0.58;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.129.0.58], Content-type=[application/json], Content-Length=[0], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:54:49,959 WARNING [io.netty.channel.epoll.EpollEventLoop] (cluster3-nio-worker-5) Unexpected exception in the selector loop.: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:00,425 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-302) ISPN000136: Error executing command VersionedPrepareCommand, writing keys [feed-6edfc68d-19a3-4510-a09f-652e9dac9ee9-Server-0-child-41, feed-6edfc68d-19a3-4510-a09f-652e9dac9ee9-Server-0-child-42, feed-6edfc68d-19a3-4510-a09f-652e9dac9ee9-Server-0-child-43, feed-6edfc68d-19a3-4510-a09f-652e9dac9ee9-Server-0-child-44, feed-6edfc68d-19a3-4510-a09f-652e9dac9ee9-Server-0-child-45, feed-6edfc68d-19a3-4510-a09f-652e9dac9ee9-Server-0-child-46, feed-6edfc68d-19a3-4510-a09f-652e9dac9ee9-Server-0-child-47, feed-6edfc68d-19a3-4510-a09f-652e9dac9ee9-Server-0-child-48...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.infinispan.commons.util.ByRef.create(ByRef.java:18) at org.infinispan.util.concurrent.locks.impl.PerKeyLockContainer.acquire(PerKeyLockContainer.java:39) at org.infinispan.util.concurrent.locks.impl.DefaultLockManager.lockAll(DefaultLockManager.java:124) at org.infinispan.interceptors.locking.AbstractLockingInterceptor.lockAllAndRecord(AbstractLockingInterceptor.java:278) at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.checkPendingAndLockAllKeys(AbstractTxLockingInterceptor.java:168) at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.lockAllOrRegisterBackupLock(AbstractTxLockingInterceptor.java:134) at org.infinispan.interceptors.locking.OptimisticLockingInterceptor.visitPrepareCommand(OptimisticLockingInterceptor.java:40) at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:185) at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:58) at org.infinispan.interceptors.impl.TxInterceptor.handlePrepareCommand(TxInterceptor.java:167) at org.infinispan.interceptors.impl.TxInterceptor.visitPrepareCommand(TxInterceptor.java:136) at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:185) at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:58) at org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54) at org.infinispan.interceptors.DDAsyncInterceptor.visitPrepareCommand(DDAsyncInterceptor.java:132) at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:185) at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNext(BaseAsyncInterceptor.java:58) at org.infinispan.interceptors.DDAsyncInterceptor.handleDefault(DDAsyncInterceptor.java:54) at org.infinispan.interceptors.DDAsyncInterceptor.visitPrepareCommand(DDAsyncInterceptor.java:132) at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:185) at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:127) at org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:96) at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:137) at org.infinispan.transaction.impl.TransactionCoordinator.prepare(TransactionCoordinator.java:130) at org.infinispan.transaction.impl.TransactionCoordinator.prepare(TransactionCoordinator.java:113) at org.infinispan.transaction.impl.TransactionTable.beforeCompletion(TransactionTable.java:837) at org.infinispan.transaction.synchronization.SynchronizationAdapter.beforeCompletion(SynchronizationAdapter.java:28) at com.arjuna.ats.internal.jta.resources.arjunacore.SynchronizationImple.beforeCompletion(SynchronizationImple.java:76) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.beforeCompletion(TwoPhaseCoordinator.java:368) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:91) at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162) 17:57:04,305 WARN [org.hawkular.metrics.scheduler.impl.SchedulerImpl] (query-thread-pool-2) Job execution failed: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.OperationTimedOutException: [hawkular-cassandra/172.30.23.124:9042] Timed out waiting for server response at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299) at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) at rx.observable.ListenableFutureObservable$2$1.run(ListenableFutureObservable.java:78) at rx.observable.ListenableFutureObservable$1$1.call(ListenableFutureObservable.java:50) at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55) at rx.internal.schedulers.ExecutorScheduler$ExecutorSchedulerWorker.run(ExecutorScheduler.java:107) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [hawkular-cassandra/172.30.23.124:9042] Timed out waiting for server response at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:790) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1382) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:581) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:655) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:367) at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137) ... 1 more 17:57:04,305 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-299) ISPN000136: Error executing command VersionedCommitCommand, writing keys [feed-32a07adf-3d2a-4b20-b414-103f968dc97d-NewApp.war]: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:02,437 WARN [org.hawkular.agent.monitor.cmd.FeedCommProcessor] (OkHttp https://127.0.0.1:8443/...) HAWKAGENT010038: Failed to close web socket with code=[1000] and reason=[Shutting down FeedCommProcessor]: java.net.SocketException: Socket is closed at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1542) at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1563) at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) at okio.shaded.Okio$1.write(Okio.java:78) at okio.shaded.AsyncTimeout$1.write(AsyncTimeout.java:180) at okio.shaded.RealBufferedSink.emit(RealBufferedSink.java:178) at okhttp3.shaded.internal.ws.WebSocketWriter.writeControlFrameSynchronized(WebSocketWriter.java:152) at okhttp3.shaded.internal.ws.WebSocketWriter.writeClose(WebSocketWriter.java:111) at okhttp3.shaded.internal.ws.RealWebSocket.close(RealWebSocket.java:168) at org.hawkular.agent.monitor.cmd.FeedCommProcessor.disconnect(FeedCommProcessor.java:175) at org.hawkular.agent.monitor.cmd.FeedCommProcessor.disconnect(FeedCommProcessor.java:169) at org.hawkular.agent.monitor.cmd.FeedCommProcessor.onFailure(FeedCommProcessor.java:381) at okhttp3.shaded.internal.ws.RealWebSocket.readerErrorClose(RealWebSocket.java:217) at okhttp3.shaded.internal.ws.RealWebSocket.readMessage(RealWebSocket.java:100) at okhttp3.shaded.ws.WebSocketCall.createWebSocket(WebSocketCall.java:152) at okhttp3.shaded.ws.WebSocketCall.access$000(WebSocketCall.java:41) at okhttp3.shaded.ws.WebSocketCall$1.onResponse(WebSocketCall.java:97) at okhttp3.shaded.RealCall$AsyncCall.execute(RealCall.java:126) at okhttp3.shaded.internal.NamedRunnable.run(NamedRunnable.java:32) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 17:57:04,304 ERROR [stderr] (Thread-27 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@1bd5d578-1512653915)) Exception in thread "Thread-27 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@1bd5d578-1512653915)" Exception in thread "default I/O-1" Exception in thread "default I/O-16" Exception in thread "default I/O-25" java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:03,282 ERROR [io.undertow.request] (default task-259) UT005023: Exception handling request to /hawkular/inventory/import: org.jboss.resteasy.spi.UnhandledException: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.jboss.resteasy.core.ExceptionHandler.handleApplicationException(ExceptionHandler.java:77) at org.jboss.resteasy.core.ExceptionHandler.handleException(ExceptionHandler.java:220) at org.jboss.resteasy.core.SynchronousDispatcher.writeException(SynchronousDispatcher.java:175) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:418) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:02,434 WARNING [io.netty.util.concurrent.SingleThreadEventExecutor] (cluster3-nio-worker-7) A task raised an exception.: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:02,434 ERROR [io.undertow.request] (default task-290) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:01,249 ERROR [io.undertow.request] (default task-294) UT005071: Undertow request failed HttpServerExchange{ DELETE /hawkular/inventory/resources/feed-06cd6424-b78d-41b2-b230-5569dab97219-NewApp.war request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[0], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache], Content-Type=[application/json], Content-Length=[0]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:01,246 ERROR [io.undertow.request] (default task-276) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.RuntimeException: WFLYUT0052: Security context creation failed at org.wildfly.extension.undertow.security.SecurityActions.createSecurityContext(SecurityActions.java:74) at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.setup(SecurityContextThreadSetupAction.java:87) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:42) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedConstructorAccessor113.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.jboss.security.SecurityContextFactory.createSecurityContext(SecurityContextFactory.java:199) at org.jboss.security.SecurityContextFactory.createSecurityContext(SecurityContextFactory.java:108) at org.wildfly.extension.undertow.security.SecurityActions.createSecurityContext(SecurityActions.java:72) ... 14 more Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:01,246 ERROR [io.undertow.request] (default task-306) UT005023: Exception handling request to /hawkular/inventory/resources/feed-caa9a054-bfc7-423e-b48a-7aebf31bda0b-NewApp.war: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:57,631 ERROR [io.undertow.request] (default task-328) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:01,246 ERROR [io.undertow.request] (default task-307) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:54,433 ERROR [io.undertow.request] (default task-333) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.129.0.57;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.129.0.57], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.RuntimeException: WFLYUT0052: Security context creation failed at org.wildfly.extension.undertow.security.SecurityActions.createSecurityContext(SecurityActions.java:74) at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.setup(SecurityContextThreadSetupAction.java:87) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:42) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedConstructorAccessor113.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.jboss.security.SecurityContextFactory.createSecurityContext(SecurityContextFactory.java:199) at org.jboss.security.SecurityContextFactory.createSecurityContext(SecurityContextFactory.java:108) at org.wildfly.extension.undertow.security.SecurityActions.createSecurityContext(SecurityActions.java:72) ... 14 more Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:59:08,919 ERROR [io.undertow.request] (default task-336) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:58,029 ERROR [io.undertow.request] (default task-312) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:55:15,024 ERROR [org.xnio.listener] (default I/O-34) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:02,437 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-342) ISPN000136: Error executing command VersionedCommitCommand, writing keys [feed-97cb2104-1757-4484-8ffb-1dc050be316f-NewApp.war]: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:56,760 ERROR [io.undertow.request] (default task-283) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:55:43,647 WARN [org.hibernate.search.backend.impl.lucene.IndexWriterHolder] (Hibernate Search sync consumer thread for index resource.3) HSEARCH000052: Going to force release of the IndexWriter lock 17:56:47,826 ERROR [io.undertow.request] (default task-288) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:23,038 ERROR [io.undertow.request] (default task-34) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:54,433 ERROR [io.undertow.request] (default task-292) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:01:18,793 ERROR [org.jboss.as.controller.management-operation] (DeploymentScanner-threads - 2) WFLYCTL0013: Operation ("read-attribute") failed - address: ([("deployment" => "hawkular-metrics.ear")]): java.lang.OutOfMemoryError: GC overhead limit exceeded 18:04:08,537 ERROR [io.undertow.request] (default task-282) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:22,527 ERROR [io.undertow.request] (default task-73) UT005023: Exception handling request to /hawkular/inventory/resources/feed-0e3d268a-a15a-456f-ad42-28dff3c9256b-NewApp.war: org.jboss.resteasy.spi.UnhandledException: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.jboss.resteasy.core.ExceptionHandler.handleApplicationException(ExceptionHandler.java:77) at org.jboss.resteasy.core.ExceptionHandler.handleException(ExceptionHandler.java:220) at org.jboss.resteasy.core.SynchronousDispatcher.writeException(SynchronousDispatcher.java:175) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:418) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:10,379 ERROR [io.undertow.request] (default task-133) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:17,730 ERROR [org.jboss.resteasy.resteasy_jaxrs.i18n] (default task-119) RESTEASY002005: Failed executing POST /import: org.jboss.resteasy.spi.ReaderException: com.fasterxml.jackson.databind.JsonMappingException: Instantiation of [simple type, class org.hawkular.inventory.api.model.Metric] value failed (java.lang.OutOfMemoryError): GC overhead limit exceeded at [Source: io.undertow.servlet.spec.ServletInputStreamImpl@642b5b0a; line: 1, column: 1573] (through reference chain: org.hawkular.inventory.api.model.Inventory["resources"]->java.util.ArrayList[0]->org.hawkular.inventory.api.model.RawResource["metrics"]->java.util.ArrayList[13]) at org.jboss.resteasy.core.MessageBodyParameterInjector.inject(MessageBodyParameterInjector.java:184) at org.jboss.resteasy.core.MethodInjectorImpl.injectArguments(MethodInjectorImpl.java:91) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:114) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.fasterxml.jackson.databind.JsonMappingException: Instantiation of [simple type, class org.hawkular.inventory.api.model.Metric] value failed (java.lang.OutOfMemoryError): GC overhead limit exceeded at [Source: io.undertow.servlet.spec.ServletInputStreamImpl@642b5b0a; line: 1, column: 1573] (through reference chain: org.hawkular.inventory.api.model.Inventory["resources"]->java.util.ArrayList[0]->org.hawkular.inventory.api.model.RawResource["metrics"]->java.util.ArrayList[13]) at com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:262) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.wrapAsJsonMappingException(StdValueInstantiator.java:445) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.rewrapCtorProblem(StdValueInstantiator.java:464) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createFromObjectWith(StdValueInstantiator.java:258) at com.fasterxml.jackson.databind.deser.impl.PropertyBasedCreator.build(PropertyBasedCreator.java:135) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:385) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:277) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:249) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:26) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:277) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:249) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:26) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.ObjectReader._bind(ObjectReader.java:1535) at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:944) at org.jboss.resteasy.plugins.providers.jackson.ResteasyJackson2Provider.readFrom(ResteasyJackson2Provider.java:121) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.readFrom(AbstractReaderInterceptorContext.java:61) at org.jboss.resteasy.core.interception.ServerReaderInterceptorContext.readFrom(ServerReaderInterceptorContext.java:60) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:53) at org.jboss.resteasy.security.doseta.DigitalVerificationInterceptor.aroundReadFrom(DigitalVerificationInterceptor.java:34) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:55) at org.jboss.resteasy.plugins.interceptors.encoding.GZIPDecodingInterceptor.aroundReadFrom(GZIPDecodingInterceptor.java:59) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:55) at org.jboss.resteasy.core.MessageBodyParameterInjector.inject(MessageBodyParameterInjector.java:151) ... 51 more Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:08,540 WARN [org.jboss.modules] (default task-294) Failed to define class io.undertow.servlet.UndertowServletMessages_$bundle in Module "io.undertow.servlet:main" from local module loader @436e852b (finder: local module finder @32d2fa64 (roots: /opt/jboss/wildfly/modules,/opt/jboss/wildfly/modules/system/layers/hawkular,/opt/jboss/wildfly/modules/system/layers/base)): java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:49,038 ERROR [org.infinispan.transaction.impl.TransactionCoordinator] (default task-264) ISPN000255: Error while processing prepare: org.infinispan.commons.CacheException: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:263) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:137) at org.infinispan.transaction.impl.TransactionCoordinator.prepare(TransactionCoordinator.java:130) at org.infinispan.transaction.impl.TransactionCoordinator.prepare(TransactionCoordinator.java:113) at org.infinispan.transaction.impl.TransactionTable.beforeCompletion(TransactionTable.java:837) at org.infinispan.transaction.synchronization.SynchronizationAdapter.beforeCompletion(SynchronizationAdapter.java:28) at com.arjuna.ats.internal.jta.resources.arjunacore.SynchronizationImple.beforeCompletion(SynchronizationImple.java:76) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.beforeCompletion(TwoPhaseCoordinator.java:368) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:91) at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1200) at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126) at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89) at org.jboss.as.ejb3.tx.CMTTxInterceptor.endTransaction(CMTTxInterceptor.java:91) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:279) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.addResource(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.importInventory(InventoryHandlers.java:235) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.importInventory(Unknown Source) at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:08,541 ERROR [io.undertow.request] (default task-352) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:07,746 ERROR [org.hawkular.agent.monitor.storage.HawkularStorageAdapter] (OkHttp https://127.0.0.1:8443/...) HAWKAGENT010010: Failed to store metric data: {"counters":[{"data":[{"value":5528369,"timestamp":1508953971569}],"id":"MI~R~[hawkular-services-2-vgsd2/hawkular-services-2-vgsd2~Local JMX~java.lang:type=Runtime]~MT~Runtime Metrics~VM Uptime"}],"strings":[],"availabilities":[],"gauges":[{"data":[{"value":42089.0,"timestamp":1508953971569}],"id":"MI~R~[hawkular-services-2-vgsd2/hawkular-services-2-vgsd2~Local JMX~java.lang:type=Runtime]~MT~Runtime Metrics~Aggregate GC Collection Time"},{"data":[{"value":4.16003536E8,"timestamp":1508953971569}],"id":"MI~R~[hawkular-services-2-vgsd2/hawkular-services-2-vgsd2~Local JMX~java.lang:type=Runtime]~MT~Runtime Metrics~Used Heap Memory"}]}: java.net.SocketTimeoutException: timeout at okio.shaded.Okio$3.newTimeoutException(Okio.java:210) at okio.shaded.AsyncTimeout.exit(AsyncTimeout.java:288) at okio.shaded.AsyncTimeout$2.read(AsyncTimeout.java:242) at okio.shaded.RealBufferedSource.indexOf(RealBufferedSource.java:325) at okio.shaded.RealBufferedSource.indexOf(RealBufferedSource.java:314) at okio.shaded.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:210) at okhttp3.shaded.internal.http.Http1xStream.readResponse(Http1xStream.java:186) at okhttp3.shaded.internal.http.Http1xStream.readResponseHeaders(Http1xStream.java:127) at okhttp3.shaded.internal.http.CallServerInterceptor.intercept(CallServerInterceptor.java:53) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:45) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.RealCall.getResponseWithInterceptorChain(RealCall.java:170) at okhttp3.shaded.RealCall.access$100(RealCall.java:33) at okhttp3.shaded.RealCall$AsyncCall.execute(RealCall.java:120) at okhttp3.shaded.internal.NamedRunnable.run(NamedRunnable.java:32) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:171) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) at sun.security.ssl.InputRecord.read(InputRecord.java:503) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983) at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:940) at sun.security.ssl.AppInputStream.read(AppInputStream.java:105) at okio.shaded.Okio$2.read(Okio.java:138) at okio.shaded.AsyncTimeout$2.read(AsyncTimeout.java:238) ... 25 more 18:03:46,346 ERROR [org.xnio.listener] (default I/O-46) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:24,183 ERROR [io.undertow.request] (default task-305) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:35,401 ERROR [io.undertow.request] (default task-97) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:04:32,105 ERROR [org.apache.activemq.artemis.core.client] (Thread-29 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@1bd5d578-1512653915)) AMQ214017: Caught unexpected Throwable: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:59:46,455 ERROR [org.hawkular.agent.monitor.protocol.EndpointService] (Hawkular-WildFly-Agent-Scheduler-Metrics-2) HAWKAGENT010049: Could not access resources of endpoint [PlatformEndpointService[Endpoint[platform]:[null]]]: org.hawkular.agent.monitor.protocol.ProtocolException: java.lang.NullPointerException at org.hawkular.agent.monitor.protocol.platform.PlatformDriver.fetchAttribute(PlatformDriver.java:124) at org.hawkular.agent.monitor.protocol.EndpointService.measureMetrics(EndpointService.java:586) at org.hawkular.agent.monitor.scheduler.MetricsCollector.run(MetricsCollector.java:60) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at org.shaded.jboss.threads.JBossThread.run(JBossThread.java:320) Caused by: java.lang.NullPointerException at org.hawkular.agent.monitor.protocol.platform.OshiPlatformCache.getProcessor(OshiPlatformCache.java:204) at org.hawkular.agent.monitor.protocol.platform.OshiPlatformCache.discoverResources(OshiPlatformCache.java:467) at org.hawkular.agent.monitor.protocol.platform.PlatformDriver.fetchAttribute(PlatformDriver.java:94) ... 8 more 18:02:11,407 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-272) ISPN000136: Error executing command VersionedPrepareCommand, writing keys [feed-d386b13e-cc84-4031-b6a9-3a65488765fc-Server-0-child-30, feed-d386b13e-cc84-4031-b6a9-3a65488765fc-Server-0-child-34, feed-d386b13e-cc84-4031-b6a9-3a65488765fc-Server-0-child-8, feed-d386b13e-cc84-4031-b6a9-3a65488765fc-Server-0-child-33, feed-d386b13e-cc84-4031-b6a9-3a65488765fc-Server-0-child-9, feed-d386b13e-cc84-4031-b6a9-3a65488765fc-Server-0-child-32, feed-d386b13e-cc84-4031-b6a9-3a65488765fc-Server-0-child-6, feed-d386b13e-cc84-4031-b6a9-3a65488765fc-Server-0-child-31...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:07:37,564 ERROR [org.xnio.listener] (default I/O-42) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:07:20,440 ERROR [io.undertow.request] (default task-114) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:29,380 ERROR [io.undertow.request] (default task-7) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:10:00,000 ERROR [io.undertow.request] (default task-72) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,998 ERROR [org.infinispan.transaction.impl.TransactionCoordinator] (default task-272) ISPN000255: Error while processing prepare: org.infinispan.commons.CacheException: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.infinispan.interceptors.impl.InvocationContextInterceptor.rethrowException(InvocationContextInterceptor.java:140) at org.infinispan.interceptors.impl.InvocationContextInterceptor.access$000(InvocationContextInterceptor.java:43) at org.infinispan.interceptors.impl.InvocationContextInterceptor$1.apply(InvocationContextInterceptor.java:60) at org.infinispan.interceptors.InvocationExceptionFunction.apply(InvocationExceptionFunction.java:21) at org.infinispan.interceptors.impl.SimpleAsyncInvocationStage.addCallback(SimpleAsyncInvocationStage.java:67) at org.infinispan.interceptors.InvocationStage.andExceptionally(InvocationStage.java:34) at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:132) at org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:96) at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:137) at org.infinispan.transaction.impl.TransactionCoordinator.prepare(TransactionCoordinator.java:130) at org.infinispan.transaction.impl.TransactionCoordinator.prepare(TransactionCoordinator.java:113) at org.infinispan.transaction.impl.TransactionTable.beforeCompletion(TransactionTable.java:837) at org.infinispan.transaction.synchronization.SynchronizationAdapter.beforeCompletion(SynchronizationAdapter.java:28) at com.arjuna.ats.internal.jta.resources.arjunacore.SynchronizationImple.beforeCompletion(SynchronizationImple.java:76) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.beforeCompletion(TwoPhaseCoordinator.java:368) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:91) at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1200) at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126) at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89) at org.jboss.as.ejb3.tx.CMTTxInterceptor.endTransaction(CMTTxInterceptor.java:91) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:279) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.addResource(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.importInventory(InventoryHandlers.java:235) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.importInventory(Unknown Source) at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,998 ERROR [org.jboss.resteasy.resteasy_jaxrs.i18n] (default task-291) RESTEASY002005: Failed executing POST /import: org.jboss.resteasy.spi.ReaderException: com.fasterxml.jackson.databind.JsonMappingException: Instantiation of [map type; class java.util.LinkedHashMap, [simple type, class java.lang.String] -> [simple type, class java.lang.String]] value failed (java.lang.OutOfMemoryError): GC overhead limit exceeded at [Source: io.undertow.servlet.spec.ServletInputStreamImpl@543779ea; line: 1, column: 6416] (through reference chain: org.hawkular.inventory.api.model.Inventory["resources"]->java.util.ArrayList[2]->org.hawkular.inventory.api.model.RawResource["metrics"]->java.util.ArrayList[8]->org.hawkular.inventory.api.model.Metric["properties"]) at org.jboss.resteasy.core.MessageBodyParameterInjector.inject(MessageBodyParameterInjector.java:184) at org.jboss.resteasy.core.MethodInjectorImpl.injectArguments(MethodInjectorImpl.java:91) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:114) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.fasterxml.jackson.databind.JsonMappingException: Instantiation of [map type; class java.util.LinkedHashMap, [simple type, class java.lang.String] -> [simple type, class java.lang.String]] value failed (java.lang.OutOfMemoryError): GC overhead limit exceeded at [Source: io.undertow.servlet.spec.ServletInputStreamImpl@543779ea; line: 1, column: 6416] (through reference chain: org.hawkular.inventory.api.model.Inventory["resources"]->java.util.ArrayList[2]->org.hawkular.inventory.api.model.RawResource["metrics"]->java.util.ArrayList[8]->org.hawkular.inventory.api.model.Metric["properties"]) at com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:262) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.wrapAsJsonMappingException(StdValueInstantiator.java:445) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.rewrapCtorProblem(StdValueInstantiator.java:464) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createUsingDefault(StdValueInstantiator.java:245) at com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:339) at com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:277) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:249) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:26) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:277) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:249) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:26) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.ObjectReader._bind(ObjectReader.java:1535) at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:944) at org.jboss.resteasy.plugins.providers.jackson.ResteasyJackson2Provider.readFrom(ResteasyJackson2Provider.java:121) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.readFrom(AbstractReaderInterceptorContext.java:61) at org.jboss.resteasy.core.interception.ServerReaderInterceptorContext.readFrom(ServerReaderInterceptorContext.java:60) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:53) at org.jboss.resteasy.security.doseta.DigitalVerificationInterceptor.aroundReadFrom(DigitalVerificationInterceptor.java:34) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:55) at org.jboss.resteasy.plugins.interceptors.encoding.GZIPDecodingInterceptor.aroundReadFrom(GZIPDecodingInterceptor.java:59) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:55) at org.jboss.resteasy.core.MessageBodyParameterInjector.inject(MessageBodyParameterInjector.java:151) ... 51 more Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,999 ERROR [org.jboss.resteasy.resteasy_jaxrs.i18n] (default task-329) RESTEASY002005: Failed executing POST /import: org.jboss.resteasy.spi.ReaderException: com.fasterxml.jackson.databind.JsonMappingException: Instantiation of [map type; class java.util.LinkedHashMap, [simple type, class java.lang.String] -> [simple type, class java.lang.String]] value failed (java.lang.OutOfMemoryError): GC overhead limit exceeded at [Source: io.undertow.servlet.spec.ServletInputStreamImpl@5dfcf6bd; line: 1, column: 65643] (through reference chain: org.hawkular.inventory.api.model.Inventory["resources"]->java.util.ArrayList[24]->org.hawkular.inventory.api.model.RawResource["metrics"]->java.util.ArrayList[3]->org.hawkular.inventory.api.model.Metric["properties"]) at org.jboss.resteasy.core.MessageBodyParameterInjector.inject(MessageBodyParameterInjector.java:184) at org.jboss.resteasy.core.MethodInjectorImpl.injectArguments(MethodInjectorImpl.java:91) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:114) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.fasterxml.jackson.databind.JsonMappingException: Instantiation of [map type; class java.util.LinkedHashMap, [simple type, class java.lang.String] -> [simple type, class java.lang.String]] value failed (java.lang.OutOfMemoryError): GC overhead limit exceeded at [Source: io.undertow.servlet.spec.ServletInputStreamImpl@5dfcf6bd; line: 1, column: 65643] (through reference chain: org.hawkular.inventory.api.model.Inventory["resources"]->java.util.ArrayList[24]->org.hawkular.inventory.api.model.RawResource["metrics"]->java.util.ArrayList[3]->org.hawkular.inventory.api.model.Metric["properties"]) at com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:262) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.wrapAsJsonMappingException(StdValueInstantiator.java:445) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.rewrapCtorProblem(StdValueInstantiator.java:464) at com.fasterxml.jackson.databind.deser.std.StdValueInstantiator.createUsingDefault(StdValueInstantiator.java:245) at com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:339) at com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:277) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:249) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:26) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:277) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:249) at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:26) at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) at com.fasterxml.jackson.databind.ObjectReader._bind(ObjectReader.java:1535) at com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:944) at org.jboss.resteasy.plugins.providers.jackson.ResteasyJackson2Provider.readFrom(ResteasyJackson2Provider.java:121) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.readFrom(AbstractReaderInterceptorContext.java:61) at org.jboss.resteasy.core.interception.ServerReaderInterceptorContext.readFrom(ServerReaderInterceptorContext.java:60) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:53) at org.jboss.resteasy.security.doseta.DigitalVerificationInterceptor.aroundReadFrom(DigitalVerificationInterceptor.java:34) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:55) at org.jboss.resteasy.plugins.interceptors.encoding.GZIPDecodingInterceptor.aroundReadFrom(GZIPDecodingInterceptor.java:59) at org.jboss.resteasy.core.interception.AbstractReaderInterceptorContext.proceed(AbstractReaderInterceptorContext.java:55) at org.jboss.resteasy.core.MessageBodyParameterInjector.inject(MessageBodyParameterInjector.java:151) ... 51 more Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,999 ERROR [org.jboss.as.ejb3.invocation] (default task-333) WFLYEJB0034: EJB Invocation failed on component InventoryConfig for method public org.infinispan.Cache org.hawkular.inventory.service.InventoryConfig.getResourceCache(): javax.ejb.ConcurrentAccessTimeoutException: WFLYEJB0241: EJB 3.1 PFD2 4.8.5.5.1 concurrent access timeout on InventoryConfig - could not obtain lock within 5000MILLISECONDS at org.jboss.as.ejb3.concurrency.ContainerManagedConcurrencyInterceptor.processInvocation(ContainerManagedConcurrencyInterceptor.java:106) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.service.InventoryConfig$$$view1.getResourceCache(Unknown Source) at sun.reflect.GeneratedMethodAccessor171.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:128) at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) at org.hawkular.inventory.service.InventoryConfig$Proxy$_$$_Weld$EnterpriseProxy$.getResourceCache(Unknown Source) at sun.reflect.GeneratedMethodAccessor174.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:88) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:78) at org.jboss.weld.injection.producer.ProducerMethodProducer.produce(ProducerMethodProducer.java:100) at org.jboss.weld.injection.producer.AbstractMemberProducer.produce(AbstractMemberProducer.java:161) at org.jboss.weld.bean.AbstractProducerBean.create(AbstractProducerBean.java:181) at org.jboss.weld.context.unbound.DependentContextImpl.get(DependentContextImpl.java:70) at org.jboss.weld.bean.ContextualInstanceStrategy$DefaultContextualInstanceStrategy.get(ContextualInstanceStrategy.java:101) at org.jboss.weld.bean.ContextualInstance.get(ContextualInstance.java:50) at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742) at org.jboss.weld.manager.BeanManagerImpl.getInjectableReference(BeanManagerImpl.java:842) at org.jboss.weld.injection.FieldInjectionPoint.inject(FieldInjectionPoint.java:92) at org.jboss.weld.util.Beans.injectBoundFields(Beans.java:364) at org.jboss.weld.util.Beans.injectFieldsAndInitializers(Beans.java:375) at org.jboss.weld.injection.producer.DefaultInjector$1.proceed(DefaultInjector.java:71) at org.jboss.weld.injection.InjectionContextImpl.run(InjectionContextImpl.java:48) at org.jboss.weld.injection.producer.DefaultInjector.inject(DefaultInjector.java:73) at org.jboss.weld.injection.producer.StatelessSessionBeanInjector.inject(StatelessSessionBeanInjector.java:60) at org.jboss.weld.injection.producer.ejb.SessionBeanInjectionTarget.inject(SessionBeanInjectionTarget.java:140) at org.jboss.as.weld.injection.WeldInjectionContext.inject(WeldInjectionContext.java:39) at org.jboss.as.weld.injection.WeldInjectionInterceptor.processInvocation(WeldInjectionInterceptor.java:51) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.ManagedReferenceFieldInjectionInterceptorFactory$ManagedReferenceFieldInjectionInterceptor.processInvocation(ManagedReferenceFieldInjectionInterceptorFactory.java:107) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInterceptorFactory.java:28) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInjectionInterceptor.java:56) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvocation(Jsr299BindingsCreateInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) at org.jboss.as.ejb3.tx.CMTTxInterceptor.requiresNew(CMTTxInterceptor.java:344) at org.jboss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInterceptor.java:68) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInjectionContextInterceptor.processInvocation(WeldInjectionContextInterceptor.java:43) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:161) at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:134) at org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:88) at org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:64) at org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:61) at org.jboss.as.ejb3.pool.AbstractPool.create(AbstractPool.java:56) at org.jboss.as.ejb3.pool.strictmax.StrictMaxPool.get(StrictMaxPool.java:124) at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.addResource(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.importInventory(InventoryHandlers.java:235) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.importInventory(Unknown Source) at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 18:10:00,002 ERROR [org.jboss.as.ejb3.invocation] (default task-265) WFLYEJB0034: EJB Invocation failed on component InventoryServiceIspn for method public abstract void org.hawkular.inventory.api.InventoryService.deleteResources(java.util.Collection): java.lang.IllegalStateException: WFLYEJB0060: Wrong tx on thread: expected TransactionImple < ac, BasicAction: 0:ffff0a810038:5620acf1:59f0b9e0:6313 status: ActionStatus.ABORT_ONLY >, actual TransactionImple < ac, BasicAction: 0:ffff0a810038:5620acf1:59f0b9e0:6314 status: ActionStatus.ABORT_ONLY > at org.jboss.as.ejb3.tx.CMTTxInterceptor.endTransaction(CMTTxInterceptor.java:83) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:279) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.deleteResources(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.deleteResource(InventoryHandlers.java:349) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.deleteResource(Unknown Source) at sun.reflect.GeneratedMethodAccessor167.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 18:01:22,554 ERROR [io.undertow.request] (default task-309) UT005023: Exception handling request to /hawkular/inventory/resources/feed-8528bef9-11ee-403e-a29d-f3553a48c1fc-NewApp.war: org.jboss.resteasy.spi.UnhandledException: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.jboss.resteasy.core.ExceptionHandler.handleApplicationException(ExceptionHandler.java:77) at org.jboss.resteasy.core.ExceptionHandler.handleException(ExceptionHandler.java:220) at org.jboss.resteasy.core.SynchronousDispatcher.writeException(SynchronousDispatcher.java:175) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:418) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:38,515 INFO [org.apache.activemq.artemis.ra] (default-threads - 4) AMQ151000: awaiting topic/queue creation HawkularQueue 18:03:28,807 ERROR [io.undertow.request] (default task-33) UT005023: Exception handling request to /hawkular/inventory/resources/feed-bd45bec6-0156-4a45-8e7c-3470e8a70b7d-NewApp.war: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:38,515 ERROR [org.xnio.listener] (default I/O-20) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:28,864 ERROR [io.undertow.request] (default task-64) UT005023: Exception handling request to /hawkular/inventory/resources/feed-31eead22-d900-4987-81ac-ad00684f5158-NewApp.war: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:20,715 ERROR [io.undertow.request] (default task-325) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:07,523 ERROR [org.hawkular.agent.monitor.protocol.EndpointService] (Hawkular-WildFly-Agent-Scheduler-Avail-3) HAWKAGENT010009: An availability check failed: org.hawkular.agent.monitor.protocol.ProtocolException: Error fetching DMR attribute [status] at org.hawkular.agent.monitor.protocol.dmr.DMRDriver.fetchAttribute(DMRDriver.java:149) at org.hawkular.agent.monitor.protocol.EndpointService.measureAvails(EndpointService.java:516) at org.hawkular.agent.monitor.scheduler.AvailsCollector.run(AvailsCollector.java:60) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at org.shaded.jboss.threads.JBossThread.run(JBossThread.java:320) Caused by: org.hawkular.dmr.api.DmrApiException: java.io.IOException: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.hawkular.dmr.api.OperationBuilder$AbstractOperationBuilder.execute(OperationBuilder.java:86) at org.hawkular.agent.monitor.protocol.dmr.DMRDriver.fetchAttribute(DMRDriver.java:146) ... 8 more Caused by: java.io.IOException: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:149) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:75) at org.hawkular.dmr.api.OperationBuilder$AbstractOperationBuilder.execute(OperationBuilder.java:84) ... 9 more Caused by: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.shaded.jboss.as.protocol.ProtocolConnectionUtils.connectSync(ProtocolConnectionUtils.java:124) at org.shaded.jboss.as.protocol.ProtocolConnectionManager$EstablishingConnection.connect(ProtocolConnectionManager.java:257) at org.shaded.jboss.as.protocol.ProtocolConnectionManager.connect(ProtocolConnectionManager.java:71) at org.shaded.jboss.as.protocol.mgmt.FutureManagementChannel$Establishing.getChannel(FutureManagementChannel.java:212) at org.shaded.jboss.as.controller.client.impl.RemotingModelControllerClient.getOrCreateChannel(RemotingModelControllerClient.java:146) at org.shaded.jboss.as.controller.client.impl.RemotingModelControllerClient$1.getChannel(RemotingModelControllerClient.java:65) at org.shaded.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:147) at org.shaded.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:122) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeRequest(AbstractModelControllerClient.java:263) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:168) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:147) ... 11 more 18:05:22,073 ERROR [io.undertow.request] (default task-42) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:04:56,442 ERROR [org.apache.activemq.artemis.core.client] (Thread-18 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@1bd5d578-1512653915)) AMQ214017: Caught unexpected Throwable: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:37,341 ERROR [io.undertow.request] (default task-327) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:03:18,612 ERROR [io.undertow.request] (default task-362) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:38,515 ERROR [org.xnio.listener] (default I/O-2) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:33,599 WARN [org.hibernate.search.backend.impl.lucene.IndexWriterHolder] (Hibernate Search sync consumer thread for index resource.4) HSEARCH000052: Going to force release of the IndexWriter lock 18:02:00,457 ERROR [io.undertow.request] (default task-340) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:03:15,471 ERROR [io.undertow.request] (default task-1) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:03:07,252 ERROR [org.xnio.listener] (default I/O-6) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:04:24,799 ERROR [io.undertow.request] (default task-359) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:22,073 ERROR [org.xnio.listener] (default I/O-44) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:01:37,944 ERROR [io.undertow.request] (default task-335) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:03:21,214 ERROR [io.undertow.request] (default task-367) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:10:25,016 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-96) ISPN000136: Error executing command VersionedPrepareCommand, writing keys [feed-6d255abc-361b-4f08-a0c7-da4c44c9748c-Server-0-child-83, feed-6d255abc-361b-4f08-a0c7-da4c44c9748c-Server-0-child-84, feed-6d255abc-361b-4f08-a0c7-da4c44c9748c-Server-0-child-85, feed-6d255abc-361b-4f08-a0c7-da4c44c9748c-Server-0-child-86, feed-6d255abc-361b-4f08-a0c7-da4c44c9748c-Server-0-child-87, feed-6d255abc-361b-4f08-a0c7-da4c44c9748c-Server-0-child-88, feed-6d255abc-361b-4f08-a0c7-da4c44c9748c-Server-0-child-89, feed-6d255abc-361b-4f08-a0c7-da4c44c9748c-Server-0-child-90...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:03:15,471 ERROR [io.undertow.request] (default task-4) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:08,036 ERROR [io.undertow.request] (default task-37) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:01:32,611 ERROR [io.undertow.request] (default task-13) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[498], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:06,793 ERROR [org.jboss.as.ejb3.invocation] (default task-50) WFLYEJB0034: EJB Invocation failed on component InventoryServiceIspn for method public abstract void org.hawkular.inventory.api.InventoryService.addResource(java.util.Collection): java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:26,565 ERROR [io.undertow.request] (default task-385) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:32,971 ERROR [io.undertow.request] (default task-372) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:01:32,089 ERROR [io.undertow.request] (default task-346) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:26,565 ERROR [io.undertow.request] (default task-23) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:33,599 ERROR [io.undertow.request] (default task-66) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:27,309 ERROR [io.undertow.request] (default task-38) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:01:30,980 ERROR [io.undertow.request] (default task-278) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:04:07,735 ERROR [io.undertow.request] (default task-323) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:13,092 ERROR [io.undertow.request] (default task-47) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:59:04,515 ERROR [io.undertow.request] (default task-31) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:04,804 ERROR [io.undertow.request] (default task-75) UT005071: Undertow request failed HttpServerExchange{ DELETE /hawkular/inventory/resources/feed-3a009927-44cb-4b19-8387-5548a7c6e08e-NewApp.war request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[0], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:51,894 ERROR [org.hawkular.agent.monitor.storage.HawkularStorageAdapter] (Hawkular-WildFly-Agent-Storage-Dispatcher-Avail) HAWKAGENT010011: Failed to store avail data: [{"data":[{"value":"up","timestamp":1508954307334}],"id":"AI~R~[hawkular-services-2-vgsd2/hawkular-services-2-vgsd2~Local JMX~java.lang:name=Code Cache,type=MemoryPool]~AT~Memory Pool Availability~Memory Pool Availability"},{"data":[{"value":"up","timestamp":1508954307334}],"id":"AI~R~[hawkular-services-2-vgsd2/hawkular-services-2-vgsd2~Local JMX~java.lang:name=PS Old Gen,type=MemoryPool]~AT~Memory Pool Availability~Memory Pool Availability"}]: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:08,571 ERROR [io.undertow.request] (default task-297) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:01:20,013 ERROR [io.undertow.request] (default task-46) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:47,915 ERROR [io.undertow.request] (default task-78) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:17,764 ERROR [io.undertow.request] (default task-343) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:17,764 ERROR [io.undertow.request] (default task-25) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:35,799 ERROR [org.hawkular.agent.monitor.protocol.EndpointService] (Hawkular-WildFly-Agent-Scheduler-Metrics-2) HAWKAGENT010049: Could not access resources of endpoint [PlatformEndpointService[Endpoint[platform]:[null]]]: org.hawkular.agent.monitor.protocol.ProtocolException: java.lang.NullPointerException at org.hawkular.agent.monitor.protocol.platform.PlatformDriver.fetchAttribute(PlatformDriver.java:124) at org.hawkular.agent.monitor.protocol.EndpointService.measureMetrics(EndpointService.java:586) at org.hawkular.agent.monitor.scheduler.MetricsCollector.run(MetricsCollector.java:60) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at org.shaded.jboss.threads.JBossThread.run(JBossThread.java:320) Caused by: java.lang.NullPointerException at org.hawkular.agent.monitor.protocol.platform.OshiPlatformCache.getProcessor(OshiPlatformCache.java:204) at org.hawkular.agent.monitor.protocol.platform.OshiPlatformCache.discoverResources(OshiPlatformCache.java:467) at org.hawkular.agent.monitor.protocol.platform.PlatformDriver.fetchAttribute(PlatformDriver.java:94) ... 8 more 18:11:36,650 ERROR [org.hawkular.agent.monitor.protocol.EndpointService] (Hawkular-WildFly-Agent-Scheduler-Avail-3) HAWKAGENT010009: An availability check failed: org.hawkular.agent.monitor.protocol.ProtocolException: Error fetching DMR attribute [status] at org.hawkular.agent.monitor.protocol.dmr.DMRDriver.fetchAttribute(DMRDriver.java:149) at org.hawkular.agent.monitor.protocol.EndpointService.measureAvails(EndpointService.java:516) at org.hawkular.agent.monitor.scheduler.AvailsCollector.run(AvailsCollector.java:60) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at org.shaded.jboss.threads.JBossThread.run(JBossThread.java:320) Caused by: org.hawkular.dmr.api.DmrApiException: java.io.IOException: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.hawkular.dmr.api.OperationBuilder$AbstractOperationBuilder.execute(OperationBuilder.java:86) at org.hawkular.agent.monitor.protocol.dmr.DMRDriver.fetchAttribute(DMRDriver.java:146) ... 8 more Caused by: java.io.IOException: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:149) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:75) at org.hawkular.dmr.api.OperationBuilder$AbstractOperationBuilder.execute(OperationBuilder.java:84) ... 9 more Caused by: java.net.ConnectException: WFLYPRT0023: Could not connect to https-remoting://127.0.0.1:9993. The connection timed out at org.shaded.jboss.as.protocol.ProtocolConnectionUtils.connectSync(ProtocolConnectionUtils.java:124) at org.shaded.jboss.as.protocol.ProtocolConnectionManager$EstablishingConnection.connect(ProtocolConnectionManager.java:257) at org.shaded.jboss.as.protocol.ProtocolConnectionManager.connect(ProtocolConnectionManager.java:71) at org.shaded.jboss.as.protocol.mgmt.FutureManagementChannel$Establishing.getChannel(FutureManagementChannel.java:212) at org.shaded.jboss.as.controller.client.impl.RemotingModelControllerClient.getOrCreateChannel(RemotingModelControllerClient.java:146) at org.shaded.jboss.as.controller.client.impl.RemotingModelControllerClient$1.getChannel(RemotingModelControllerClient.java:65) at org.shaded.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:147) at org.shaded.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:122) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeRequest(AbstractModelControllerClient.java:263) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:168) at org.shaded.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:147) ... 11 more 17:59:17,990 ERROR [io.undertow.request] (default task-369) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:01:33,758 WARN [org.hawkular.agent.monitor.scheduler.AvailsCollector] (Hawkular-WildFly-Agent-Scheduler-Avail-1) Unexpected error caught in AvailsCollector for endpoint [JMXEndpointService[Endpoint[Local JMX]:[null]]]: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:14,361 ERROR [io.undertow.request] (default task-363) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:40,195 ERROR [org.xnio.listener] (default I/O-30) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:13,097 ERROR [io.undertow.request] (default task-63) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:59:00,419 ERROR [io.undertow.request] (default task-365) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:57,320 ERROR [io.undertow.request] (default task-300) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:21,705 ERROR [org.infinispan.transaction.impl.TransactionCoordinator] (default task-299) ISPN000188: Error while processing a commit in a two-phase transaction: org.infinispan.commons.CacheException: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.infinispan.interceptors.impl.InvocationContextInterceptor.rethrowException(InvocationContextInterceptor.java:140) at org.infinispan.interceptors.impl.InvocationContextInterceptor.access$000(InvocationContextInterceptor.java:43) at org.infinispan.interceptors.impl.InvocationContextInterceptor$1.apply(InvocationContextInterceptor.java:60) at org.infinispan.interceptors.InvocationExceptionFunction.apply(InvocationExceptionFunction.java:21) at org.infinispan.interceptors.impl.SimpleAsyncInvocationStage.addCallback(SimpleAsyncInvocationStage.java:67) at org.infinispan.interceptors.InvocationStage.andExceptionally(InvocationStage.java:34) at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:132) at org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:96) at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:137) at org.infinispan.transaction.impl.TransactionCoordinator.commitInternal(TransactionCoordinator.java:230) at org.infinispan.transaction.impl.TransactionCoordinator.commit(TransactionCoordinator.java:172) at org.infinispan.transaction.impl.TransactionTable.afterCompletion(TransactionTable.java:851) at org.infinispan.transaction.synchronization.SynchronizationAdapter.afterCompletion(SynchronizationAdapter.java:33) at com.arjuna.ats.internal.jta.resources.arjunacore.SynchronizationImple.afterCompletion(SynchronizationImple.java:96) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.afterCompletion(TwoPhaseCoordinator.java:542) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:101) at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1200) at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126) at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89) at org.jboss.as.ejb3.tx.CMTTxInterceptor.endTransaction(CMTTxInterceptor.java:91) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:279) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.addResource(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.importInventory(InventoryHandlers.java:235) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.importInventory(Unknown Source) at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:30,583 ERROR [io.undertow.request] (default task-32) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:24,186 ERROR [stderr] (default I/O-25) Exception in thread "AsyncStoreProcessor--p12-t22" Exception in thread "default task-351" Exception in thread "default I/O-22" Exception in thread "RxScheduledExecutorPool-1" Exception in thread "Hibernate Search sync consumer thread for index resource.0" java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:55,872 WARN [com.datastax.driver.core.Connection] (cluster3-connection-reaper-0) Forcing termination of Connection[hawkular-cassandra/172.30.23.124:9042-7, inFlight=0, closed=true]. This should not happen and is likely a bug, please report. 17:59:58,035 ERROR [org.apache.activemq.artemis.core.client] (Thread-30 (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$2@1bd5d578-1512653915)) AMQ214017: Caught unexpected Throwable: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:09,258 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-267) ISPN000136: Error executing command PutMapCommand, writing keys [feed-3b77cf32-eb86-48ed-a6ea-e4b750e003e6-Server-0-child-24, feed-3b77cf32-eb86-48ed-a6ea-e4b750e003e6-Server-0-child-25, feed-3b77cf32-eb86-48ed-a6ea-e4b750e003e6-Server-0, feed-3b77cf32-eb86-48ed-a6ea-e4b750e003e6-Server-0-child-22, feed-3b77cf32-eb86-48ed-a6ea-e4b750e003e6-Server-0-child-23, feed-3b77cf32-eb86-48ed-a6ea-e4b750e003e6-Server-0-child-28, feed-3b77cf32-eb86-48ed-a6ea-e4b750e003e6-Server-0-child-29, feed-3b77cf32-eb86-48ed-a6ea-e4b750e003e6-Server-0-child-26...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:49,624 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:629b in state RUN 17:57:37,224 ERROR [io.undertow.request] (default task-332) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:59:13,184 ERROR [io.undertow.request] (default task-258) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:31,518 ERROR [io.undertow.request] (default task-310) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:59:55,342 ERROR [org.jboss.as.ejb3.invocation] (default task-331) WFLYEJB0034: EJB Invocation failed on component InventoryServiceIspn for method public abstract void org.hawkular.inventory.api.InventoryService.addResource(java.util.Collection): java.lang.OutOfMemoryError: GC overhead limit exceeded 18:01:16,832 ERROR [io.undertow.request] (default task-274) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.129.0.57;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.129.0.57], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:53,675 WARN [com.arjuna.ats.arjuna] (default task-262) ARJUNA012125: TwoPhaseCoordinator.beforeCompletion - failed for SynchronizationImple< 0:ffff0a810038:5620acf1:59f0b9e0:62cb, org.hibernate.search.backend.impl.PostTransactionWorkQueueSynchronization@75936540 >: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:09,258 ERROR [io.undertow.request] (default task-344) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:04,324 ERROR [io.undertow.request] (default task-373) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:19,923 ERROR [io.undertow.request] (default task-338) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:59:59,326 ERROR [io.undertow.request] (default task-354) UT005023: Exception handling request to /hawkular/inventory/resources/feed-395bd14f-e948-4ef1-a123-495f73900883-NewApp.war: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:22,766 ERROR [io.undertow.request] (default task-3) UT005023: Exception handling request to /hawkular/inventory/resources/feed-526ee9f0-8ca4-4abc-a773-39585d2c58b0-NewApp.war: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:26,670 ERROR [io.undertow.request] (default task-311) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:09,935 ERROR [io.undertow.request] (default task-308) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:54:51,692 ERROR [io.undertow.request] (default task-313) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[498], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:23,783 ERROR [io.undertow.request] (default task-277) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:51,887 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:629c in state RUN 18:00:10,604 ERROR [io.undertow.request] (default task-21) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.RuntimeException: WFLYUT0052: Security context creation failed at org.wildfly.extension.undertow.security.SecurityActions.createSecurityContext(SecurityActions.java:74) at org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.setup(SecurityContextThreadSetupAction.java:87) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:42) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedConstructorAccessor113.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.jboss.security.SecurityContextFactory.createSecurityContext(SecurityContextFactory.java:199) at org.jboss.security.SecurityContextFactory.createSecurityContext(SecurityContextFactory.java:108) at org.wildfly.extension.undertow.security.SecurityActions.createSecurityContext(SecurityActions.java:72) ... 14 more Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:26,468 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-235) ISPN000136: Error executing command VersionedCommitCommand, writing keys [feed-18a8f4cf-cd54-4ab3-bab1-85b897a761aa-Server-0-child-38, feed-18a8f4cf-cd54-4ab3-bab1-85b897a761aa-Server-0-child-39, feed-18a8f4cf-cd54-4ab3-bab1-85b897a761aa-Server-0, feed-18a8f4cf-cd54-4ab3-bab1-85b897a761aa-Server-0-child-40, feed-18a8f4cf-cd54-4ab3-bab1-85b897a761aa-Server-0-child-41, feed-18a8f4cf-cd54-4ab3-bab1-85b897a761aa-Server-0-child-42, feed-18a8f4cf-cd54-4ab3-bab1-85b897a761aa-Server-0-child-43, feed-18a8f4cf-cd54-4ab3-bab1-85b897a761aa-Server-0-child-44...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:43,828 ERROR [io.undertow.request] (default task-371) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:21,710 ERROR [io.undertow.request] (default task-271) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:26,468 ERROR [io.undertow.request] (default task-357) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:00:47,966 ERROR [io.undertow.request] (default task-55) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:22,910 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-273) ISPN000136: Error executing command PutMapCommand, writing keys [feed-7729e56d-5899-434d-9493-847a05d924f1-Server-0-child-17, feed-7729e56d-5899-434d-9493-847a05d924f1-Server-0-child-16, feed-7729e56d-5899-434d-9493-847a05d924f1-Server-0-child-19, feed-7729e56d-5899-434d-9493-847a05d924f1-Server-0-child-18, feed-7729e56d-5899-434d-9493-847a05d924f1-Server-0-child-97, feed-7729e56d-5899-434d-9493-847a05d924f1-Server-0-child-96, feed-7729e56d-5899-434d-9493-847a05d924f1-Server-0-child-11, feed-7729e56d-5899-434d-9493-847a05d924f1-Server-0-child-98...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:54,530 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:62a1 in state RUN 17:56:11,821 ERROR [io.undertow.request] (default task-360) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {X-Powered-By=[Undertow/1], Server=[WildFly/10]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:11,096 ERROR [io.undertow.request] (default task-345) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:52,958 ERROR [org.infinispan.transaction.impl.TransactionCoordinator] (default task-235) ISPN000188: Error while processing a commit in a two-phase transaction: org.infinispan.commons.CacheException: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.infinispan.interceptors.impl.InvocationContextInterceptor.rethrowException(InvocationContextInterceptor.java:140) at org.infinispan.interceptors.impl.InvocationContextInterceptor.access$000(InvocationContextInterceptor.java:43) at org.infinispan.interceptors.impl.InvocationContextInterceptor$1.apply(InvocationContextInterceptor.java:60) at org.infinispan.interceptors.InvocationExceptionFunction.apply(InvocationExceptionFunction.java:21) at org.infinispan.interceptors.impl.SimpleAsyncInvocationStage.addCallback(SimpleAsyncInvocationStage.java:67) at org.infinispan.interceptors.InvocationStage.andExceptionally(InvocationStage.java:34) at org.infinispan.interceptors.BaseAsyncInterceptor.invokeNextAndExceptionally(BaseAsyncInterceptor.java:132) at org.infinispan.interceptors.impl.InvocationContextInterceptor.visitCommand(InvocationContextInterceptor.java:96) at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:248) at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:137) at org.infinispan.transaction.impl.TransactionCoordinator.commitInternal(TransactionCoordinator.java:230) at org.infinispan.transaction.impl.TransactionCoordinator.commit(TransactionCoordinator.java:172) at org.infinispan.transaction.impl.TransactionTable.afterCompletion(TransactionTable.java:851) at org.infinispan.transaction.synchronization.SynchronizationAdapter.afterCompletion(SynchronizationAdapter.java:33) at com.arjuna.ats.internal.jta.resources.arjunacore.SynchronizationImple.afterCompletion(SynchronizationImple.java:96) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.afterCompletion(TwoPhaseCoordinator.java:542) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:101) at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1200) at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126) at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89) at org.jboss.as.ejb3.tx.CMTTxInterceptor.endTransaction(CMTTxInterceptor.java:91) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:279) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.addResource(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.importInventory(InventoryHandlers.java:235) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.importInventory(Unknown Source) at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:46,227 ERROR [io.undertow.request] (default task-261) UT005071: Undertow request failed HttpServerExchange{ DELETE /hawkular/inventory/resources/feed-d478a0d3-503e-4741-a158-2a39feb16d68-NewApp.war request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[0], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache], Content-Type=[application/json], Content-Length=[0]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:17,266 WARN [org.apache.activemq.artemis.core.server] (activemq-failure-check-thread) AMQ222082: error on connection failure check: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:22,766 ERROR [io.undertow.request] (default task-293) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:34,462 ERROR [org.xnio.listener] (default I/O-28) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:58:48,395 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-284) ISPN000136: Error executing command VersionedPrepareCommand, writing keys [feed-5c15eb08-a741-4ffd-bb53-abfb4939e450-Server-0-child-5, feed-5c15eb08-a741-4ffd-bb53-abfb4939e450-Server-0-child-4, feed-5c15eb08-a741-4ffd-bb53-abfb4939e450-Server-0-child-3, feed-5c15eb08-a741-4ffd-bb53-abfb4939e450-Server-0-child-2, feed-5c15eb08-a741-4ffd-bb53-abfb4939e450-Server-0-child-9, feed-5c15eb08-a741-4ffd-bb53-abfb4939e450-Server-0-child-8, feed-5c15eb08-a741-4ffd-bb53-abfb4939e450-Server-0-child-40, feed-5c15eb08-a741-4ffd-bb53-abfb4939e450-Server-0-child-7...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:24,158 ERROR [io.undertow.request] (default task-2) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:10:50,052 ERROR [io.undertow.request] (default task-228) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:10:49,389 ERROR [io.undertow.request] (default task-240) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,969 ERROR [io.undertow.request] (default task-148) UT005023: Exception handling request to /hawkular/inventory/resources/feed-3cac05f3-b014-4377-9b58-7b2233ae2d08-NewApp.war: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:53:30,946 WARN [org.hawkular.agent.monitor.scheduler.MetricsCollector] (Hawkular-WildFly-Agent-Scheduler-Metrics-1) Unexpected error caught in MetricsCollector for endpoint [JMXEndpointService[Endpoint[Local JMX]:[null]]]: java.lang.OutOfMemoryError: GC overhead limit exceeded at java.util.HashSet.(HashSet.java:105) at org.hawkular.agent.monitor.scheduler.ScheduledCollectionsQueue.popNextScheduledSet(ScheduledCollectionsQueue.java:79) at org.hawkular.agent.monitor.scheduler.MetricsCollector.run(MetricsCollector.java:59) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at org.shaded.jboss.threads.JBossThread.run(JBossThread.java:320) 18:10:55,279 ERROR [io.undertow.request] (default task-209) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:29,388 ERROR [io.undertow.request] (default task-260) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:10:02,944 INFO [org.hawkular.cmdgw.command.ws.server.FeedWebSocket] (default task-395) HAWKFEEDCOMM000015: WebSocket session [hawkular-services-2-vgsd2] of [/feed/{feedId}] closed. Reason=[CloseReason[1006]] 18:07:23,978 ERROR [io.undertow.request] (default task-316) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:19,666 ERROR [io.undertow.request] (default task-381) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[498], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache], Content-Type=[application/json], Content-Length=[0]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:40,855 ERROR [io.undertow.request] (default task-199) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:44,554 ERROR [io.undertow.request] (default task-254) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:07:24,452 ERROR [io.undertow.request] (default task-386) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: Java heap space 18:10:02,944 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-314) ISPN000136: Error executing command VersionedPrepareCommand, writing keys [feed-7ab7968e-d790-4009-84bb-593df870724e-Server-0-child-79, feed-7ab7968e-d790-4009-84bb-593df870724e-Server-0-child-70, feed-7ab7968e-d790-4009-84bb-593df870724e-Server-0-child-74, feed-7ab7968e-d790-4009-84bb-593df870724e-Server-0-child-73, feed-7ab7968e-d790-4009-84bb-593df870724e-Server-0-child-72, feed-7ab7968e-d790-4009-84bb-593df870724e-Server-0-child-71, feed-7ab7968e-d790-4009-84bb-593df870724e-Server-0-child-78, feed-7ab7968e-d790-4009-84bb-593df870724e-Server-0-child-77...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:01,799 ERROR [io.undertow.request] (default task-242) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:07:22,720 ERROR [io.undertow.request] (default task-266) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:10:49,389 ERROR [io.undertow.request] (default task-210) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:11:29,403 ERROR [io.undertow.request] (default task-236) UT005023: Exception handling request to /hawkular/status: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:10:58,778 ERROR [io.undertow.request] (default task-327) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:38,423 ERROR [org.jboss.as.ejb3.invocation] (default task-12) WFLYEJB0034: EJB Invocation failed on component InventoryConfig for method public org.infinispan.Cache org.hawkular.inventory.service.InventoryConfig.getResourceCache(): javax.ejb.ConcurrentAccessTimeoutException: WFLYEJB0241: EJB 3.1 PFD2 4.8.5.5.1 concurrent access timeout on InventoryConfig - could not obtain lock within 5000MILLISECONDS at org.jboss.as.ejb3.concurrency.ContainerManagedConcurrencyInterceptor.processInvocation(ContainerManagedConcurrencyInterceptor.java:106) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.service.InventoryConfig$$$view1.getResourceCache(Unknown Source) at sun.reflect.GeneratedMethodAccessor171.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:128) at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) at org.hawkular.inventory.service.InventoryConfig$Proxy$_$$_Weld$EnterpriseProxy$.getResourceCache(Unknown Source) at sun.reflect.GeneratedMethodAccessor174.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:88) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:78) at org.jboss.weld.injection.producer.ProducerMethodProducer.produce(ProducerMethodProducer.java:100) at org.jboss.weld.injection.producer.AbstractMemberProducer.produce(AbstractMemberProducer.java:161) at org.jboss.weld.bean.AbstractProducerBean.create(AbstractProducerBean.java:181) at org.jboss.weld.context.unbound.DependentContextImpl.get(DependentContextImpl.java:70) at org.jboss.weld.bean.ContextualInstanceStrategy$DefaultContextualInstanceStrategy.get(ContextualInstanceStrategy.java:101) at org.jboss.weld.bean.ContextualInstance.get(ContextualInstance.java:50) at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742) at org.jboss.weld.manager.BeanManagerImpl.getInjectableReference(BeanManagerImpl.java:842) at org.jboss.weld.injection.FieldInjectionPoint.inject(FieldInjectionPoint.java:92) at org.jboss.weld.util.Beans.injectBoundFields(Beans.java:364) at org.jboss.weld.util.Beans.injectFieldsAndInitializers(Beans.java:375) at org.jboss.weld.injection.producer.DefaultInjector$1.proceed(DefaultInjector.java:71) at org.jboss.weld.injection.InjectionContextImpl.run(InjectionContextImpl.java:48) at org.jboss.weld.injection.producer.DefaultInjector.inject(DefaultInjector.java:73) at org.jboss.weld.injection.producer.StatelessSessionBeanInjector.inject(StatelessSessionBeanInjector.java:60) at org.jboss.weld.injection.producer.ejb.SessionBeanInjectionTarget.inject(SessionBeanInjectionTarget.java:140) at org.jboss.as.weld.injection.WeldInjectionContext.inject(WeldInjectionContext.java:39) at org.jboss.as.weld.injection.WeldInjectionInterceptor.processInvocation(WeldInjectionInterceptor.java:51) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.ManagedReferenceFieldInjectionInterceptorFactory$ManagedReferenceFieldInjectionInterceptor.processInvocation(ManagedReferenceFieldInjectionInterceptorFactory.java:107) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInterceptorFactory.java:28) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInjectionInterceptor.java:56) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvocation(Jsr299BindingsCreateInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) at org.jboss.as.ejb3.tx.CMTTxInterceptor.requiresNew(CMTTxInterceptor.java:344) at org.jboss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInterceptor.java:68) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInjectionContextInterceptor.processInvocation(WeldInjectionContextInterceptor.java:43) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:161) at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:134) at org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:88) at org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:64) at org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:61) at org.jboss.as.ejb3.pool.AbstractPool.create(AbstractPool.java:56) at org.jboss.as.ejb3.pool.strictmax.StrictMaxPool.get(StrictMaxPool.java:124) at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.deleteResources(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.deleteResource(InventoryHandlers.java:349) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.deleteResource(Unknown Source) at sun.reflect.GeneratedMethodAccessor167.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 18:10:56,168 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-181) ISPN000136: Error executing command PutMapCommand, writing keys [feed-24a93b82-e6d5-4287-9d90-849bfcf33085-Server-0-child-32, feed-24a93b82-e6d5-4287-9d90-849bfcf33085-Server-0-child-33, feed-24a93b82-e6d5-4287-9d90-849bfcf33085-Server-0-child-30, feed-24a93b82-e6d5-4287-9d90-849bfcf33085-Server-0-child-31, feed-24a93b82-e6d5-4287-9d90-849bfcf33085-Server-0-child-29, feed-24a93b82-e6d5-4287-9d90-849bfcf33085-Server-0-child-27, feed-24a93b82-e6d5-4287-9d90-849bfcf33085-Server-0-child-28, feed-24a93b82-e6d5-4287-9d90-849bfcf33085-Server-0-child-25...<92 other elements>]: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,970 ERROR [org.hawkular.agent.monitor.storage.HawkularStorageAdapter] (OkHttp https://127.0.0.1:8443/...) HAWKAGENT010010: Failed to store metric data: {"counters":[],"strings":[],"availabilities":[],"gauges":[{"data":[{"value":7.0,"timestamp":1508954220425}],"id":"MI~R~[hawkular-services-2-vgsd2/hawkular-services-2-vgsd2~platform~/OPERATING_SYSTEM=hawkular-services-2-vgsd2_OperatingSystem]~MT~Platform_Operating System_Process Count"}]}: java.net.SocketTimeoutException at java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at okhttp3.shaded.internal.platform.Platform.connectSocket(Platform.java:124) at okhttp3.shaded.internal.connection.RealConnection.connectSocket(RealConnection.java:187) at okhttp3.shaded.internal.connection.RealConnection.buildConnection(RealConnection.java:173) at okhttp3.shaded.internal.connection.RealConnection.connect(RealConnection.java:114) at okhttp3.shaded.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:193) at okhttp3.shaded.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:129) at okhttp3.shaded.internal.connection.StreamAllocation.newStream(StreamAllocation.java:98) at okhttp3.shaded.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.RealCall.getResponseWithInterceptorChain(RealCall.java:170) at okhttp3.shaded.RealCall.access$100(RealCall.java:33) at okhttp3.shaded.RealCall$AsyncCall.execute(RealCall.java:120) at okhttp3.shaded.internal.NamedRunnable.run(NamedRunnable.java:32) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 17:57:52,119 ERROR [io.undertow.request] (default task-324) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:10:19,104 ERROR [io.undertow.request] (default task-220) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:40,106 ERROR [org.jboss.as.ejb3.invocation] (default task-28) WFLYEJB0034: EJB Invocation failed on component InventoryConfig for method public org.infinispan.Cache org.hawkular.inventory.service.InventoryConfig.getResourceCache(): javax.ejb.ConcurrentAccessTimeoutException: WFLYEJB0241: EJB 3.1 PFD2 4.8.5.5.1 concurrent access timeout on InventoryConfig - could not obtain lock within 5000MILLISECONDS at org.jboss.as.ejb3.concurrency.ContainerManagedConcurrencyInterceptor.processInvocation(ContainerManagedConcurrencyInterceptor.java:106) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.service.InventoryConfig$$$view1.getResourceCache(Unknown Source) at sun.reflect.GeneratedMethodAccessor171.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:128) at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) at org.hawkular.inventory.service.InventoryConfig$Proxy$_$$_Weld$EnterpriseProxy$.getResourceCache(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:88) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:78) at org.jboss.weld.injection.producer.ProducerMethodProducer.produce(ProducerMethodProducer.java:100) at org.jboss.weld.injection.producer.AbstractMemberProducer.produce(AbstractMemberProducer.java:161) at org.jboss.weld.bean.AbstractProducerBean.create(AbstractProducerBean.java:181) at org.jboss.weld.context.unbound.DependentContextImpl.get(DependentContextImpl.java:70) at org.jboss.weld.bean.ContextualInstanceStrategy$DefaultContextualInstanceStrategy.get(ContextualInstanceStrategy.java:101) at org.jboss.weld.bean.ContextualInstance.get(ContextualInstance.java:50) at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742) at org.jboss.weld.manager.BeanManagerImpl.getInjectableReference(BeanManagerImpl.java:842) at org.jboss.weld.injection.FieldInjectionPoint.inject(FieldInjectionPoint.java:92) at org.jboss.weld.util.Beans.injectBoundFields(Beans.java:364) at org.jboss.weld.util.Beans.injectFieldsAndInitializers(Beans.java:375) at org.jboss.weld.injection.producer.DefaultInjector$1.proceed(DefaultInjector.java:71) at org.jboss.weld.injection.InjectionContextImpl.run(InjectionContextImpl.java:48) at org.jboss.weld.injection.producer.DefaultInjector.inject(DefaultInjector.java:73) at org.jboss.weld.injection.producer.StatelessSessionBeanInjector.inject(StatelessSessionBeanInjector.java:60) at org.jboss.weld.injection.producer.ejb.SessionBeanInjectionTarget.inject(SessionBeanInjectionTarget.java:140) at org.jboss.as.weld.injection.WeldInjectionContext.inject(WeldInjectionContext.java:39) at org.jboss.as.weld.injection.WeldInjectionInterceptor.processInvocation(WeldInjectionInterceptor.java:51) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.ManagedReferenceFieldInjectionInterceptorFactory$ManagedReferenceFieldInjectionInterceptor.processInvocation(ManagedReferenceFieldInjectionInterceptorFactory.java:107) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInterceptorFactory.java:28) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInjectionInterceptor.java:56) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvocation(Jsr299BindingsCreateInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) at org.jboss.as.ejb3.tx.CMTTxInterceptor.requiresNew(CMTTxInterceptor.java:344) at org.jboss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInterceptor.java:68) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInjectionContextInterceptor.processInvocation(WeldInjectionContextInterceptor.java:43) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:161) at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:134) at org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:88) at org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:64) at org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:61) at org.jboss.as.ejb3.pool.AbstractPool.create(AbstractPool.java:56) at org.jboss.as.ejb3.pool.strictmax.StrictMaxPool.get(StrictMaxPool.java:124) at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.deleteResources(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.deleteResource(InventoryHandlers.java:349) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.deleteResource(Unknown Source) at sun.reflect.GeneratedMethodAccessor167.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 18:05:04,373 ERROR [org.xnio.listener] (default I/O-4) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:07:23,406 ERROR [io.undertow.request] (default task-40) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:20,508 ERROR [org.hawkular.agent.monitor.storage.HawkularStorageAdapter] (OkHttp https://127.0.0.1:8443/...) HAWKAGENT010011: Failed to store avail data: [{"data":[{"value":"up","timestamp":1508954144647}],"id":"AI~R~[hawkular-services-2-vgsd2/hawkular-services-2-vgsd2~Local JMX~java.lang:name=Code Cache,type=MemoryPool]~AT~Memory Pool Availability~Memory Pool Availability"}]: java.net.SocketTimeoutException at java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at okhttp3.shaded.internal.platform.Platform.connectSocket(Platform.java:124) at okhttp3.shaded.internal.connection.RealConnection.connectSocket(RealConnection.java:187) at okhttp3.shaded.internal.connection.RealConnection.buildConnection(RealConnection.java:173) at okhttp3.shaded.internal.connection.RealConnection.connect(RealConnection.java:114) at okhttp3.shaded.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:193) at okhttp3.shaded.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:129) at okhttp3.shaded.internal.connection.StreamAllocation.newStream(StreamAllocation.java:98) at okhttp3.shaded.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.RealCall.getResponseWithInterceptorChain(RealCall.java:170) at okhttp3.shaded.RealCall.access$100(RealCall.java:33) at okhttp3.shaded.RealCall$AsyncCall.execute(RealCall.java:120) at okhttp3.shaded.internal.NamedRunnable.run(NamedRunnable.java:32) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 17:58:48,396 ERROR [io.undertow.request] (default task-224) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.129.0.58;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.129.0.58], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:40,109 ERROR [org.hawkular.agent.monitor.storage.HawkularStorageAdapter] (OkHttp https://127.0.0.1:8443/...) HAWKAGENT010010: Failed to store metric data: {"counters":[],"strings":[],"availabilities":[],"gauges":[{"data":[{"value":1.2089298944E10,"timestamp":1508954224316}],"id":"MI~R~[hawkular-services-2-vgsd2/hawkular-services-2-vgsd2~platform~/OPERATING_SYSTEM=hawkular-services-2-vgsd2_OperatingSystem/FILE_STORE=/dev/mapper/rhel-root]~MT~Platform_File Store_Usable Space"}]}: java.net.SocketTimeoutException at java.net.SocksSocketImpl.remainingMillis(SocksSocketImpl.java:111) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at okhttp3.shaded.internal.platform.Platform.connectSocket(Platform.java:124) at okhttp3.shaded.internal.connection.RealConnection.connectSocket(RealConnection.java:187) at okhttp3.shaded.internal.connection.RealConnection.buildConnection(RealConnection.java:173) at okhttp3.shaded.internal.connection.RealConnection.connect(RealConnection.java:114) at okhttp3.shaded.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:193) at okhttp3.shaded.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:129) at okhttp3.shaded.internal.connection.StreamAllocation.newStream(StreamAllocation.java:98) at okhttp3.shaded.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.shaded.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.shaded.RealCall.getResponseWithInterceptorChain(RealCall.java:170) at okhttp3.shaded.RealCall.access$100(RealCall.java:33) at okhttp3.shaded.RealCall$AsyncCall.execute(RealCall.java:120) at okhttp3.shaded.internal.NamedRunnable.run(NamedRunnable.java:32) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 18:08:40,110 ERROR [org.xnio.listener] (default task-312) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:40,110 ERROR [io.undertow.request] (default task-281) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:40,113 ERROR [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 2) WFLYDS0012: Scan of /opt/jboss/wildfly/standalone/deployments threw Exception: java.lang.RuntimeException: WFLYDS0036: Deployment model operation failed. undefined at org.jboss.as.server.deployment.scanner.DefaultDeploymentOperations.getDeploymentsStatus(DefaultDeploymentOperations.java:83) at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$ScanContext.(FileSystemDeploymentService.java:1622) at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$ScanContext.(FileSystemDeploymentService.java:1571) at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.scan(FileSystemDeploymentService.java:572) at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService.scan(FileSystemDeploymentService.java:491) at org.jboss.as.server.deployment.scanner.FileSystemDeploymentService$DeploymentScanRunnable.run(FileSystemDeploymentService.java:250) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) at org.jboss.threads.JBossThread.run(JBossThread.java:320) 18:08:40,119 ERROR [org.jboss.as.ejb3.invocation] (default task-94) WFLYEJB0034: EJB Invocation failed on component InventoryConfig for method public org.infinispan.Cache org.hawkular.inventory.service.InventoryConfig.getResourceCache(): javax.ejb.ConcurrentAccessTimeoutException: WFLYEJB0241: EJB 3.1 PFD2 4.8.5.5.1 concurrent access timeout on InventoryConfig - could not obtain lock within 5000MILLISECONDS at org.jboss.as.ejb3.concurrency.ContainerManagedConcurrencyInterceptor.processInvocation(ContainerManagedConcurrencyInterceptor.java:106) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.service.InventoryConfig$$$view1.getResourceCache(Unknown Source) at sun.reflect.GeneratedMethodAccessor171.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.util.reflection.Reflections.invokeAndUnwrap(Reflections.java:433) at org.jboss.weld.bean.proxy.EnterpriseBeanProxyMethodHandler.invoke(EnterpriseBeanProxyMethodHandler.java:128) at org.jboss.weld.bean.proxy.EnterpriseTargetBeanInstance.invoke(EnterpriseTargetBeanInstance.java:56) at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) at org.hawkular.inventory.service.InventoryConfig$Proxy$_$$_Weld$EnterpriseProxy$.getResourceCache(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:88) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:78) at org.jboss.weld.injection.producer.ProducerMethodProducer.produce(ProducerMethodProducer.java:100) at org.jboss.weld.injection.producer.AbstractMemberProducer.produce(AbstractMemberProducer.java:161) at org.jboss.weld.bean.AbstractProducerBean.create(AbstractProducerBean.java:181) at org.jboss.weld.context.unbound.DependentContextImpl.get(DependentContextImpl.java:70) at org.jboss.weld.bean.ContextualInstanceStrategy$DefaultContextualInstanceStrategy.get(ContextualInstanceStrategy.java:101) at org.jboss.weld.bean.ContextualInstance.get(ContextualInstance.java:50) at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742) at org.jboss.weld.manager.BeanManagerImpl.getInjectableReference(BeanManagerImpl.java:842) at org.jboss.weld.injection.FieldInjectionPoint.inject(FieldInjectionPoint.java:92) at org.jboss.weld.util.Beans.injectBoundFields(Beans.java:364) at org.jboss.weld.util.Beans.injectFieldsAndInitializers(Beans.java:375) at org.jboss.weld.injection.producer.DefaultInjector$1.proceed(DefaultInjector.java:71) at org.jboss.weld.injection.InjectionContextImpl.run(InjectionContextImpl.java:48) at org.jboss.weld.injection.producer.DefaultInjector.inject(DefaultInjector.java:73) at org.jboss.weld.injection.producer.StatelessSessionBeanInjector.inject(StatelessSessionBeanInjector.java:60) at org.jboss.weld.injection.producer.ejb.SessionBeanInjectionTarget.inject(SessionBeanInjectionTarget.java:140) at org.jboss.as.weld.injection.WeldInjectionContext.inject(WeldInjectionContext.java:39) at org.jboss.as.weld.injection.WeldInjectionInterceptor.processInvocation(WeldInjectionInterceptor.java:51) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.ManagedReferenceFieldInjectionInterceptorFactory$ManagedReferenceFieldInjectionInterceptor.processInvocation(ManagedReferenceFieldInjectionInterceptorFactory.java:107) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInterceptorFactory.java:28) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInjectionInterceptor.java:56) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvocation(Jsr299BindingsCreateInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) at org.jboss.as.ejb3.tx.CMTTxInterceptor.requiresNew(CMTTxInterceptor.java:344) at org.jboss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInterceptor.java:68) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInjectionContextInterceptor.processInvocation(WeldInjectionContextInterceptor.java:43) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:161) at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:134) at org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:88) at org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:64) at org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:61) at org.jboss.as.ejb3.pool.AbstractPool.create(AbstractPool.java:56) at org.jboss.as.ejb3.pool.strictmax.StrictMaxPool.get(StrictMaxPool.java:124) at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.addResource(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.importInventory(InventoryHandlers.java:235) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.importInventory(Unknown Source) at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 18:07:23,979 ERROR [io.undertow.request] (default task-51) UT005071: Undertow request failed HttpServerExchange{ DELETE /hawkular/inventory/resources/feed-dfe060e2-bfc8-4c9a-97c2-518ce3eea08f-NewApp.war request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.31;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.31], Content-type=[application/json], Content-Length=[0], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache], Date=[Wed, 25 Oct 2017 18:00:26 GMT], Connection=[keep-alive], Content-Type=[application/json], Content-Length=[0]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:12,814 ERROR [io.undertow.request] (default task-341) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:41,068 ERROR [io.undertow.request] (default task-26) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:48,893 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (default task-383) ISPN000136: Error executing command VersionedCommitCommand, writing keys [feed-f386659d-c243-4f4c-852e-92d18a91ac03-NewApp.war]: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:48,893 ERROR [io.undertow.request] (default task-102) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:07:23,406 ERROR [io.undertow.request] (default task-106) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:39,122 ERROR [io.undertow.request] (default task-393) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,970 ERROR [io.undertow.request] (default task-127) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,973 ERROR [io.undertow.request] (default task-347) UT005071: Undertow request failed HttpServerExchange{ POST /hawkular/inventory/import request {Accept=[application/json], Accept-Encoding=[gzip, deflate], User-Agent=[python-requests/2.18.4], Forwarded=[for=10.16.23.44;host=hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com;proto=http], Authorization=[Basic amRvZTpwYXNzd29yZA==], X-Forwarded-Proto=[http], X-Forwarded-Port=[80], X-Forwarded-For=[10.16.23.44], Content-type=[application/json], Content-Length=[271719], Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com], X-Forwarded-Host=[hs-downstream-web-inventory-scalability-inventory-scalability.cloud2.jonqe.lab.eng.bos.redhat.com]} response {Expires=[0], Cache-Control=[no-cache, no-store, must-revalidate], X-Powered-By=[Undertow/1], Server=[WildFly/10], Pragma=[no-cache]}}: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:59,981 ERROR [io.undertow.request] (default task-57) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:09:53,464 ERROR [org.xnio.listener] (default I/O-48) XNIO001007: A channel event listener threw an exception: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:23,607 ERROR [io.undertow.request] (default task-295) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:57:09,226 ERROR [io.undertow.request] (default task-296) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:38,422 ERROR [org.jboss.as.ejb3.invocation] (default task-342) WFLYEJB0034: EJB Invocation failed on component InventoryServiceIspn for method public abstract void org.hawkular.inventory.api.InventoryService.deleteResources(java.util.Collection): java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:31,913 ERROR [io.undertow.request] (default task-88) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:08:13,543 ERROR [org.jboss.as.txn] (default task-302) WFLYTX0003: APPLICATION ERROR: transaction still active in request with status 1 18:11:32,628 ERROR [io.undertow.request] (default task-167) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:53,341 ERROR [io.undertow.request] (default task-81) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 17:56:12,547 ERROR [io.undertow.request] (default task-317) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:05:23,719 ERROR [io.undertow.request] (default task-374) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:43,919 ERROR [io.undertow.request] (default task-392) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:02:04,614 ERROR [org.jboss.as.ejb3.invocation] (default task-280) WFLYEJB0034: EJB Invocation failed on component InventoryServiceIspn for method public abstract void org.hawkular.inventory.api.InventoryService.addResource(java.util.Collection): javax.ejb.EJBException: WFLYEJB0442: Unexpected Error at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleExceptionInOurTx(CMTTxInterceptor.java:184) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:277) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:54) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:636) at org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) at org.hawkular.inventory.api.InventoryService$$$view2.addResource(Unknown Source) at org.hawkular.inventory.handlers.InventoryHandlers.importInventory(InventoryHandlers.java:235) at org.hawkular.inventory.handlers.InventoryHandlers$Proxy$_$$_WeldClientProxy.importInventory(Unknown Source) at sun.reflect.GeneratedMethodAccessor164.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139) at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249) at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:236) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:402) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at java.util.concurrent.ForkJoinTask.getThrowableException(ForkJoinTask.java:598) at java.util.concurrent.ForkJoinTask.reportException(ForkJoinTask.java:677) at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:735) at java.util.stream.ReduceOps$ReduceOp.evaluateParallel(ReduceOps.java:714) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233) at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) at org.hawkular.inventory.service.InventoryServiceIspn.addResource(InventoryServiceIspn.java:120) at sun.reflect.GeneratedMethodAccessor165.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:82) at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93) at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:64) at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) ... 90 more Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:14,100 ERROR [io.undertow.request] (default task-268) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:04:37,462 ERROR [io.undertow.request] (default task-89) UT005023: Exception handling request to /hawkular/inventory/import: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:06:46,415 ERROR [io.undertow.request] (default task-60) UT005023: Exception handling request to /hawkular/inventory/resources/feed-dcfd1d06-f6ef-44cc-9d4c-d22d07f443fb-NewApp.war: org.jboss.resteasy.spi.UnhandledException: java.lang.OutOfMemoryError: GC overhead limit exceeded at org.jboss.resteasy.core.ExceptionHandler.handleApplicationException(ExceptionHandler.java:77) at org.jboss.resteasy.core.ExceptionHandler.handleException(ExceptionHandler.java:220) at org.jboss.resteasy.core.SynchronousDispatcher.writeException(SynchronousDispatcher.java:175) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:418) at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:209) at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:221) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:85) at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) at io.undertow.server.handlers.DisableCacheHandler.handleRequest(DisableCacheHandler.java:33) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) at io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) at io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.api.LegacyThreadSetupActionWrapper$1.call(LegacyThreadSetupActionWrapper.java:44) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors.java:202) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:805) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded 18:12:32,885 ERROR [org.jboss.as.ejb3.invocation] (default task-28) WFLYEJB0034: EJB Invocation failed on component InventoryServiceIspn for method public abstract void org.hawkular.inventory.api.InventoryService.deleteResources(java.util.Collection): javax.ejb.EJBException: java.lang.IllegalStateException: WFLYEE0042: Failed to construct component instance at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleExceptionInOurTx(CMTTxInterceptor.java:187) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:277) at org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:327) at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) 18:13:40,110 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6357 in state RUN 18:13:40,111 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:635a in state RUN 18:13:40,115 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:635d in state RUN 18:13:40,118 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:635c in state RUN 18:13:41,071 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6369 in state RUN 18:13:41,072 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:636c in state RUN 18:13:42,646 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:636e in state RUN 18:13:42,647 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6370 in state RUN 18:13:42,647 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6371 in state RUN 18:13:45,987 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6389 in state RUN 18:14:21,903 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6397 in state RUN 18:14:21,904 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6396 in state RUN 18:14:22,988 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:639c in state RUN 18:14:59,971 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63a6 in state RUN 18:14:59,971 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63ab in state RUN 18:14:59,989 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63b2 in state RUN 18:14:59,990 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63b6 in state RUN 18:14:59,992 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63bb in state RUN 18:14:59,994 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63bd in state RUN 18:14:59,996 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63c5 in state RUN 18:14:59,998 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63c7 in state RUN 18:14:59,999 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63cb in state RUN 18:15:00,001 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63d1 in state RUN 18:15:00,003 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63d7 in state RUN 18:15:00,827 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63e1 in state RUN 18:15:00,828 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63d1 in state SCHEDULE_CANCEL 18:15:01,604 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63e5 in state RUN 18:15:01,604 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63e8 in state RUN 18:15:01,608 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63ee in state RUN 18:15:01,611 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63f8 in state RUN 18:15:01,614 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63f9 in state RUN 18:15:01,617 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6402 in state RUN 18:15:01,640 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6404 in state RUN 18:15:01,643 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6409 in state RUN 18:15:01,646 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:640b in state RUN 18:15:01,649 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6417 in state RUN 18:15:01,653 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:641c in state RUN 18:15:01,656 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6421 in state RUN 18:15:01,659 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6428 in state RUN 18:15:01,662 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:642a in state RUN 18:15:01,665 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6430 in state RUN 18:15:02,949 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6434 in state RUN 18:15:02,950 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6438 in state RUN 18:15:02,954 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:643d in state RUN 18:15:02,957 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6442 in state RUN 18:15:02,960 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:644f in state RUN 18:15:02,963 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6453 in state RUN 18:15:04,069 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6457 in state RUN 18:15:04,070 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6458 in state RUN 18:15:04,075 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:63e4 in state RUN 18:15:04,815 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:645f in state RUN 18:15:05,915 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6463 in state RUN 18:15:06,553 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6466 in state RUN 18:15:08,337 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:646b in state RUN 18:15:23,830 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6476 in state RUN 18:15:28,954 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:647b in state RUN 18:15:28,965 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:648b in state RUN 18:15:28,969 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6490 in state RUN 18:15:28,969 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6491 in state RUN 18:15:28,971 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6494 in state RUN 18:15:31,230 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:6499 in state RUN 18:15:31,231 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:649a in state RUN 18:15:31,231 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:649f in state RUN 18:15:32,278 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64a3 in state RUN 18:15:50,053 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64a8 in state RUN 18:15:51,497 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64ae in state RUN 18:15:51,497 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64b2 in state RUN 18:15:55,284 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64b5 in state RUN 18:17:37,320 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64d4 in state RUN 18:17:37,344 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64d5 in state RUN 18:17:37,344 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64d8 in state RUN 18:17:38,644 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a810038:5620acf1:59f0b9e0:64e8 in state RUN