Is your Cassandra instance up and running? The errors appear to be that Hawkular Metrics can no longer connect to the Cassandra instance or is having problems trying to connect to it.
----- Original Message ----- > From: "Den Cowboy" <[email protected]> > To: [email protected] > Sent: Thursday, February 4, 2016 5:42:07 AM > Subject: RE: hawkular-metrics Error on Origin 1.1 > > My heapster shows the whole time: > E0204 10:41:18.378835 1 driver.go:234] Could not update tags: Put > https://hawkular-metrics:443/hawkular/metrics/counters/heapster%2Fd8af2e68-cb28-11e5-9109-021fa5f1deed%2Fmemory%2Fpage_faults/tags: > net/http: request canceled while waiting for connection > > > From: [email protected] > To: [email protected] > Subject: hawkular-metrics Error on Origin 1.1 > Date: Thu, 4 Feb 2016 10:30:00 +0000 > > I've set up my Hawkul cluster metrics. The configuration went fine and all > the pods are running. > But when I'm taking a watch into the metrics-tab of some apps I see: > Error fetching cpu/usage for container test. Failed to perform operation due > to an error: All host(s) tried for query failed (no host was tried) > > For more information I took a look into the logs of my hawkular-metrics - pod > which shows: > > [0m[31m10:24:33,210 ERROR [com.datastax.driver.core.ControlConnection] > (cluster9-reconnection-0) [Control connection] Cannot connect to any host, > scheduling retry in 64000 milliseconds > [0m[31m10:25:37,211 ERROR [com.datastax.driver.core.ControlConnection] > (cluster9-reconnection-0) [Control connection] Cannot connect to any host, > scheduling retry in 128000 milliseconds > [0m[31m10:27:45,211 ERROR [com.datastax.driver.core.ControlConnection] > (cluster9-reconnection-0) [Control connection] Cannot connect to any host, > scheduling retry in 256000 milliseconds > [0m[31m10:28:06,554 ERROR [org.hawkular.metrics.api.jaxrs.util.ApiUtils] > (RxComputationThreadPool-2) HAWKMETRICS200010: Failed to process request: > java.util.concurrent.ExecutionException: > com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) > tried for query failed (no host was tried) > at > com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299) > at > com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286) > at > com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) > at org.hawkular.rx.cassandra.driver.RxUtil$2$1.run(RxUtil.java:82) > at org.hawkular.rx.cassandra.driver.RxUtil$1$1.call(RxUtil.java:59) > at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All > host(s) tried for query failed (no host was tried) > at > com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:219) > at com.datastax.driver.core.RequestHandler.access$900(RequestHandler.java:45) > at > com.datastax.driver.core.RequestHandler$SpeculativeExecution.sendRequest(RequestHandler.java:279) > at > com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:118) > at > com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:94) > at com.datastax.driver.core.SessionManager.execute(SessionManager.java:565) > at > com.datastax.driver.core.SessionManager.executeQuery(SessionManager.java:602) > at > com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:98) > at > org.hawkular.rx.cassandra.driver.RxSessionImpl.execute(RxSessionImpl.java:80) > at > org.hawkular.metrics.core.impl.DataAccessImpl.findGaugeData(DataAccessImpl.java:438) > at > org.hawkular.metrics.core.impl.DataAccessImpl.findGaugeData(DataAccessImpl.java:409) > at > org.hawkular.metrics.core.impl.MetricsServiceImpl.lambda$startUp$20(MetricsServiceImpl.java:223) > at > org.hawkular.metrics.core.impl.MetricsServiceImpl.lambda$findDataPoints$55(MetricsServiceImpl.java:644) > at com.codahale.metrics.Timer.time(Timer.java:99) > at > org.hawkular.metrics.core.impl.MetricsServiceImpl.time(MetricsServiceImpl.java:907) > at > org.hawkular.metrics.core.impl.MetricsServiceImpl.findDataPoints(MetricsServiceImpl.java:644) > at > org.hawkular.metrics.core.impl.MetricsServiceImpl.findGaugeStats(MetricsServiceImpl.java:713) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.jboss.weld.bean.proxy.AbstractBeanInstance.invoke(AbstractBeanInstance.java:38) > at > org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) > at > org.jboss.weld.proxies.MetricsService$962346502$Proxy$_$$_WeldClientProxy.findGaugeStats(Unknown > Source) > at > org.hawkular.metrics.api.jaxrs.handler.GaugeHandler.findGaugeData(GaugeHandler.java:305) > at > org.hawkular.metrics.api.jaxrs.handler.GaugeHandler$Proxy$_$$_WeldClientProxy.findGaugeData(Unknown > Source) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:137) > at > org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:296) > at > org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:250) > at > org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:237) > at > org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:356) > at > org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:179) > at > org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:220) > at > org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56) > at > org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) > > Someone known with this error? > > _______________________________________________ users mailing list > [email protected] > http://lists.openshift.redhat.com/openshiftmm/listinfo/users > > _______________________________________________ > users mailing list > [email protected] > http://lists.openshift.redhat.com/openshiftmm/listinfo/users > _______________________________________________ users mailing list [email protected] http://lists.openshift.redhat.com/openshiftmm/listinfo/users
