Hi.
Heapster is experiencing failures for some pods of the cluster, which in
turn causes HPA to malfunction.
>From project events I can see:
2017-03-22T22:13:29Z 2017-03-22T21:32:59Z 32 portal
HorizontalPodAutoscaler Warning FailedGetMetrics
{horizontal-pod-autoscaler } failed to get CPU consumption and request:
metrics obtained for 2/4 of pods
2017-03-22T22:13:29Z 2017-03-22T21:32:59Z 32 portal
HorizontalPodAutoscaler Warning FailedComputeReplicas
{horizontal-pod-autoscaler } failed to get CPU utilization: failed to get
CPU consumption and request: metrics obtained for 2/4 of pods
Heapster logs says some pods have no metrics, while other pods from the
same project does:
I0322 22:10:29.104727 1 handlers.go:242] No metrics for container
wordpress in pod kondzilla/portal-107-rg2ia
I0322 22:10:29.104746 1 handlers.go:178] No metrics for pod
kondzilla/portal-107-rg2ia
...
I0322 22:12:21.780763 1 pod_based_enricher.go:141] Container
namespace:kondzilla/pod:portal-107-rg2ia/container:wordpress not found,
creating a stub
Hitting kubelete's /stats/container/ does returns valid stats, as expected.
I'm running:
openshift v1.3.1
kubernetes v1.3.0+52492b4
etcd 2.3.0+git
openshift/origin-metrics-cassandra:v1.3.1
openshift/origin-metrics-hawkular-metrics:v1.3.1
openshift/origin-metrics-heapster:v1.3.2 (v1.3.1 has the same effect)
Thanks,
--
Mateus Caruccio / Master of Puppets
GetupCloud.com
We make the infrastructure invisible
_______________________________________________
dev mailing list
[email protected]
http://lists.openshift.redhat.com/openshiftmm/listinfo/dev