Hi Team,
Anyone came across this following issue. Please provide your inputs or
suggestions.
Regards,
Naveen
________________________________
From: [email protected] <[email protected]> on behalf of
Naveen S. Sankad via lists.onap.org <[email protected]>
Sent: 29 September 2020 21:26
To: [email protected] <[email protected]>
Cc: [email protected] <[email protected]>
Subject: [onap-discuss] [Frankfurt] #dcae VES collector pod Readiness probe
failed
Hi,
As a part of Frankfurt deployment, all the healthchecks are passing but
dep-dcae-ves-collector-7d4449ddbb-b4jkh pod is giving error message: Readiness
probe failed: Get http://10.42.7.113:8080/healthcheck: net/http: request
canceled (Client.Timeout exceeded while awaiting headers). By which events are
unable to reach VES collector.
Thanks in advance, any inputs or suggestions are highly appreciated.
Thanks and Regards,
Naveen
L&T Technology Services Ltd
www.LTTS.com
L&T Technology Services Limited (LTTS) is committed to safeguard your data
privacy. For more information to view our commitment towards data privacy under
GDPR, please visit the privacy policy on our website www.Ltts.com. This Email
may contain confidential or privileged information for the intended recipient
(s). If you are not the intended recipient, please do not use or disseminate
the information, notify the sender and delete it from your system.
L&T Technology Services Ltd
www.LTTS.com
L&T Technology Services Limited (LTTS) is committed to safeguard your data
privacy. For more information to view our commitment towards data privacy under
GDPR, please visit the privacy policy on our website www.Ltts.com. This Email
may contain confidential or privileged information for the intended recipient
(s). If you are not the intended recipient, please do not use or disseminate
the information, notify the sender and delete it from your system.
L&T Technology Services Ltd
www.LTTS.com
L&T Technology Services Limited (LTTS) is committed to safeguard your data
privacy. For more information to view our commitment towards data privacy under
GDPR, please visit the privacy policy on our website www.Ltts.com. This Email
may contain confidential or privileged information for the intended recipient
(s). If you are not the intended recipient, please do not use or disseminate
the information, notify the sender and delete it from your system.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22213): https://lists.onap.org/g/onap-discuss/message/22213
Mute This Topic: https://lists.onap.org/mt/77199049/21656
Mute #dcaegen2:https://lists.onap.org/g/onap-discuss/mutehashtag/dcaegen2
Group Owner: [email protected]
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-
root@f6demo-nfs:~/oom/kubernetes/robot#
root@f6demo-nfs:~/oom/kubernetes/robot# ./ete-k8s.sh onap health
++ export NAMESPACE=onap
++ NAMESPACE=onap
+++ kubectl --namespace onap get pods
+++ sed 's/ .*//'
+++ grep robot
++ POD=frank6-robot-8669dc5ff8-7vnqz
++ TAGS='-i health'
+++ dirname ./ete-k8s.sh
++ DIR=.
++ SCRIPTDIR=scripts/etescript
++ ETEHOME=/var/opt/ONAP
++ [[ health == \e\x\e\c\s\c\r\i\p\t ]]
+++ kubectl --namespace onap exec frank6-robot-8669dc5ff8-7vnqz -- bash -c 'ls
-1q /share/logs/ | wc -l'
++ export GLOBAL_BUILD_NUMBER=7
++ GLOBAL_BUILD_NUMBER=7
+++ printf %04d 7
++ OUTPUT_FOLDER=0007_ete_health
++ DISPLAY_NUM=97
++ VARIABLEFILES='-V /share/config/robot_properties.py'
++ VARIABLES='-v GLOBAL_BUILD_NUMBER:12499'
++ case $2 in
++ kubectl --namespace onap exec frank6-robot-8669dc5ff8-7vnqz --
/var/opt/ONAP/runTags.sh -V /share/config/robot_properties.py -v
GLOBAL_BUILD_NUMBER:12499 -d /share/logs/0007_ete_health -i health --display 97
Starting Xvfb on display :97 with res 1280x1024x24
Executing robot tests at log level TRACE
==============================================================================
Testsuites
==============================================================================
Testsuites.Health-Check :: Test that ONAP components are available via basi...
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF SMS Health Check | PASS |
------------------------------------------------------------------------------
Basic APPC Health Check | PASS |
------------------------------------------------------------------------------
Basic CLI Health Check | PASS |
------------------------------------------------------------------------------
Basic CLAMP Health Check | PASS |
------------------------------------------------------------------------------
Basic DCAE Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Data Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Bus Controller Health Check With Basic Auth | PASS |
------------------------------------------------------------------------------
Basic External API NBI Health Check | PASS |
------------------------------------------------------------------------------
Basic Microservice Bus Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-pike API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-starlingx API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-titanium_cloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-vio API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-k8s API Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-Homing Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-SNIRO Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-CMSO Health Check | PASS |
------------------------------------------------------------------------------
Basic Policy Health Check | PASS |
------------------------------------------------------------------------------
Basic Policy New Healthcheck | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check (DMaaP:UP)
| PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Basic UseCaseUI API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC emsdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC gvnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC huaweivnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC jujuvnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC multivimproxy API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC nokiav2driver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC nslcm API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC resmgr API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnflcm API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnfmgr API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnfres API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC workflow API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC ztesdncdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC ztevnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VID Health Check | PASS |
------------------------------------------------------------------------------
Basic VNFSDK Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-fcaps API Health Check | PASS |
------------------------------------------------------------------------------
Basic Modeling genericparser API Health Check | PASS |
------------------------------------------------------------------------------
Basic CDS Health Check | PASS |
------------------------------------------------------------------------------
Testsuites.Health-Check :: Test that ONAP components are available... | PASS |
47 critical tests, 47 passed, 0 failed
47 tests total, 47 passed, 0 failed
==============================================================================
Testsuites | PASS |
47 critical tests, 47 passed, 0 failed
47 tests total, 47 passed, 0 failed
==============================================================================
Output: /share/logs/0007_ete_health/output.xml
Log: /share/logs/0007_ete_health/log.html
Report: /share/logs/0007_ete_health/report.html
root@f6demo-nfs:/home/ubuntu# kubectl get pods -o wide | grep ves
dep-dcae-hv-ves-collector-d7ffb6c88-2s2jl 2/2 Running
0 4h22m 10.42.1.69 f6demo-k8s-02 <none> <none>
dep-dcae-ves-collector-7d4449ddbb-b4jkh 2/2 Running
0 4h22m 10.42.7.113 f6demo-k8s-09 <none> <none>
root@f6demo-nfs:/home/ubuntu#
root@f6demo-nfs:/home/ubuntu#
root@f6demo-nfs:/home/ubuntu# kubectl describe pod
dep-dcae-ves-collector-7d4449ddbb-b4jkh
Name: dep-dcae-ves-collector-7d4449ddbb-b4jkh
Namespace: onap
Priority: 0
Node: f6demo-k8s-09/80.0.0.13
Start Time: Tue, 29 Sep 2020 09:42:58 +0000
Labels: app=dcae-ves-collector
cfydeployment=ves-tls
cfynode=ves
cfynodeinstance=ves_jua9be
k8sdeployment=dep-dcae-ves-collector
pod-template-hash=7d4449ddbb
Annotations: cni.projectcalico.org/podIP: 10.42.7.113/32
Status: Running
IP: 10.42.7.113
Controlled By: ReplicaSet/dep-dcae-ves-collector-7d4449ddbb
Init Containers:
init-tls:
Container ID:
docker://5259c7c034a1fc76396b22f952f5e6fab95e0cd70d822dae1fa3a835e419ac18
Image:
nexus3.onap.org:10001/onap/org.onap.dcaegen2.deployments.tls-init-container:2.1.0
Image ID:
docker-pullable://nexus3.onap.org:10001/onap/org.onap.dcaegen2.deployments.tls-init-container@sha256:36934e5002cfa55a9df08e0fd2f621c843e5ef9bea24e9963ce680beccfcc060
Port: <none>
Host Port: <none>
State: Terminated
Reason: Completed
Exit Code: 0
Started: Tue, 29 Sep 2020 09:43:08 +0000
Finished: Tue, 29 Sep 2020 09:43:21 +0000
Ready: True
Restart Count: 0
Environment:
POD_IP: (v1:status.podIP)
Mounts:
/opt/app/osaaf from tls-info (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-klssz
(ro)
Containers:
dcae-ves-collector:
Container ID:
docker://19cd8f754b163e5842fc4398379049318932eb4d1433a07cc1bef8f7a5a2d963
Image:
nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.ves.vescollector:1.5.4
Image ID:
docker-pullable://nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.ves.vescollector@sha256:a8bb655c7132d9b517c52af44de9a47af820e8fba1588761047514cbf6a3fd84
Ports: 8080/TCP, 8443/TCP
Host Ports: 0/TCP, 0/TCP
State: Running
Started: Tue, 29 Sep 2020 09:43:24 +0000
Ready: True
Restart Count: 0
Readiness: http-get http://:8080/healthcheck delay=5s timeout=1s
period=15s #success=1 #failure=1
Environment:
DCAE_CA_CERTPATH: /opt/app/dcae-certificate//cacert.pem
CONSUL_HOST: consul-server.onap
CONFIG_BINDING_SERVICE: config-binding-service
CBS_CONFIG_URL:
https://config-binding-service:10443/service_component_all/dcae-ves-collector
POD_IP: (v1:status.podIP)
Mounts:
/opt/app/VESCollector/logs from component-log (rw)
/opt/app/dcae-certificate/ from tls-info (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-klssz
(ro)
filebeat:
Container ID:
docker://4aa9bc5b95ee30031ee98458beb4c80be8c6e2755cb41c12838d6f9934057490
Image: docker.elastic.co/beats/filebeat:5.5.0
Image ID:
docker-pullable://docker.elastic.co/beats/filebeat@sha256:fe7602b641ed8ee288f067f7b31ebde14644c4722d9f7960f176d621097a5942
Port: <none>
Host Port: <none>
State: Running
Started: Tue, 29 Sep 2020 09:43:25 +0000
Ready: True
Restart Count: 0
Environment:
POD_IP: (v1:status.podIP)
Mounts:
/usr/share/filebeat/data from filebeat-data (rw)
/usr/share/filebeat/filebeat.yml from filebeat-conf
(rw,path="filebeat.yml")
/var/log/onap/dcae-ves-collector from component-log (rw)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-klssz
(ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
component-log:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
filebeat-data:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
filebeat-conf:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: frank6-dcae-filebeat-configmap
Optional: false
tls-info:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
default-token-klssz:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-klssz
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning Unhealthy 11m (x8 over 3h34m) kubelet, f6demo-k8s-09 Readiness
probe failed: Get http://10.42.7.113:8080/healthcheck: net/http: request
canceled (Client.Timeout exceeded while awaiting headers)
