Are SDC and DMaaP MR passing health check ? SDC in partciular is BE reporting UP ?
From: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> On Behalf Of Lotoski, John Sent: Monday, January 21, 2019 12:31 AM To: onap-discuss@lists.onap.org Subject: [onap-discuss] Sdnc Ueb Listener crashloopbackoff Hi all, On an install using the latest git branch clone of Casablanca, the sdnc component has pod errors on the ueb-listener. I don't see anything in the pod logs and the pod describe doesn't really explain much. Has anyone seen this? onap-sdnc-controller-blueprints-db-0 1/1 Running 0 15m 172.16.37.193 ip-172-16-32-85.ec2.internal <none> onap-sdnc-nengdb-0 1/1 Running 0 15m 172.16.46.227 ip-172-16-32-85.ec2.internal <none> onap-sdnc-network-name-gen-9f5f44b69-dcfzj 1/1 Running 0 15m 172.16.40.105 ip-172-16-32-85.ec2.internal <none> onap-sdnc-sdnc-0 2/2 Running 0 15m 172.16.27.216 ip-172-16-21-150.ec2.internal <none> onap-sdnc-sdnc-ansible-server-857cc5f6fc-24mjx 1/1 Running 0 15m 172.16.46.0 ip-172-16-32-85.ec2.internal <none> onap-sdnc-sdnc-db-0 2/2 Running 0 15m 172.16.33.200 ip-172-16-32-85.ec2.internal <none> onap-sdnc-sdnc-dgbuilder-56c796c68d-ht6tn 1/1 Running 0 15m 172.16.46.196 ip-172-16-32-85.ec2.internal <none> onap-sdnc-sdnc-dmaap-listener-67d869f578-8fxj2 1/1 Running 0 15m 172.16.25.187 ip-172-16-21-150.ec2.internal <none> onap-sdnc-sdnc-portal-5fc5497489-nlp22 1/1 Running 0 15m 172.16.33.255 ip-172-16-32-85.ec2.internal <none> onap-sdnc-sdnc-ueb-listener-685df89896-fcnd2 0/1 CrashLoopBackOff 7 15m 172.16.38.233 ip-172-16-32-85.ec2.internal <none> $ kubectl -n onap logs -f onap-sdnc-sdnc-ueb-listener-685df89896-fcnd2 $ $ kubectl -n onap describe pod onap-sdnc-sdnc-ueb-listener-685df89896-fcnd2 Name: onap-sdnc-sdnc-ueb-listener-685df89896-fcnd2 Namespace: onap Priority: 0 PriorityClassName: <none> Node: ip-172-16-32-85.ec2.internal/172.16.32.85 Start Time: Mon, 21 Jan 2019 02:54:45 +0000 Labels: app=sdnc-ueb-listener pod-template-hash=2418945452 release=onap-sdnc Annotations: <none> Status: Running IP: 172.16.38.233 Controlled By: ReplicaSet/onap-sdnc-sdnc-ueb-listener-685df89896 Init Containers: sdnc-ueb-listener-readiness: Container ID: docker://689a4c34766d941426714beb7baf75357d27d59f9e30920dbd1bac5e9c37602c Image: oomk8s/readiness-check:2.0.0 Image ID: docker-pullable://oomk8s/readiness-check@sha256:7daa08b81954360a1111d03364febcb3dcfeb723bcc12ce3eb3ed3e53f2323ed Port: <none> Host Port: <none> Command: /root/ready.py Args: --container-name sdnc-db --container-name sdnc --container-name sdc-be --container-name message-router State: Terminated Reason: Completed Exit Code: 0 Started: Mon, 21 Jan 2019 02:54:59 +0000 Finished: Mon, 21 Jan 2019 02:56:24 +0000 Ready: True Restart Count: 0 Environment: NAMESPACE: onap (v1:metadata.namespace) Mounts: /var/run/secrets/kubernetes.io/serviceaccount from default-token-dmnsz (ro) Containers: sdnc-ueb-listener: [16/1767] Container ID: docker://b937a8f3d058d80d63943b2062f18928cba52f7f7f634a665d1d83dd53111518 Image: nexus3.onap.org:10001/onap/sdnc-ueb-listener-image:1.4.4 Image ID: docker-pullable://nexus3.onap.org:10001/onap/sdnc-ueb-listener-image@sha256:ce1c0c0ed26583089e64381cecf3a404e3b90753ac2a8cacdcdbb32dd1851de9 Port: <none> Host Port: <none> Command: /opt/onap/sdnc/ueb-listener/bin/start-ueb-listener.sh State: Waiting Reason: CrashLoopBackOff Last State: Terminated Reason: Completed Exit Code: 0 Started: Mon, 21 Jan 2019 03:07:54 +0000 Finished: Mon, 21 Jan 2019 03:07:55 +0000 Ready: False Restart Count: 7 Environment: PROPERTY_DIR: /opt/onap/sdnc/data/properties SDNC_CONFIG_DIR: /opt/onap/sdnc/data/properties Mounts: /etc/localtime from localtime (ro) /opt/onap/sdnc/data/properties/dblib.properties from properties (rw) /opt/onap/sdnc/data/properties/ueb-listener.properties from properties (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-dmnsz (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: localtime: Type: HostPath (bare host directory volume) Path: /etc/localtime HostPathType: properties: Type: ConfigMap (a volume populated by a ConfigMap) Name: onap-sdnc-sdnc-ueb-listener Optional: false default-token-dmnsz: Type: Secret (a volume populated by a Secret) SecretName: default-token-dmnsz Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 17m default-scheduler Successfully assigned onap/onap-sdnc-sdnc-ueb-listener-685df89896-fcnd2 to ip-172-16-32-85.ec2.internal Normal Pulled 17m kubelet, ip-172-16-32-85.ec2.internal Container image "oomk8s/readiness-check:2.0.0" already present on machine Normal Created 17m kubelet, ip-172-16-32-85.ec2.internal Created container Normal Started 17m kubelet, ip-172-16-32-85.ec2.internal Started container Normal Created 13m (x5 over 15m) kubelet, ip-172-16-32-85.ec2.internal Created container Normal Started 13m (x5 over 15m) kubelet, ip-172-16-32-85.ec2.internal Started container Normal Pulled 12m (x6 over 15m) kubelet, ip-172-16-32-85.ec2.internal Container image "nexus3.onap.org:10001/onap/sdnc-ueb-listener-image:1.4.4" already present on machine Warning BackOff 2m (x46 over 14m) kubelet, ip-172-16-32-85.ec2.internal Back-off restarting failed container Thanks, John -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#15048): https://lists.onap.org/g/onap-discuss/message/15048 Mute This Topic: https://lists.onap.org/mt/29355549/21656 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-