Hi Brian, here my situation: root@control-plane-1:~# kubectl get pods -n onap | grep dev-maria dev-mariadb-galera-mariadb-galera-0 0/1 CrashLoopBackOff 26 100m dev-mariadb-galera-mariadb-galera-1 0/1 CrashLoopBackOff 25 81m
root@control-plane-1:~# kubectl -n onap describe pods dev-mariadb-galera-mariadb-galera-0 Name: dev-mariadb-galera-mariadb-galera-0 Namespace: onap Priority: 0 PriorityClassName: <none> Node: k8s-5/192.168.2.8 Start Time: Wed, 29 May 2019 10:28:02 +0000 Labels: app=dev-mariadb-galera-mariadb-galera chart=mariadb-galera-4.0.0 controller-revision-hash=dev-mariadb-galera-mariadb-galera-74cd6dcf6b heritage=Tiller release=dev-mariadb-galera statefulset.kubernetes.io/pod-name=dev-mariadb-galera-mariadb-galera-0 Annotations: cni.projectcalico.org/podIP: 10.42.13.44/32 pod.alpha.kubernetes.io/initialized: true Status: Running IP: 10.42.13.44 Controlled By: StatefulSet/dev-mariadb-galera-mariadb-galera Init Containers: mariadb-galera-prepare: Container ID: docker://9331ce51f2e58662351ad27ecce94e41614eee1180cdb06ddd1f2945d8d90227 Image: nexus3.onap.org:10001/busybox Image ID: docker-pullable://busybox@sha256:4b6ad3a68d34da29bf7c8ccb5d355ba8b4babcad1f99798204e7abb43e54ee3d Port: <none> Host Port: <none> Command: sh -c chown -R 27:27 /var/lib/mysql State: Terminated Reason: Completed Exit Code: 0 Started: Wed, 29 May 2019 10:28:06 +0000 Finished: Wed, 29 May 2019 10:28:06 +0000 Ready: True Restart Count: 0 Environment: <none> Mounts: /var/lib/mysql from dev-mariadb-galera-mariadb-galera-data (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-bh6p2 (ro) Containers: mariadb-galera: Container ID: docker://a0fb350ac85f318abe0b0ee466250d1e1703e776a02e2586e0089ef3f33692cc Image: nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos:v002 Image ID: docker-pullable://nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos@sha256:fbcb842f30065ae94532cb1af9bb03cc6e2acaaf896d87d0ec38da7dd09a3dde Ports: 3306/TCP, 4444/TCP, 4567/TCP, 4568/TCP Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP State: Waiting Reason: CrashLoopBackOff Last State: Terminated Reason: Error Exit Code: 1 Started: Wed, 29 May 2019 10:35:44 +0000 Finished: Wed, 29 May 2019 10:36:19 +0000 Ready: False Restart Count: 6 Liveness: exec [mysqladmin ping] delay=60s timeout=5s period=10s #success=1 #failure=3 Readiness: exec [/usr/share/container-scripts/mysql/readiness-probe.sh] delay=60s timeout=5s period=10s #success=1 #failure=3 Environment: POD_NAMESPACE: onap (v1:metadata.namespace) MYSQL_USER: my-user MYSQL_PASSWORD: <set to the key 'user-password' in secret 'dev-mariadb-galera-mariadb-galera'> Optional: false MYSQL_DATABASE: my-database MYSQL_ROOT_PASSWORD: <set to the key 'db-root-password' in secret 'dev-mariadb-galera-mariadb-galera'> Optional: false Mounts: /etc/localtime from localtime (ro) /var/lib/mysql from dev-mariadb-galera-mariadb-galera-data (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-bh6p2 (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: dev-mariadb-galera-mariadb-galera-data: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: dev-mariadb-galera-mariadb-galera-data-dev-mariadb-galera-mariadb-galera-0 ReadOnly: false localtime: Type: HostPath (bare host directory volume) Path: /etc/localtime HostPathType: default-token-bh6p2: Type: Secret (a volume populated by a Secret) SecretName: default-token-bh6p2 Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Pulling 11m kubelet, k8s-5 pulling image "nexus3.onap.org:10001/busybox" Normal Created 11m kubelet, k8s-5 Created container Normal Pulled 11m kubelet, k8s-5 Successfully pulled image "nexus3.onap.org:10001/busybox" Normal Started 11m kubelet, k8s-5 Started container Warning FailedScheduling 11m (x2 over 11m) default-scheduler pod has unbound immediate PersistentVolumeClaims (repeated 12 times) Normal Scheduled 11m default-scheduler Successfully assigned onap/dev-mariadb-galera-mariadb-galera-0 to k8s-5 Warning Unhealthy 10m (x3 over 10m) kubelet, k8s-5 Liveness probe failed: mysqladmin: connect to server at 'localhost' failed error: 'Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2 "No such file or directory")' Check that mysqld is running and that the socket: '/var/lib/mysql/mysql.sock' exists! Warning Unhealthy 9m58s (x3 over 10m) kubelet, k8s-5 Readiness probe failed: ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2 "No such file or directory") Normal Killing 9m32s kubelet, k8s-5 Killing container with id docker://mariadb-galera:Container failed liveness probe.. Container will be killed and recreated. Normal Pulling 9m16s (x3 over 11m) kubelet, k8s-5 pulling image "nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos:v002" Normal Started 9m14s (x3 over 11m) kubelet, k8s-5 Started container Normal Created 9m14s (x3 over 11m) kubelet, k8s-5 Created container Normal Pulled 9m14s (x3 over 11m) kubelet, k8s-5 Successfully pulled image "nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos:v002" Warning BackOff 95s (x25 over 8m38s) kubelet, k8s-5 Back-off restarting failed container Any workaround to solve this issue? Aniello Paolo Malinconico -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#17319): https://lists.onap.org/g/onap-discuss/message/17319 Mute This Topic: https://lists.onap.org/mt/27737637/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
