Hello friends, After deploying the Casablanca from local repository server, most of the modules has deployed successfully except below:
* dmaap needs to create user manually on database. * SO-module pods become completely running by setting password to mariadb and executing scripts. Here are the existing issues seems to need some fixes: * dev-appc-appc-db-1 : ubuntu@kub1:~/oom/kubernetes/sdnc/sdnc-prom$ kubectl describe pod dev-appc-appc-db-1 -n onap Name: dev-appc-appc-db-1 Namespace: onap Node: kub2/ Start Time: Tue, 08 Jan 2019 07:17:47 +0000 Labels: app=dev-appc-appc-db controller-revision-hash=dev-appc-appc-db-589fb9c8c9 statefulset.kubernetes.io/pod-name=dev-appc-appc-db-1 Annotations: pod.alpha.kubernetes.io/initialized=true Status: Running IP: 10.42.184.214 Controlled By: StatefulSet/dev-appc-appc-db Init Containers: mariadb-galera-prepare: Container ID: docker://484237ae0fd95d27fbdcd8d4692fc72598908df2436914567bd7d7bb8d9c1227 Image: registry:5000/busybox Image ID: docker-pullable://busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0 Port: <none> Host Port: <none> Command: sh -c chown -R 27:27 /var/lib/mysql State: Terminated Reason: Completed Exit Code: 0 Started: Tue, 08 Jan 2019 07:18:26 +0000 Finished: Tue, 08 Jan 2019 07:18:37 +0000 Ready: True Restart Count: 0 Environment: <none> Mounts: /var/lib/mysql from dev-appc-appc-db-data (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-q79bx (ro) Containers: appc-db: Container ID: docker://3ca60aec2fd015080e91722a085b68476e35a0ae4aa8f22412ffbfc3813a5d18 Image: registry:5000/adfinissygroup/k8s-mariadb-galera-centos:v002 Image ID: docker-pullable://nexus3.onap.org:10001/adfinissygroup/k8s-mariadb-galera-centos@sha256:fbcb842f30065ae94532cb1af9bb03cc6e2acaaf896d87d0ec38da7dd09a3dde Ports: 3306/TCP, 4444/TCP, 4567/TCP, 4568/TCP Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP State: Waiting Reason: CrashLoopBackOff Last State: Terminated Reason: Error Exit Code: 1 Started: Tue, 08 Jan 2019 08:49:37 +0000 Finished: Tue, 08 Jan 2019 08:49:59 +0000 Ready: False Restart Count: 27 Liveness: exec [mysqladmin ping] delay=30s timeout=5s period=10s #success=1 #failure=3 Readiness: exec [/usr/share/container-scripts/mysql/readiness-probe.sh] delay=15s timeout=1s period=10s #success=1 #failure=3 Environment: POD_NAMESPACE: onap (v1:metadata.namespace) MYSQL_USER: my-user MYSQL_PASSWORD: <set to the key 'user-password' in secret 'dev-appc-appc-db'> Optional: false MYSQL_DATABASE: my-database MYSQL_ROOT_PASSWORD: <set to the key 'db-root-password' in secret 'dev-appc-appc-db'> Optional: false Mounts: /etc/localtime from localtime (ro) /var/lib/mysql from dev-appc-appc-db-data (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-q79bx (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: dev-appc-appc-db-data: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: dev-appc-appc-db-data-dev-appc-appc-db-1 ReadOnly: false localtime: Type: HostPath (bare host directory volume) Path: /etc/localtime HostPathType: default-token-q79bx: Type: Secret (a volume populated by a Secret) SecretName: default-token-q79bx Optional: false QoS Class: BestEffort Node-Selectors: <none> Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s node.kubernetes.io/unreachable:NoExecute for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Pulled 18m (x23 over 1h) kubelet, kub2 Container image "registry:5000/adfinissygroup/k8s-mariadb-galera-centos:v002" already present on machine Warning BackOff 8m (x214 over 1h) kubelet, kub2 Back-off restarting failed container Warning Unhealthy 3m (x139 over 1h) kubelet, kub2 Readiness probe failed: ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2 "No such file or directory") ubuntu@kub1:~/oom/kubernetes/sdnc/sdnc-prom$ kubectl logs -f dev-appc-appc-db-1 -n onap + CONTAINER_SCRIPTS_DIR=/usr/share/container-scripts/mysql + EXTRA_DEFAULTS_FILE=/etc/my.cnf.d/galera.cnf + '[' -z onap ']' + echo 'Galera: Finding peers' Galera: Finding peers ++ hostname -f ++ cut -d. -f2 Using service name: appc-dbhost + K8S_SVC_NAME=appc-dbhost + echo 'Using service name: appc-dbhost' + cp /usr/share/container-scripts/mysql/galera.cnf /etc/my.cnf.d/galera.cnf + /usr/bin/peer-finder -on-start=/usr/share/container-scripts/mysql/configure-galera.sh -service=appc-dbhost 2019/01/08 08:49:37 Peer list updated was [] now [dev-appc-appc-db-0.appc-dbhost.onap.svc.cluster.local dev-appc-appc-db-1.appc-dbhost.onap.svc.cluster.local] 2019/01/08 08:49:37 execing: /usr/share/container-scripts/mysql/configure-galera.sh with stdin: dev-appc-appc-db-0.appc-dbhost.onap.svc.cluster.local dev-appc-appc-db-1.appc-dbhost.onap.svc.cluster.local 2019/01/08 08:49:37 2019/01/08 08:49:38 Peer finder exiting + '[' '!' -d /var/lib/mysql/mysql ']' + echo 'Configure first time mysql' + /usr/share/container-scripts/mysql/configure-mysql.sh Configure first time mysql + echo 'Running mysql_install_db ...' + mysql_install_db --datadir=/var/lib/mysql Running mysql_install_db ... Installing MariaDB/MySQL system tables in '/var/lib/mysql' ... 2019-01-08 8:49:39 139922462640384 [Note] /usr/sbin/mysqld (mysqld 10.1.24-MariaDB) starting as process 50 ... 2019-01-08 8:49:39 139922462640384 [Note] WSREP: Read nil XID from storage engines, skipping position init 2019-01-08 8:49:39 139922462640384 [Note] WSREP: wsrep_load(): loading provider library 'none' 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB. 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: The InnoDB memory heap is disabled 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: Using Linux native AIO 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: Using SSE crc32 instructions 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: Completed initialization of buffer pool 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: The first specified data file ./ibdata1 did not exist: a new database to be created! 2019-01-08 8:49:40 139922462640384 [Note] InnoDB: Setting file ./ibdata1 size to 12 MB 2019-01-08 8:49:42 139922462640384 [Note] InnoDB: Setting log file ./ib_logfile101 size to 48 MB 2019-01-08 8:49:46 139922462640384 [Note] InnoDB: Setting log file ./ib_logfile1 size to 48 MB 2019-01-08 8:49:52 139922462640384 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 2019-01-08 8:49:52 139922462640384 [Warning] InnoDB: New log files created, LSN=45883 2019-01-08 8:49:52 139922462640384 [Note] InnoDB: Doublewrite buffer not found: creating new 2019-01-08 8:49:53 139922462640384 [Note] InnoDB: Doublewrite buffer created 2019-01-08 8:49:53 139922462640384 [Note] InnoDB: 128 rollback segment(s) are active. 2019-01-08 8:49:53 139922462640384 [Warning] InnoDB: Creating foreign key constraint system tables. 2019-01-08 8:49:53 139922462640384 [Note] InnoDB: Foreign key constraint system tables created 2019-01-08 8:49:53 139922462640384 [Note] InnoDB: Creating tablespace and datafile system tables. 2019-01-08 8:49:53 139922462640384 [Note] InnoDB: Tablespace and datafile system tables created. 2019-01-08 8:49:53 139922462640384 [Note] InnoDB: Waiting for purge to start 2019-01-08 8:49:53 139922462640384 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.36-82.0 started; log sequence number 0 2019-01-08 8:49:55 139921675253504 [Note] InnoDB: Dumping buffer pool(s) not yet started 2019-01-08 8:49:55 139922462640384 [Note] Recovering after a crash using tc.log 2019-01-08 8:49:55 139922462640384 [ERROR] Bad magic header in tc log 2019-01-08 8:49:55 139922462640384 [ERROR] Crash recovery failed. Either correct the problem (if it's, for example, out of memory error) and restart, or delete tc log and start mysqld with --tc-heuristic-recover={commit|rollback} 2019-01-08 8:49:55 139922462640384 [ERROR] Can't init tc log 2019-01-08 8:49:55 139922462640384 [ERROR] Aborting -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#14843): https://lists.onap.org/g/onap-discuss/message/14843 Mute This Topic: https://lists.onap.org/mt/28873133/21656 Mute #so: https://lists.onap.org/mk?hashtag=so&subid=2740164 Mute #casablanca: https://lists.onap.org/mk?hashtag=casablanca&subid=2740164 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
