Hi, Some answers/question inline.
Alexis > On Jan 24, 2018, at 11:40 AM, HU, JUN NICOLAS <jh2...@att.com> wrote: > > Hi, > > We deployed an OOM amsterdam > <https://gerrit.onap.org/r/gitweb?p=oom.git;a=shortlog;h=refs/heads/amsterdam> > release. We installed all the containers a K8s cluster with 6 nodes hosts. > > [centos@server-k8s6nodes-kubernetes-master-host-7qcfy4 ~]$ kubectl get nodes > NAME STATUS AGE VERSION > server-k8s6nodes-kubernetes-master-host-7qcfy4 Ready 1d v1.7.4 > server-k8s6nodes-kubernetes-node-host-2sy3xz Ready 1d v1.7.4 > server-k8s6nodes-kubernetes-node-host-7rptcz Ready 1d v1.7.4 > server-k8s6nodes-kubernetes-node-host-8aaw03 Ready 1d v1.7.4 > server-k8s6nodes-kubernetes-node-host-b39rfm Ready 1d v1.7.4 > server-k8s6nodes-kubernetes-node-host-kvx3b8 Ready 1d v1.7.4 > server-k8s6nodes-kubernetes-node-host-w52ffi Ready 1d v1.7.4 > > Here is the running pods > > [centos@server-k8s6nodes-kubernetes-master-host-7qcfy4 ~]$ kubectl get pod > --all-namespaces > NAMESPACE NAME > READY STATUS RESTARTS AGE > kube-system etcd-server-k8s6nodes-kubernetes-master-host-7qcfy4 > 1/1 Running 2 1d > kube-system > kube-apiserver-server-k8s6nodes-kubernetes-master-host-7qcfy4 1/1 > Running 0 1d > kube-system > kube-controller-manager-server-k8s6nodes-kubernetes-master-host-7qcfy4 1/1 > Running 2 1d > kube-system kube-dns-2425271678-5724j > 3/3 Running 0 1d > kube-system kube-proxy-6lwp7 > 1/1 Running 0 1d > kube-system kube-proxy-bgvd6 > 1/1 Running 0 1d > kube-system kube-proxy-dtmfz > 1/1 Running 0 1d > kube-system kube-proxy-dtql9 > 1/1 Running 0 1d > kube-system kube-proxy-t1pjw > 1/1 Running 0 1d > kube-system kube-proxy-thjnr > 1/1 Running 0 1d > kube-system kube-proxy-w8rjb > 1/1 Running 0 1d > kube-system > kube-scheduler-server-k8s6nodes-kubernetes-master-host-7qcfy4 1/1 > Running 3 1d > kube-system tiller-deploy-3206783038-5ldb1 > 1/1 Running 0 1d > kube-system weave-net-178n1 > 2/2 Running 6 1d > kube-system weave-net-31nf1 > 2/2 Running 6 1d > kube-system weave-net-dl2qk > 2/2 Running 6 1d > kube-system weave-net-f88nv > 2/2 Running 6 1d > kube-system weave-net-fzs8t > 2/2 Running 6 1d > kube-system weave-net-lc965 > 2/2 Running 7 1d > kube-system weave-net-vhj9x > 2/2 Running 7 1d > onap-aaf aaf-1993711932-m4d07 > 0/1 Running 0 1d > onap-aaf aaf-cs-1310404376-ptm73 > 1/1 Running 0 1d > onap-aai aai-resources-2269342809-bd2gm > 2/2 Running 0 1d > onap-aai aai-service-749944520-1rt0l > 1/1 Running 0 1d > onap-aai aai-traversal-8423740-31htm > 2/2 Running 0 1d > onap-aai data-router-3434587794-pm2z0 > 1/1 Running 0 1d > onap-aai elasticsearch-622738319-k590c > 1/1 Running 0 1d > onap-aai hbase-1949550546-8f612 > 1/1 Running 0 1d > onap-aai model-loader-service-4144225433-tfl3c > 2/2 Running 0 1d > onap-aai search-data-service-3842430948-vd4b6 > 2/2 Running 0 1d > onap-aai sparky-be-4222608366-ff4zk > 2/2 Running 0 1d > onap-appc appc-1828810488-p47bv > 2/2 Running 0 1d > onap-appc appc-dbhost-2793739621-chd33 > 1/1 Running 0 1d > onap-appc appc-dgbuilder-2298093128-gwqs8 > 1/1 Running 0 1d > onap-clamp clamp-2211988013-sbr3m > 1/1 Running 0 1d > onap-clamp clamp-mariadb-1812977665-m1l07 > 1/1 Running 0 1d > onap-cli cli-595710742-889k2 > 1/1 Running 0 1d > onap-consul consul-agent-3312409084-r9s33 > 1/1 Running 1 1d > onap-consul consul-server-1173049560-2n6df > 1/1 Running 0 1d > onap-consul consul-server-1173049560-65z1r > 1/1 Running 0 1d > onap-consul consul-server-1173049560-wrfr2 > 1/1 Running 1 1d > onap-kube2msb kube2msb-registrator-3606611270-gnjnc > 1/1 Running 1 1d > onap-log elasticsearch-1942187295-x7wf9 > 1/1 Running 0 1d > onap-log kibana-3372627750-77j4x > 1/1 Running 0 1d > onap-log logstash-1708188010-b74xd > 1/1 Running 0 1d > onap-message-router dmaap-3126594942-xpmrt > 1/1 Running 0 1d > onap-message-router global-kafka-3848542622-p4ds0 > 1/1 Running 0 1d > onap-message-router zookeeper-624700062-r2w20 > 1/1 Running 0 1d > onap-msb msb-consul-3334785600-v26z1 > 1/1 Running 0 1d > onap-msb msb-discovery-196547432-fmvxp > 1/1 Running 0 1d > onap-msb msb-eag-1649257109-pcjqm > 1/1 Running 0 1d > onap-msb msb-iag-1033096170-shth3 > 1/1 Running 0 1d > onap-mso mariadb-829081257-n3b46 > 1/1 Running 0 1d > onap-mso mso-3784963895-25cd4 > 2/2 Running 0 1d > onap-multicloud framework-2273343137-q6ln7 > 1/1 Running 0 1d > onap-multicloud multicloud-ocata-1517639325-tctcn > 1/1 Running 0 1d > onap-multicloud multicloud-vio-4239509896-jhsxf > 1/1 Running 0 1d > onap-multicloud multicloud-windriver-3629763724-5wfcp > 1/1 Running 0 1d > onap-policy brmsgw-4149605335-pjhfn > 1/1 Running 0 22h > onap-policy drools-1061884943-xnj2k > 2/2 Running 0 22h > onap-policy mariadb-4208653871-g9bc7 > 1/1 Running 0 22h > onap-policy nexus-1730114603-bcqkv > 1/1 Running 0 22h > onap-policy pap-1693910617-q2kd9 > 2/2 Running 0 22h > onap-policy pdp-3450409118-gqt5n > 2/2 Running 0 22h > onap-portal portalapps-1783099045-1vnz6 > 2/2 Running 0 1d > onap-portal portaldb-1451233177-d7hgm > 1/1 Running 0 1d > onap-portal portalwidgets-2060058548-bfhnx > 1/1 Running 0 1d > onap-portal vnc-portal-1319334380-1tx4q > 1/1 Running 0 1d > onap-robot robot-2551980890-f97nq > 1/1 Running 0 1d > onap-sdc sdc-be-2336519847-6j70f > 2/2 Running 0 1d > onap-sdc sdc-cs-1151560586-dz29w > 1/1 Running 0 1d > onap-sdc sdc-es-3319302712-663gl > 1/1 Running 0 1d > onap-sdc sdc-fe-2862673798-2rdzp > 2/2 Running 0 1d > onap-sdc sdc-kb-1258596734-d5tkh > 1/1 Running 0 1d > onap-sdnc dmaap-listener-2388707432-w715q > 1/1 Running 0 1d > onap-sdnc sdnc-1395102659-9m0jb > 2/2 Running 0 1d > onap-sdnc sdnc-dbhost-3029711096-v9f38 > 1/1 Running 0 1d > onap-sdnc sdnc-dgbuilder-4267203648-91h9g > 1/1 Running 0 1d > onap-sdnc sdnc-portal-2558294154-bhs5c > 1/1 Running 0 1d > onap-sdnc ueb-listener-847561612-4qj1g > 1/1 Running 0 1d > onap-uui uui-4267149477-5mlhj > 1/1 Running 0 1d > onap-uui uui-server-3441797946-ckhcr > 1/1 Running 0 1d > onap-vfc vfc-catalog-840807183-55dpw > 1/1 Running 0 1d > onap-vfc vfc-emsdriver-2936953408-2sbjd > 1/1 Running 0 1d > onap-vfc vfc-gvnfmdriver-2866216209-918xj > 1/1 Running 0 1d > onap-vfc vfc-hwvnfmdriver-2588350680-x2fll > 1/1 Running 0 1d > onap-vfc vfc-jujudriver-406795794-rw8x9 > 1/1 Running 0 1d > onap-vfc vfc-nokiavnfmdriver-1760240499-w6q0r > 1/1 Running 0 1d > onap-vfc vfc-nslcm-3756650867-4vtxd > 1/1 Running 0 1d > onap-vfc vfc-resmgr-1409642779-9t9th > 1/1 Running 0 1d > onap-vfc vfc-vnflcm-3340104471-3l2mm > 1/1 Running 0 1d > onap-vfc vfc-vnfmgr-2823857741-qt2bm > 1/1 Running 0 1d > onap-vfc vfc-vnfres-1792029715-rhr5c > 1/1 Running 0 1d > onap-vfc vfc-workflow-3450325534-dr555 > 1/1 Running 0 1d > onap-vfc vfc-workflowengineactiviti-4110617986-wchjf > 1/1 Running 0 1d > onap-vfc vfc-ztesdncdriver-1452986549-tmm94 > 1/1 Running 0 1d > onap-vfc vfc-ztevmanagerdriver-2080553526-rctm0 > 1/1 Running 0 1d > onap-vid vid-mariadb-3318685446-g0c2d > 1/1 Running 0 1d > onap-vid vid-server-3026751708-dtnl6 > 2/2 Running 0 1d > onap-vnfsdk postgres-436836560-xggm4 > 1/1 Running 0 1d > onap-vnfsdk refrepo-1924147637-p0x09 > 1/1 Running 0 1d > [centos@server-k8s6nodes-kubernetes-master-host-7qcfy4 ~]$ kubectl get pod > --all-namespaces | grep 0/ > onap-aaf aaf-1993711932-m4d07 > 0/1 Running 0 1d > > > Here is the MSB web UI. > From the list, not all the services were registered by MSB. It fails robot > health checking. AdT: Can you paste the robot logs. What the failure there. > <image003.jpg> > > Here is the log for Kube2msb > > Log: > E0123 21:39:40.341054 7 reflector.go:216] kube2msb/kube2msb.go:214: > Failed to list *api.Pod: the server does not allow access to the requested > resource (get pods) > E0123 21:39:40.341321 7 reflector.go:216] kube2msb/kube2msb.go:148: > Failed to list *api.Service: the server does not allow access to the > requested resource (get services) > E0123 21:39:41.343272 7 reflector.go:216] kube2msb/kube2msb.go:148: > Failed to list *api.Service: the server does not allow access to the > requested resource (get services) > E0123 21:39:41.343324 7 reflector.go:216] kube2msb/kube2msb.go:214: > Failed to list *api.Pod: the server does not allow access to the requested > resource (get pods) > AdT: This usually mean the pod doesn’t have access to the resources, probably due to a mis-configured token. Have you updated the token once the deployment was already done? > We need help to understand the root cause of this issue. > > > Thanks > Jun Hu > SR MEMBER OF TECHNICAL STAFF > <http://webphone.att.com/cgi-bin/orglist.pl?id=jh245g&org=02222869&level=2&output=html> > AT&T > Email : jun.nicolas...@att.com <mailto:jun.nicolas...@att.com> > Office : +1 (732) 420-0743 > 200 S Laurel Ave, Rm D5-3B34 > Middletown, NJ 08873 > USA > > _______________________________________________ > onap-discuss mailing list > onap-discuss@lists.onap.org <mailto:onap-discuss@lists.onap.org> > https://lists.onap.org/mailman/listinfo/onap-discuss > <https://lists.onap.org/mailman/listinfo/onap-discuss>
_______________________________________________ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
