Hi Bharat, In my opinion, most of the CKS issues you have are caused by your network configuration.
Please share more details of your environments, as much as possible. -Wei On Thu, Feb 29, 2024 at 5:45 PM Bharat Bhushan Saini <bharat.sa...@kloudspot.com.invalid> wrote: > Hi All, > > > > Now the cluster goes in error state. Please refer logs as below > > > > 2024-02-29 13:25:05,774 ERROR [c.c.k.c.a.KubernetesClusterActionWorker] > (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d) > Failed to setup Kubernetes cluster : *kspot* in usable state as unable to > access control node VMs of the cluster > > 2024-02-29 13:25:11,900 INFO [c.c.k.c.a.KubernetesClusterActionWorker] > (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d) > Detached Kubernetes binaries from VM : *kspot*-control-18df4d40038 in the > Kubernetes cluster : *kspot* > > 2024-02-29 13:25:12,804 INFO [c.c.k.c.a.KubernetesClusterActionWorker] > (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d) > Detached Kubernetes binaries from VM : *kspot*-node-18df4d4562b in the > Kubernetes cluster : *kspot* > > 2024-02-29 13:25:12,806 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (API-Job-Executor-54:ctx-7e86c22d job-777) (logid:458f275d) Complete async > job-777, jobStatus: FAILED, resultCode: 530, result: > org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Failed > to setup Kubernetes cluster : *kspot* in usable state as unable to access > control node VMs of the cluster"} > > 2024-02-29 13:34:31,962 DEBUG [c.c.a.t.Request] > (RouterStatusMonitor-1:ctx-6890fa84) (logid:7daaca79) Seq > 10-2919458458442974958 > > > > > > Thanks and Regards, > > Bharat Saini > > > > [image: signature_3007469423] > > > > *From: *Bharat Bhushan Saini <bharat.sa...@kloudspot.com.INVALID> > *Date: *Thursday, 29 February 2024 at 5:09 PM > *To: *users@cloudstack.apache.org <users@cloudstack.apache.org> > *Subject: *Re: CKS with K8s Offering N/w > > EXTERNAL EMAIL: Please verify the sender email address before taking any > action, replying, clicking any link or opening any attachment. > > > > Hi Wei, > > > > I truncate the mysql database table of kubernetes_cluster. > > > > Now the cluster is stucked in the starting state. > > > > Thanks and Regards, > > Bharat Saini > > > > [image: signature_17144652] > > > > *From: *Wei ZHOU <ustcweiz...@gmail.com> > *Date: *Thursday, 29 February 2024 at 4:52 PM > *To: *users@cloudstack.apache.org <users@cloudstack.apache.org> > *Subject: *Re: CKS with K8s Offering N/w > > EXTERNAL EMAIL: Please verify the sender email address before taking any > action, replying, clicking any link or opening any attachment. > > > The endpoint is automatically set by cloudstack, if the CKS cluster is > created successfully. > > If the endpoint is empty, it means the CKS cluster is not setup well, you'd > better remove it if it is not in use. > > -Wei > > On Thu, Feb 29, 2024 at 12:17 PM Bharat Bhushan Saini > <bharat.sa...@kloudspot.com.invalid> wrote: > > > Hi Wei, > > > > > > > > Last record is empty but new one also having the same endpoint with alert > > condition. Can I delete first the new cluster then empty the table, > should > > it work? > > > > If it is then how we will manage multiple cluster! > > > > > > > > Thanks and Regards, > > > > Bharat Saini > > > > > > > > [image: signature_3652424534] > > > > > > > > *From: *Wei ZHOU <ustcweiz...@gmail.com> > > *Date: *Thursday, 29 February 2024 at 4:34 PM > > *To: *users@cloudstack.apache.org <users@cloudstack.apache.org> > > *Subject: *Re: CKS with K8s Offering N/w > > > > EXTERNAL EMAIL: Please verify the sender email address before taking any > > action, replying, clicking any link or opening any attachment. > > > > > > Yes, > > > > They are the Kubernetes API server endpoint of CKS clusters. > > > > Is the endpoint of the last record empty ? > > > > -Wei > > > > On Thu, Feb 29, 2024 at 11:58 AM Bharat Bhushan Saini > > <bharat.sa...@kloudspot.com.invalid> wrote: > > > > > Hi Wei, > > > > > > > > > > > > It show different IP instead of management > > > > > > mysql> select endpoint from kubernetes_cluster; > > > > > > +--------------------------+ > > > > > > | endpoint | > > > > > > +--------------------------+ > > > > > > | https://10.x.x.87:6443/ | > > > > > > | https://10.x.x.87:6443/ | > > > > > > | https://10.x.x.87:6443/ | > > > > > > | https://10.x.x.87:6443/ | > > > > > > | | > > > > > > +--------------------------+ > > > > > > > > > > > > > > > > > > > > > > > > Thanks and Regards, > > > > > > Bharat Saini > > > > > > > > > > > > [image: signature_3154659082] > > > > > > > > > > > > *From: *Wei ZHOU <ustcweiz...@gmail.com> > > > *Date: *Thursday, 29 February 2024 at 4:15 PM > > > *To: *users@cloudstack.apache.org <users@cloudstack.apache.org> > > > *Subject: *Re: CKS with K8s Offering N/w > > > > > > EXTERNAL EMAIL: Please verify the sender email address before taking > any > > > action, replying, clicking any link or opening any attachment. > > > > > > > > > It is not related to the endpoint.url in the global setting. > > > > > > The endpoint of the CKS cluster is invalid. You can check mysql by > > "select > > > endpoint from kubernetes_cluster;" > > > I guess your CKS cluster was not created successfully. > > > > > > -Wei > > > > > > > > > > > > On Thu, Feb 29, 2024 at 11:40 AM Bharat Bhushan Saini > > > <bharat.sa...@kloudspot.com.invalid> wrote: > > > > > > > Hi All, > > > > > > > > > > > > > > > > I started a cluster with Network offering by k8s. It shows API > endpoint > > > > error as below > > > > > > > > 2024-02-29 10:25:13,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > > > > (API-Job-Executor-38:ctx-f6f75d23 job-719) (logid:7e7e617f) Complete > > > async > > > > job-719, jobStatus: FAILED, resultCode: 530, result: > > > > > > > > > > org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Kubernetes > > > > cluster : *kspot* has invalid API endpoint. Can not verify if cluster > > is > > > > in ready state"} > > > > > > > > > > > > > > > > The endpoint.url was set as > > > > https://cloudstack.inte.example.com:8443/client/api > > > > > > > > > > > > > > > > Thanks and Regards, > > > > > > > > Bharat Saini > > > > > > > > > > > > > > > > [image: signature_2879974955] > > > > > > > > --------------------------- Disclaimer: > ------------------------------ > > > > This message and its contents are intended solely for the designated > > > > addressee and are proprietary to Kloudspot. The information in this > > email > > > > is meant exclusively for Kloudspot business use. Any use by > individuals > > > > other than the addressee constitutes misuse and an infringement of > > > > Kloudspot's proprietary rights. If you are not the intended > recipient, > > > > please return this email to the sender. Kloudspot cannot guarantee > the > > > > security or error-free transmission of e-mail communications. > > Information > > > > could be intercepted, corrupted, lost, destroyed, arrive late or > > > > incomplete, or contain viruses. Therefore, Kloudspot shall not be > > liable > > > > for any issues arising from the transmission of this email. > > > > > > > > > > --------------------------- Disclaimer: ------------------------------ > > > This message and its contents are intended solely for the designated > > > addressee and are proprietary to Kloudspot. The information in this > email > > > is meant exclusively for Kloudspot business use. Any use by individuals > > > other than the addressee constitutes misuse and an infringement of > > > Kloudspot's proprietary rights. If you are not the intended recipient, > > > please return this email to the sender. Kloudspot cannot guarantee the > > > security or error-free transmission of e-mail communications. > Information > > > could be intercepted, corrupted, lost, destroyed, arrive late or > > > incomplete, or contain viruses. Therefore, Kloudspot shall not be > liable > > > for any issues arising from the transmission of this email. > > > > > > > --------------------------- Disclaimer: ------------------------------ > > This message and its contents are intended solely for the designated > > addressee and are proprietary to Kloudspot. The information in this email > > is meant exclusively for Kloudspot business use. Any use by individuals > > other than the addressee constitutes misuse and an infringement of > > Kloudspot's proprietary rights. If you are not the intended recipient, > > please return this email to the sender. Kloudspot cannot guarantee the > > security or error-free transmission of e-mail communications. Information > > could be intercepted, corrupted, lost, destroyed, arrive late or > > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable > > for any issues arising from the transmission of this email. > > > > --------------------------- Disclaimer: ------------------------------ > This message and its contents are intended solely for the designated > addressee and are proprietary to Kloudspot. The information in this email > is meant exclusively for Kloudspot business use. Any use by individuals > other than the addressee constitutes misuse and an infringement of > Kloudspot's proprietary rights. If you are not the intended recipient, > please return this email to the sender. Kloudspot cannot guarantee the > security or error-free transmission of e-mail communications. Information > could be intercepted, corrupted, lost, destroyed, arrive late or > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable > for any issues arising from the transmission of this email. > > --------------------------- Disclaimer: ------------------------------ > This message and its contents are intended solely for the designated > addressee and are proprietary to Kloudspot. The information in this email > is meant exclusively for Kloudspot business use. Any use by individuals > other than the addressee constitutes misuse and an infringement of > Kloudspot's proprietary rights. If you are not the intended recipient, > please return this email to the sender. Kloudspot cannot guarantee the > security or error-free transmission of e-mail communications. Information > could be intercepted, corrupted, lost, destroyed, arrive late or > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable > for any issues arising from the transmission of this email. >