Hi Kiran,
Apologies but the images are not visible.
I am understanding the context that LB is not there outside as I am also
created the traefik deployment but it is goed in pending state due to this.
Kindly suggest the workaround by which the service (SVC) of cluster are
accessible from outside as the testing is going on which helps us to deploy on
a medium scale.
Thanks and Regards,
Bharat Saini
[signature_3699698153]
From: Kiran Chavala <kiran.chav...@shapeblue.com>
Date: Friday, 1 March 2024 at 12:59 PM
To: users@cloudstack.apache.org <users@cloudstack.apache.org>
Subject: Re: CKS with K8s Offering N/w
EXTERNAL EMAIL: Please verify the sender email address before taking any
action, replying, clicking any link or opening any attachment.
Hi Bharat
For shared networks is no Loadblancing service is not available if you look at
the the offering
The is the reason I believe containers are running on Cluster IP
[cid:image001.png@01DA6BD7.CF067AE0]
For isolated networks or the default Kubernetes network Offering there is
Loabalancing service available
[A screenshot of a computer Description automatically generated]
Regards
Kiran
From: Bharat Bhushan Saini <bharat.sa...@kloudspot.com.INVALID>
Date: Friday, 1 March 2024 at 11:38 AM
To: users@cloudstack.apache.org <users@cloudstack.apache.org>
Subject: Re: CKS with K8s Offering N/w
Hi Wei,
I deployed cloudstack 4.18.1 on ubuntu 22.04 LTS on a standalone server with
kvm,nfs consist.
I already tested some vm’s on the cloudstack on a shared network with untagged
vlan because what IP range I have that was bridged with the private n/w and
natting is enabled on that. On shared n/w I am able to access internet but in
isolated or L2 config it can’t.
As per your suggestion, I tried with create default k8s n/w and also create a
network which have the same config of default k8s n/w but I untag the vlan in
that n/w. Both was not working.
On shared n/w I a able to spawn the cluster and also able to login with key and
also deploy an application but the containers was running on the Cluster IP.
Thanks and Regards,
Bharat Saini
[signature_2926674288]
From: Wei ZHOU <ustcweiz...@gmail.com>
Date: Thursday, 29 February 2024 at 10:20 PM
To: users@cloudstack.apache.org <users@cloudstack.apache.org>
Subject: Re: CKS with K8s Offering N/w
EXTERNAL EMAIL: Please verify the sender email address before taking any
action, replying, clicking any link or opening any attachment.
Hi Bharat,
In my opinion, most of the CKS issues you have are caused by your network
configuration.
Please share more details of your environments, as much as possible.
-Wei
On Thu, Feb 29, 2024 at 5:45 PM Bharat Bhushan Saini
<bharat.sa...@kloudspot.com.invalid> wrote:
> Hi All,
>
>
>
> Now the cluster goes in error state. Please refer logs as below
>
>
>
> 2024-02-29 13:25:05,774 ERROR [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Failed to setup Kubernetes cluster : *kspot* in usable state as unable to
> access control node VMs of the cluster
>
> 2024-02-29 13:25:11,900 INFO [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Detached Kubernetes binaries from VM : *kspot*-control-18df4d40038 in the
> Kubernetes cluster : *kspot*
>
> 2024-02-29 13:25:12,804 INFO [c.c.k.c.a.KubernetesClusterActionWorker]
> (API-Job-Executor-54:ctx-7e86c22d job-777 ctx-5c1e1685) (logid:458f275d)
> Detached Kubernetes binaries from VM : *kspot*-node-18df4d4562b in the
> Kubernetes cluster : *kspot*
>
> 2024-02-29 13:25:12,806 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-54:ctx-7e86c22d job-777) (logid:458f275d) Complete async
> job-777, jobStatus: FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Failed
> to setup Kubernetes cluster : *kspot* in usable state as unable to access
> control node VMs of the cluster"}
>
> 2024-02-29 13:34:31,962 DEBUG [c.c.a.t.Request]
> (RouterStatusMonitor-1:ctx-6890fa84) (logid:7daaca79) Seq
> 10-2919458458442974958
>
>
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_3007469423]
>
>
>
> *From: *Bharat Bhushan Saini <bharat.sa...@kloudspot.com.INVALID>
> *Date: *Thursday, 29 February 2024 at 5:09 PM
> *To: *users@cloudstack.apache.org <users@cloudstack.apache.org>
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
>
> Hi Wei,
>
>
>
> I truncate the mysql database table of kubernetes_cluster.
>
>
>
> Now the cluster is stucked in the starting state.
>
>
>
> Thanks and Regards,
>
> Bharat Saini
>
>
>
> [image: signature_17144652]
>
>
>
> *From: *Wei ZHOU <ustcweiz...@gmail.com>
> *Date: *Thursday, 29 February 2024 at 4:52 PM
> *To: *users@cloudstack.apache.org <users@cloudstack.apache.org>
> *Subject: *Re: CKS with K8s Offering N/w
>
> EXTERNAL EMAIL: Please verify the sender email address before taking any
> action, replying, clicking any link or opening any attachment.
>
>
> The endpoint is automatically set by cloudstack, if the CKS cluster is
> created successfully.
>
> If the endpoint is empty, it means the CKS cluster is not setup well, you'd
> better remove it if it is not in use.
>
> -Wei
>
> On Thu, Feb 29, 2024 at 12:17 PM Bharat Bhushan Saini
> <bharat.sa...@kloudspot.com.invalid> wrote:
>
> > Hi Wei,
> >
> >
> >
> > Last record is empty but new one also having the same endpoint with alert
> > condition. Can I delete first the new cluster then empty the table,
> should
> > it work?
> >
> > If it is then how we will manage multiple cluster!
> >
> >
> >
> > Thanks and Regards,
> >
> > Bharat Saini
> >
> >
> >
> > [image: signature_3652424534]
> >
> >
> >
> > *From: *Wei ZHOU <ustcweiz...@gmail.com>
> > *Date: *Thursday, 29 February 2024 at 4:34 PM
> > *To: *users@cloudstack.apache.org <users@cloudstack.apache.org>
> > *Subject: *Re: CKS with K8s Offering N/w
> >
> > EXTERNAL EMAIL: Please verify the sender email address before taking any
> > action, replying, clicking any link or opening any attachment.
> >
> >
> > Yes,
> >
> > They are the Kubernetes API server endpoint of CKS clusters.
> >
> > Is the endpoint of the last record empty ?
> >
> > -Wei
> >
> > On Thu, Feb 29, 2024 at 11:58 AM Bharat Bhushan Saini
> > <bharat.sa...@kloudspot.com.invalid> wrote:
> >
> > > Hi Wei,
> > >
> > >
> > >
> > > It show different IP instead of management
> > >
> > > mysql> select endpoint from kubernetes_cluster;
> > >
> > > +--------------------------+
> > >
> > > | endpoint |
> > >
> > > +--------------------------+
> > >
> > > | https://10.x.x.87:6443/ |
> > >
> > > | https://10.x.x.87:6443/ |
> > >
> > > | https://10.x.x.87:6443/ |
> > >
> > > | https://10.x.x.87:6443/ |
> > >
> > > | |
> > >
> > > +--------------------------+
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Thanks and Regards,
> > >
> > > Bharat Saini
> > >
> > >
> > >
> > > [image: signature_3154659082]
> > >
> > >
> > >
> > > *From: *Wei ZHOU <ustcweiz...@gmail.com>
> > > *Date: *Thursday, 29 February 2024 at 4:15 PM
> > > *To: *users@cloudstack.apache.org <users@cloudstack.apache.org>
> > > *Subject: *Re: CKS with K8s Offering N/w
> > >
> > > EXTERNAL EMAIL: Please verify the sender email address before taking
> any
> > > action, replying, clicking any link or opening any attachment.
> > >
> > >
> > > It is not related to the endpoint.url in the global setting.
> > >
> > > The endpoint of the CKS cluster is invalid. You can check mysql by
> > "select
> > > endpoint from kubernetes_cluster;"
> > > I guess your CKS cluster was not created successfully.
> > >
> > > -Wei
> > >
> > >
> > >
> > > On Thu, Feb 29, 2024 at 11:40 AM Bharat Bhushan Saini
> > > <bharat.sa...@kloudspot.com.invalid> wrote:
> > >
> > > > Hi All,
> > > >
> > > >
> > > >
> > > > I started a cluster with Network offering by k8s. It shows API
> endpoint
> > > > error as below
> > > >
> > > > 2024-02-29 10:25:13,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > > > (API-Job-Executor-38:ctx-f6f75d23 job-719) (logid:7e7e617f) Complete
> > > async
> > > > job-719, jobStatus: FAILED, resultCode: 530, result:
> > > >
> > >
> >
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Kubernetes
> > > > cluster : *kspot* has invalid API endpoint. Can not verify if cluster
> > is
> > > > in ready state"}
> > > >
> > > >
> > > >
> > > > The endpoint.url was set as
> > > > https://cloudstack.inte.example.com:8443/client/api
> > > >
> > > >
> > > >
> > > > Thanks and Regards,
> > > >
> > > > Bharat Saini
> > > >
> > > >
> > > >
> > > > [image: signature_2879974955]
> > > >
> > > > --------------------------- Disclaimer:
> ------------------------------
> > > > This message and its contents are intended solely for the designated
> > > > addressee and are proprietary to Kloudspot. The information in this
> > email
> > > > is meant exclusively for Kloudspot business use. Any use by
> individuals
> > > > other than the addressee constitutes misuse and an infringement of
> > > > Kloudspot's proprietary rights. If you are not the intended
> recipient,
> > > > please return this email to the sender. Kloudspot cannot guarantee
> the
> > > > security or error-free transmission of e-mail communications.
> > Information
> > > > could be intercepted, corrupted, lost, destroyed, arrive late or
> > > > incomplete, or contain viruses. Therefore, Kloudspot shall not be
> > liable
> > > > for any issues arising from the transmission of this email.
> > > >
> > >
> > > --------------------------- Disclaimer: ------------------------------
> > > This message and its contents are intended solely for the designated
> > > addressee and are proprietary to Kloudspot. The information in this
> email
> > > is meant exclusively for Kloudspot business use. Any use by individuals
> > > other than the addressee constitutes misuse and an infringement of
> > > Kloudspot's proprietary rights. If you are not the intended recipient,
> > > please return this email to the sender. Kloudspot cannot guarantee the
> > > security or error-free transmission of e-mail communications.
> Information
> > > could be intercepted, corrupted, lost, destroyed, arrive late or
> > > incomplete, or contain viruses. Therefore, Kloudspot shall not be
> liable
> > > for any issues arising from the transmission of this email.
> > >
> >
> > --------------------------- Disclaimer: ------------------------------
> > This message and its contents are intended solely for the designated
> > addressee and are proprietary to Kloudspot. The information in this email
> > is meant exclusively for Kloudspot business use. Any use by individuals
> > other than the addressee constitutes misuse and an infringement of
> > Kloudspot's proprietary rights. If you are not the intended recipient,
> > please return this email to the sender. Kloudspot cannot guarantee the
> > security or error-free transmission of e-mail communications. Information
> > could be intercepted, corrupted, lost, destroyed, arrive late or
> > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> > for any issues arising from the transmission of this email.
> >
>
> --------------------------- Disclaimer: ------------------------------
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>
> --------------------------- Disclaimer: ------------------------------
> This message and its contents are intended solely for the designated
> addressee and are proprietary to Kloudspot. The information in this email
> is meant exclusively for Kloudspot business use. Any use by individuals
> other than the addressee constitutes misuse and an infringement of
> Kloudspot's proprietary rights. If you are not the intended recipient,
> please return this email to the sender. Kloudspot cannot guarantee the
> security or error-free transmission of e-mail communications. Information
> could be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. Therefore, Kloudspot shall not be liable
> for any issues arising from the transmission of this email.
>
--------------------------- Disclaimer: ------------------------------
This message and its contents are intended solely for the designated addressee
and are proprietary to Kloudspot. The information in this email is meant
exclusively for Kloudspot business use. Any use by individuals other than the
addressee constitutes misuse and an infringement of Kloudspot's proprietary
rights. If you are not the intended recipient, please return this email to the
sender. Kloudspot cannot guarantee the security or error-free transmission of
e-mail communications. Information could be intercepted, corrupted, lost,
destroyed, arrive late or incomplete, or contain viruses. Therefore, Kloudspot
shall not be liable for any issues arising from the transmission of this email.
--------------------------- Disclaimer: ------------------------------
This message and its contents are intended solely for the designated addressee
and are proprietary to Kloudspot. The information in this email is meant
exclusively for Kloudspot business use. Any use by individuals other than the
addressee constitutes misuse and an infringement of Kloudspot's proprietary
rights. If you are not the intended recipient, please return this email to the
sender. Kloudspot cannot guarantee the security or error-free transmission of
e-mail communications. Information could be intercepted, corrupted, lost,
destroyed, arrive late or incomplete, or contain viruses. Therefore, Kloudspot
shall not be liable for any issues arising from the transmission of this email.
