Hello Bharat, Can you try to install plugin manually and see if that works or not.
Vivek Kumar Sr. Manager - Cloud & DevOps TechOps | Indiqus Technologies vivek.ku...@indiqus.com <mailto:vivek.ku...@indiqus.com> www.indiqus.com <https://www.indiqus.com/> > On 23-Feb-2024, at 11:16 AM, Bharat Bhushan Saini > <bharat.sa...@kloudspot.com.INVALID> wrote: > > Hi Wei/Vivek/Kiran, > > Kindly lookout in this. > > Thanks and Regards, > Bharat Saini > > > > From: Bharat Bhushan Saini <bharat.sa...@kloudspot.com.INVALID > <mailto:bharat.sa...@kloudspot.com.INVALID>> > Date: Friday, 23 February 2024 at 12:56 AM > To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> > <users@cloudstack.apache.org <mailto:users@cloudstack.apache.org>> > Subject: Re: CKS Storage Provisioner Info > > EXTERNAL EMAIL: Please verify the sender email address before taking any > action, replying, clicking any link or opening any attachment. > > Hi Vivek, > > I deployed cloudstack with version 4.18.1. > I think it should be present in this version. > > Thanks and Regards, > Bharat Saini > > > > From: Vivek Kumar <vivek.ku...@indiqus.com.INVALID > <mailto:vivek.ku...@indiqus.com.INVALID>> > Date: Friday, 23 February 2024 at 12:48 AM > To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> > <users@cloudstack.apache.org <mailto:users@cloudstack.apache.org>> > Subject: Re: CKS Storage Provisioner Info > > EXTERNAL EMAIL: Please verify the sender email address before taking any > action, replying, clicking any link or opening any attachment. > > > Hello Bharat, > > Then you will have to deploy the cloudstack-kubernetes-provider, however > after 4.16, it’s automatically deployed, Follow the instruction in the link > -https://github.com/apache/cloudstack-kubernetes-provider > > > 1- Create a file called - cloud-config and put the below information - ( you > can create an user under your account and provide it’s apikey and secret key ) > > > [Global] > api-url = <CloudStack API URL> > api-key = <CloudStack API Key> > secret-key = <CloudStack API Secret> > > > 2- kubectl -n kube-system create secret generic cloudstack-secret > --from-file=cloud-config > 3- then deploy the controller - > > You can then use the provided example deployment.yaml > <https://github.com/apache/cloudstack-kubernetes-provider/blob/main/deployment.yaml> > to deploy the controller: > > kubectl apply -f deployment.yaml > > > > > Vivek Kumar > Sr. Manager - Cloud & DevOps > TechOps | Indiqus Technologies > > vivek.ku...@indiqus.com <mailto:vivek.ku...@indiqus.com> > <mailto:vivek.ku...@indiqus.com> > www.indiqus.com <http://www.indiqus.com/> <https://www.indiqus.com/> > > > > > > On 23-Feb-2024, at 12:08 AM, Bharat Bhushan Saini > > <bharat.sa...@kloudspot.com.INVALID > > <mailto:bharat.sa...@kloudspot.com.INVALID>> wrote: > > > > Hi Vivek, > > > > I am glad and thankful to you for sharing the information, for the > > configuration of CSI driver. > > > > But I didn’t have cloudstack-secret in my cluster, sharing the details below > > > > cloud@Kspot-App-control-18dd041902a:~$ kubectl get secret cloudstack-secret > > -n kube-system > > Error from server (NotFound): secrets "cloudstack-secret" not found > > cloud@Kspot-App-control-18dd041902a:~$ kubectl get secret -A -n kube-system > > NAMESPACE NAME TYPE > > DATA AGE > > kloudspot dockerregistrykey > > kubernetes.io/dockerconfigjson > > <http://kubernetes.io/dockerconfigjson><http://kubernetes.io/dockerconfigjson> > > 1 8h > > kube-system bootstrap-token-cb0b7f > > bootstrap.kubernetes.io/token > > <http://bootstrap.kubernetes.io/token><http://bootstrap.kubernetes.io/token> > > 6 8h > > kubernetes-dashboard kubernetes-dashboard-certs Opaque > > 0 8h > > kubernetes-dashboard kubernetes-dashboard-csrf Opaque > > 1 8h > > kubernetes-dashboard kubernetes-dashboard-key-holder Opaque > > 2 8h > > kubernetes-dashboard kubernetes-dashboard-token > > kubernetes.io/service-account-token > > <http://kubernetes.io/service-account-token> > > <http://kubernetes.io/service-account-token> 3 8h > > cloud@Kspot-App-control-18dd041902a:~$ > > > > I am using v1.28.4 k8s version ISO for the cluster, storage offering and > > network is in shared mode and using 1 node cluster without HA. > > > > Thanks and Regards, > > Bharat Saini > > > > > > > > From: Vivek Kumar <vivek.ku...@indiqus.com.INVALID > > <mailto:vivek.ku...@indiqus.com.INVALID><mailto:vivek.ku...@indiqus.com.INVALID>> > > Date: Thursday, 22 February 2024 at 11:39 PM > > To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> > > <mailto:users@cloudstack.apache.org> <users@cloudstack.apache.org > > <mailto:users@cloudstack.apache.org> <mailto:users@cloudstack.apache.org>> > > Subject: Re: CKS Storage Provisioner Info > > > > EXTERNAL EMAIL: Please verify the sender email address before taking any > > action, replying, clicking any link or opening any attachment. > > > > > > Hello Bharat, > > > > 1- When you deploy a cluster, an additional user is created under your > > cloudstack account - i.e <account_name>-kubeadmin, and apikey and secret > > key of this kubeadmin user is pushed to the cluster. > > > > This you can find - > > > > root@18dc14302a2:~# kubectl get secret cloudstack-secret -n kube-system > > NAME TYPE DATA AGE > > cloudstack-secret Opaque 1 3d5h > > > > To check the more details for this secret - > > > > root@18dc14302a2:~# kubectl get secret cloudstack-secret -n kube-system -o > > jsonpath='{.data.*}' | base64 -d > > [Global] > > api-url = http://172.27.2.53:8080/client/api > > api-key = > > ex0HfJJt7YQES4n5dsD3AEL-gr0n__JbfRvfK6cyUi5dbdPx7hyOckJ_enInYOyRewI0IR772KyNY8Sjh0TOdg > > secret-key = > > IEHR45EK8GHkNo1G5t7eZSw5MARfZcYUvYXR1mR_vn2vv3b_-nQYFt_A_xZWRc4udtPQPKWjWW8kvTnSccAglA > > > > > > Now, you can see the API URL, so this URL endpoint must be reachable from > > your cluster in order to provision PVC. This URL you can put in the global > > setting - (endpoint.url) > > > > So I am assuming this endpoint URL is reachable from your cluster - you > > don’t need to define anything in the cloud-config and secret - because > > secret is already created and pushed from cloudstack once you deploy the > > cluster. ( From above steps you can verify ). > > > > 2- Deploy the CSI driver - as mentioned in the Link - > > > > kubectl apply -f > > https://github.com/apalia/cloudstack-csi-driver/releases/latest/download/manifest.yaml > > > > > > 3- Now create the storage class - as mentioned in the Link as example > > <https://github.com/apalia/cloudstack-csi-driver/blob/master/examples/k8s/0-storageclass.yaml> > > > > > > Create a file i.e storage-class.yml and paste below information - ( Please > > mention the disk offering ID, it has to be a CUSTOM ) > > > > apiVersion: storage.k8s.io/v1 <http://storage.k8s.io/v1> > > <http://storage.k8s.io/v1> > > kind: StorageClass > > metadata: > > name: cloudstack-custom > > provisioner: csi.cloudstack.apache.org <http://csi.cloudstack.apache.org/> > > <http://csi.cloudstack.apache.org/> > > reclaimPolicy: Delete > > volumeBindingMode: WaitForFirstConsumer > > allowVolumeExpansion: false > > parameters: > > csi.cloudstack.apache.org/disk-offering-id: > > <http://csi.cloudstack.apache.org/disk-offering-id:> > > <http://csi.cloudstack.apache.org/disk-offering-id:> > > <copy-the-disk-offering-id-here> > > > > > > kubectl apply -f storage-class.yml > > > > root@18dc14302a2:~# kubectl get storageclass > > NAME PROVISIONER RECLAIMPOLICY > > VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE > > cloudstack-custom csi.cloudstack.apache.org > > <http://csi.cloudstack.apache.org/> <http://csi.cloudstack.apache.org/> > > Delete WaitForFirstConsumer false 3d5h > > > > > > 4- Now you can test by creating a PVC and POD - ( Examples are already > > there in the link > > -https://github.com/apalia/cloudstack-csi-driver/tree/master/examples/k8s ) > > > > > > > > Vivek Kumar > > Sr. Manager - Cloud & DevOps > > TechOps | Indiqus Technologies > > > > vivek.ku...@indiqus.com <mailto:vivek.ku...@indiqus.com> > > <mailto:vivek.ku...@indiqus.com> <mailto:vivek.ku...@indiqus.com> > > www.indiqus.com <http://www.indiqus.com/> <http://www.indiqus.com/> > > <https://www.indiqus.com/> > > > > > > > > > > > On 22-Feb-2024, at 8:11 PM, Bharat Bhushan Saini > > > <bharat.sa...@kloudspot.com.INVALID > > > <mailto:bharat.sa...@kloudspot.com.INVALID> > > > <mailto:bharat.sa...@kloudspot.com.INVALID>> wrote: > > > > > > Hi Vivek/Kiran, > > > > > > The cluster is deployed in the Root domain. But I am unable to locate > > > cloud-config file configuration after creating a domain user and pls > > > correct me that the cloud-config file have to be configured in controller > > > node. > > > > > > Thanks and Regards, > > > Bharat Saini > > > > > > > > > > > > From: Vivek Kumar <vivek.ku...@indiqus.com.INVALID > > > <mailto:vivek.ku...@indiqus.com.INVALID><mailto:vivek.ku...@indiqus.com.INVALID><mailto:vivek.ku...@indiqus.com.INVALID > > > > > > <mailto:vivek.ku...@indiqus.com.INVALID%3e%3cmailto:vivek.ku...@indiqus.com.INVALID>>> > > > Date: Thursday, 22 February 2024 at 5:51 PM > > > To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> > > > <mailto:users@cloudstack.apache.org> <mailto:users@cloudstack.apache.org> > > > <users@cloudstack.apache.org > > > <mailto:users@cloudstack.apache.org><mailto:users@cloudstack.apache.org> > > > <mailto:users@cloudstack.apache.org>> > > > Subject: Re: CKS Storage Provisioner Info > > > > > > EXTERNAL EMAIL: Please verify the sender email address before taking any > > > action, replying, clicking any link or opening any attachment. > > > > > > > > > Hello Bharat, > > > > > > Yes, the link provided by Kiran works well for PVC but only one caveat > > > that it only works if your cluster is deployed under ROOT domain. > > > > > > > > > > > > Vivek Kumar > > > Sr. Manager - Cloud & DevOps > > > TechOps | Indiqus Technologies > > > > > > vivek.ku...@indiqus.com <mailto:vivek.ku...@indiqus.com> > > > <mailto:vivek.ku...@indiqus.com> <mailto:vivek.ku...@indiqus.com> > > > <mailto:vivek.ku...@indiqus.com> > > > www.indiqus.com <http://www.indiqus.com/> > > > <http://www.indiqus.com/> <http://www.indiqus.com/> > > > <https://www.indiqus.com/> > > > > > > > > > > > > > > > > On 22-Feb-2024, at 5:21 PM, Kiran Chavala <kiran.chav...@shapeblue.com > > > > <mailto:kiran.chav...@shapeblue.com><mailto:kiran.chav...@shapeblue.com><mailto:kiran.chav...@shapeblue.com > > > > > > > > <mailto:kiran.chav...@shapeblue.com%3e%3cmailto:kiran.chav...@shapeblue.com>>> > > > > wrote: > > > > > > > > Hi Bharat > > > > > > > > You can try the following CSI driver > > > > > > > > https://github.com/Leaseweb/cloudstack-csi-driver > > > > > > > > > > > > Regards > > > > Kiran > > > > > > > > From: Bharat Bhushan Saini <bharat.sa...@kloudspot.com.INVALID > > > > <mailto:bharat.sa...@kloudspot.com.INVALID><mailto:bharat.sa...@kloudspot.com.INVALID><mailto:bharat.sa...@kloudspot.com.INVALID > > > > > > > > <mailto:bharat.sa...@kloudspot.com.INVALID%3e%3cmailto:bharat.sa...@kloudspot.com.INVALID>>> > > > > Date: Thursday, 22 February 2024 at 5:14 PM > > > > To: users@cloudstack.apache.org <mailto:users@cloudstack.apache.org> > > > > <mailto:users@cloudstack.apache.org> > > > > <mailto:users@cloudstack.apache.org> <users@cloudstack.apache.org > > > > <mailto:users@cloudstack.apache.org><mailto:users@cloudstack.apache.org> > > > > <mailto:users@cloudstack.apache.org>> > > > > Subject: CKS Storage Provisioner Info > > > > Hi All, > > > > > > > > As working with the CKS service I had a query regarding with the K8s > > > > storage provisioner. > > > > Which provisioner I can use for the shared and unshared PVC in the CKS > > > > service. > > > > Please support in this, it will be great help for me. > > > > > > > > Thanks and Regards, > > > > Bharat Saini > > > > > > > > [signature_1218208545] > > > > > > > > --------------------------- Disclaimer: ------------------------------ > > > > This message and its contents are intended solely for the designated > > > > addressee and are proprietary to Kloudspot. The information in this > > > > email is meant exclusively for Kloudspot business use. Any use by > > > > individuals other than the addressee constitutes misuse and an > > > > infringement of Kloudspot's proprietary rights. If you are not the > > > > intended recipient, please return this email to the sender. Kloudspot > > > > cannot guarantee the security or error-free transmission of e-mail > > > > communications. Information could be intercepted, corrupted, lost, > > > > destroyed, arrive late or incomplete, or contain viruses. Therefore, > > > > Kloudspot shall not be liable for any issues arising from the > > > > transmission of this email. > > > > > > > > > > > > > > > > > > > > > -- > > > This message is intended only for the use of the individual or entity to > > > which it is addressed and may contain confidential and/or privileged > > > information. If you are not the intended recipient, please delete the > > > original message and any copy of it from your computer system. You are > > > hereby notified that any dissemination, distribution or copying of this > > > communication is strictly prohibited unless proper authorization has been > > > obtained for such action. If you have received this communication in > > > error, > > > please notify the sender immediately. Although IndiQus attempts to sweep > > > e-mail and attachments for viruses, it does not guarantee that both are > > > virus-free and accepts no liability for any damage sustained as a result > > > of > > > viruses. > > > --------------------------- Disclaimer: ------------------------------ > > > This message and its contents are intended solely for the designated > > > addressee and are proprietary to Kloudspot. The information in this email > > > is meant exclusively for Kloudspot business use. Any use by individuals > > > other than the addressee constitutes misuse and an infringement of > > > Kloudspot's proprietary rights. If you are not the intended recipient, > > > please return this email to the sender. Kloudspot cannot guarantee the > > > security or error-free transmission of e-mail communications. Information > > > could be intercepted, corrupted, lost, destroyed, arrive late or > > > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable > > > for any issues arising from the transmission of this email. > > > > > > > > > -- > > This message is intended only for the use of the individual or entity to > > which it is addressed and may contain confidential and/or privileged > > information. If you are not the intended recipient, please delete the > > original message and any copy of it from your computer system. You are > > hereby notified that any dissemination, distribution or copying of this > > communication is strictly prohibited unless proper authorization has been > > obtained for such action. If you have received this communication in error, > > please notify the sender immediately. Although IndiQus attempts to sweep > > e-mail and attachments for viruses, it does not guarantee that both are > > virus-free and accepts no liability for any damage sustained as a result of > > viruses. > > --------------------------- Disclaimer: ------------------------------ > > This message and its contents are intended solely for the designated > > addressee and are proprietary to Kloudspot. The information in this email > > is meant exclusively for Kloudspot business use. Any use by individuals > > other than the addressee constitutes misuse and an infringement of > > Kloudspot's proprietary rights. If you are not the intended recipient, > > please return this email to the sender. Kloudspot cannot guarantee the > > security or error-free transmission of e-mail communications. Information > > could be intercepted, corrupted, lost, destroyed, arrive late or > > incomplete, or contain viruses. Therefore, Kloudspot shall not be liable > > for any issues arising from the transmission of this email. > > > > > -- > This message is intended only for the use of the individual or entity to > which it is addressed and may contain confidential and/or privileged > information. If you are not the intended recipient, please delete the > original message and any copy of it from your computer system. You are > hereby notified that any dissemination, distribution or copying of this > communication is strictly prohibited unless proper authorization has been > obtained for such action. If you have received this communication in error, > please notify the sender immediately. Although IndiQus attempts to sweep > e-mail and attachments for viruses, it does not guarantee that both are > virus-free and accepts no liability for any damage sustained as a result of > viruses. > --------------------------- Disclaimer: ------------------------------ > This message and its contents are intended solely for the designated > addressee and are proprietary to Kloudspot. The information in this email is > meant exclusively for Kloudspot business use. Any use by individuals other > than the addressee constitutes misuse and an infringement of Kloudspot's > proprietary rights. If you are not the intended recipient, please return this > email to the sender. Kloudspot cannot guarantee the security or error-free > transmission of e-mail communications. Information could be intercepted, > corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. > Therefore, Kloudspot shall not be liable for any issues arising from the > transmission of this email. > > --------------------------- Disclaimer: ------------------------------ > This message and its contents are intended solely for the designated > addressee and are proprietary to Kloudspot. The information in this email is > meant exclusively for Kloudspot business use. Any use by individuals other > than the addressee constitutes misuse and an infringement of Kloudspot's > proprietary rights. If you are not the intended recipient, please return this > email to the sender. Kloudspot cannot guarantee the security or error-free > transmission of e-mail communications. Information could be intercepted, > corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. > Therefore, Kloudspot shall not be liable for any issues arising from the > transmission of this email. > -- This message is intended only for the use of the individual or entity to which it is addressed and may contain confidential and/or privileged information. If you are not the intended recipient, please delete the original message and any copy of it from your computer system. You are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited unless proper authorization has been obtained for such action. If you have received this communication in error, please notify the sender immediately. Although IndiQus attempts to sweep e-mail and attachments for viruses, it does not guarantee that both are virus-free and accepts no liability for any damage sustained as a result of viruses.
