Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Ivan Serdyuk]

I wonder if that would assume some choice for a desired compiler? Perhaps
https://github.com/golang/gofrontend, https://go.googlesource.com/gollvm/ and
https://github.com/tinygo-org/tinygo?

I also wonder if ARM platform might be supported, since Java-on-ARM and
Kubernetes/Docker-on-ARM are pretty typical, in a modern production
environment.

Ivan

On Tue, Sep 24, 2019 at 9:42 AM Abhishek Kumar 
wrote:

> Hi all,
>
> I would like to propose developing a plugin for Kubernetes integration in
> CloudStack, can be named CloudStack Kubernetes Service plugin.
> I've written down an initial design document for it here,
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
> Please review and provide your thoughts and suggestions.
>
> Regards,
>
>
> Abhishek Kumar
>
> Software Engineer
>
> ShapeBlue
>
> abhishek.ku...@shapeblue.com
>
> www.shapeblue.com
>
> abhishek.ku...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Riepl, Gregor (SWISS TXT)]

Isn't multi-master kind of a baseline requirement?
etcd should be operated on at least three nodes to have a quorum, so a there 
should be at least three masters...

From: Abhishek Kumar 
Sent: 26 September 2019 08:11
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

I would be really interested in exploring multi-master k8s cluster but it is 
not in proposal at the moment. We can surely look into this.
FS mentions, for deployment, plugin will use kubeadm and kubectl tools.


From: Pierre-Luc Dion 
Sent: 25 September 2019 22:41
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Make sense for the proposed implementation, would it handle redundant
master?
How would the k8s cluster would be created, using Rancher tools, kubectl or
other?

so far, the small part I understand from MaaS, it could be very interesting
to integrate it to cloudstack in a way where it could be use to  scale
Hypervisor host, specially KVM nodes.


On Wed, Sep 25, 2019 at 10:47 AM Paul Angus 
wrote:

> The proposed implementation will create a master and n worker nodes.
> It will also support (graceful) cluster resizing, the next step would be
> to enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive
> that scaling, so that you can scale with demand rather than needing to
> oversize you environment to begin with.
>
> I've been keeping MaaS in mind as way of doing baremetal Kubernetes along
> side VM based Kubernetes clusters.  Interestingly a few people that I have
> spoken to have said that they prefer the use of VMs, because whole servers
> as the unit of scale is often very wasteful, unless you 'share' them which
> has all sorts of security implications...
>
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 15:31
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Paul,
>
> Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
> sure I'm curious to see how cloudstack could become more "other Apache
> products friendly" but I don't have particular use case compared to k8s
> integration. Has you are suggesting, would probably make sense to use Helm
> to deploy any other application stack.
>
> btw, we are still working on the Canonical MaaS integration, a bit more
> challenging than anticipated...
>
>
> To get back to a *Kubernetes Service plugin*:
> To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I
> need to deploy monstrous instances for worker nodes.
> which doesn't make sense if I'm a cloud consumer. So I think we need to
> solve something challenging: a k8s service that would scale has needed
> while keeping in mind redundancy of worker nodes without sacrifice on
> security. Is the worker node is part of the ongoing work or it's more about
> offering a k8s master and api infrastructure to a user ?
>
> An easy path would be some kind of shared worker nodes pool but that
> involve possible security risk unless you would trust users that consume
> those workers.
>
>
> On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
> wrote:
>
> > Hi Pierre-Luc,
> >
> > (we missed you at CCCNA!) How are you seeing CloudStack being more
> > deployment friendly?  What you do think that we could do on top of
> > creating the Kubenetes Cluster to begin with?
> > [thinking out loud - we could pre-package Tiller to make it easier to
> > deploy openWhisk via Helm charts ? ]
> >
> > Kind regards
> >
> >
> > Paul.
> >
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com<http://www.shapeblue.com>
> > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Pierre-Luc Dion 
> > Sent: 25 September 2019 13:37
> > To: dev@cloudstack.apache.org
> > Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
> >
> > Hi Rohit, Nux,
> >
> > Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I
> agree
> > with your opinion, but there is a lot of interest for k8s and seams like
> a
> > lot of organisations are moving to container based infrastructures to
> > standardized their deployment.
> >
> > if we want to extent the discussion to function as a service, would you
> > guys see a possibility for us to be more aligned or more deployment

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Abhishek Kumar]

Hi Gregor,

For cluster node templates, FS mentions service will use CoreOS template (from 
here, http://dl.openvm.eu/cloudstack/coreos/x86_64/). User can also build their 
templates. Initial though is to use a global setting(for registering template) 
or an API parameter during cluster creation.
We can also explore the possibility of a new, common, maybe debian-based, 
systemvm template which can be used by the service.
There are no additional security changes for nodes. Security will be same what 
we have for normal instances in CloudStack.

Regards,
Index of /cloudstack/coreos/x86_64 - 
openvm.eu<http://dl.openvm.eu/cloudstack/coreos/x86_64/>
Name Last modified Size; Parent Directory - alpha/ 14-Sep-2019 02:54 - beta/ 
14-Sep-2019 01:42 - buildtime.txt: 13-Sep-2019 17:53 : 13 : 
coreos_production_cloudstack_image-hyperv.vhd.zip
dl.openvm.eu


From: Riepl, Gregor (SWISS TXT) 
Sent: 25 September 2019 22:11
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi all,

kubernetes-cloudstack-provider provides the missing link between Kubernetes and 
CloudStack resources (firewall, loadbalancer, node information, ...).

There is one other component that you still need, though: Suitable images.
I'm not sure if this is something that CloudStack should provide, but without 
them, automated resizing will be difficult.

Paul, do you already have an idea on how to do handle this?
Require users to build their own images?
Create a ready-to-use template like it's done for the system VMs?
How could PaaS deployments (for example, OpenShift) be handled?
What about node security?

We've been deploying Kubernetes very successfully via custom Ansible scripts so 
far. But having CloudStack do much of the heavy lifting might allow for some 
very interesting use cases.
If cluster scaling can be abstracted at the API level, it could also be added 
to the cloud provider - allowing infrastructure scaling from within k8s itself, 
or even based on load!
In such a case, initial setup should focus first and foremost on the control 
plane (i.e. bootstrapping master nodes), then allowing worker scaling via k8s 
resources.

Regards,
Gregor

From: Paul Angus 
Sent: 25 September 2019 16:47
To: dev@cloudstack.apache.org 
Subject: RE: [DISCUSS] CloudStack Kubernetes Service plugin

The proposed implementation will create a master and n worker nodes.
It will also support (graceful) cluster resizing, the next step would be to 
enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive that 
scaling, so that you can scale with demand rather than needing to oversize you 
environment to begin with.

I've been keeping MaaS in mind as way of doing baremetal Kubernetes along side 
VM based Kubernetes clusters.  Interestingly a few people that I have spoken to 
have said that they prefer the use of VMs, because whole servers as the unit of 
scale is often very wasteful, unless you 'share' them which has all sorts of 
security implications...




paul.an...@shapeblue.com
www.shapeblue.com<http://www.shapeblue.com>
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue




abhishek.ku...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 


-Original Message-
From: Pierre-Luc Dion 
Sent: 25 September 2019 15:31
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Paul,

Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not sure 
I'm curious to see how cloudstack could become more "other Apache products 
friendly" but I don't have particular use case compared to k8s integration. Has 
you are suggesting, would probably make sense to use Helm to deploy any other 
application stack.

btw, we are still working on the Canonical MaaS integration, a bit more 
challenging than anticipated...


To get back to a *Kubernetes Service plugin*:
To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I need 
to deploy monstrous instances for worker nodes.
which doesn't make sense if I'm a cloud consumer. So I think we need to solve 
something challenging: a k8s service that would scale has needed while keeping 
in mind redundancy of worker nodes without sacrifice on security. Is the worker 
node is part of the ongoing work or it's more about offering a k8s master and 
api infrastructure to a user ?

An easy path would be some kind of shared worker nodes pool but that involve 
possible security risk unless you would trust users that consume those workers.


On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
wrote:

> Hi Pierre-Luc,
>
> (we missed you at CCCNA!) How are you seeing CloudStack being more
> deployment friendly?  What you do think that we could do on top of
> creating the Kubenetes Cluster to begin with?
> [thinking out loud - we could pre-package Tiller to make it easi

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Abhishek Kumar]

I would be really interested in exploring multi-master k8s cluster but it is 
not in proposal at the moment. We can surely look into this.
FS mentions, for deployment, plugin will use kubeadm and kubectl tools.


From: Pierre-Luc Dion 
Sent: 25 September 2019 22:41
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Make sense for the proposed implementation, would it handle redundant
master?
How would the k8s cluster would be created, using Rancher tools, kubectl or
other?

so far, the small part I understand from MaaS, it could be very interesting
to integrate it to cloudstack in a way where it could be use to  scale
Hypervisor host, specially KVM nodes.


On Wed, Sep 25, 2019 at 10:47 AM Paul Angus 
wrote:

> The proposed implementation will create a master and n worker nodes.
> It will also support (graceful) cluster resizing, the next step would be
> to enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive
> that scaling, so that you can scale with demand rather than needing to
> oversize you environment to begin with.
>
> I've been keeping MaaS in mind as way of doing baremetal Kubernetes along
> side VM based Kubernetes clusters.  Interestingly a few people that I have
> spoken to have said that they prefer the use of VMs, because whole servers
> as the unit of scale is often very wasteful, unless you 'share' them which
> has all sorts of security implications...
>
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 15:31
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Paul,
>
> Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
> sure I'm curious to see how cloudstack could become more "other Apache
> products friendly" but I don't have particular use case compared to k8s
> integration. Has you are suggesting, would probably make sense to use Helm
> to deploy any other application stack.
>
> btw, we are still working on the Canonical MaaS integration, a bit more
> challenging than anticipated...
>
>
> To get back to a *Kubernetes Service plugin*:
> To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I
> need to deploy monstrous instances for worker nodes.
> which doesn't make sense if I'm a cloud consumer. So I think we need to
> solve something challenging: a k8s service that would scale has needed
> while keeping in mind redundancy of worker nodes without sacrifice on
> security. Is the worker node is part of the ongoing work or it's more about
> offering a k8s master and api infrastructure to a user ?
>
> An easy path would be some kind of shared worker nodes pool but that
> involve possible security risk unless you would trust users that consume
> those workers.
>
>
> On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
> wrote:
>
> > Hi Pierre-Luc,
> >
> > (we missed you at CCCNA!) How are you seeing CloudStack being more
> > deployment friendly?  What you do think that we could do on top of
> > creating the Kubenetes Cluster to begin with?
> > [thinking out loud - we could pre-package Tiller to make it easier to
> > deploy openWhisk via Helm charts ? ]
> >
> > Kind regards
> >
> >
> > Paul.
> >
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com<http://www.shapeblue.com>
> > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Pierre-Luc Dion 
> > Sent: 25 September 2019 13:37
> > To: dev@cloudstack.apache.org
> > Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
> >
> > Hi Rohit, Nux,
> >
> > Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I
> agree
> > with your opinion, but there is a lot of interest for k8s and seams like
> a
> > lot of organisations are moving to container based infrastructures to
> > standardized their deployment.
> >
> > if we want to extent the discussion to function as a service, would you
> > guys see a possibility for us to be more aligned or more deployment
> > friendly for Openwhisk ?
> >
> > Cheers,
> >
> >
> > On Wed, Sep 25, 2019 at 6:54 AM Will Stevens 
> > wrote:
> >
> > > We see huge demand for K8s in our customer base. Just a note...
> > >
> > > On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
> > >

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Abhishek Kumar]

Hi Pierre-Luc,

As FS states and Paul mentioned, plugin can support scaling of worker nodes 
through an API(scaleK8sCluster), howerver, there is no automatic scaling in the 
proposal. Also, I'm not sure about shared worker nodes pool at this moment.
Also, as mentioned in FS createK8sCluster API takes parameters 
serviceofferingid and noderootdisksize so user can manage compute power of 
nodes as desired.

Regards,
Abhishek


From: Pierre-Luc Dion 
Sent: 25 September 2019 20:00
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Paul,

Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
sure I'm curious to see how cloudstack could become more
"other Apache products friendly" but I don't have particular use case
compared to k8s integration. Has you are suggesting,
would probably make sense to use Helm to deploy any other application stack.

btw, we are still working on the Canonical MaaS integration, a bit more
challenging than anticipated...


To get back to a *Kubernetes Service plugin*:
To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I
need to deploy monstrous instances for worker nodes.
which doesn't make sense if I'm a cloud consumer. So I think we need to
solve something challenging: a k8s service that would scale has needed
while keeping in mind redundancy of worker nodes without sacrifice on
security. Is the worker node is part of the ongoing work or it's more about
offering a k8s master and api infrastructure to a user ?

An easy path would be some kind of shared worker nodes pool but that
involve possible security risk unless you would trust users that consume
those workers.


On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
wrote:

> Hi Pierre-Luc,
>
> (we missed you at CCCNA!) How are you seeing CloudStack being more
> deployment friendly?  What you do think that we could do on top of creating
> the Kubenetes Cluster to begin with?
> [thinking out loud - we could pre-package Tiller to make it easier to
> deploy openWhisk via Helm charts ? ]
>
> Kind regards
>
>
> Paul.
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 13:37
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Rohit, Nux,
>
> Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I agree
> with your opinion, but there is a lot of interest for k8s and seams like a
> lot of organisations are moving to container based infrastructures to
> standardized their deployment.
>
> if we want to extent the discussion to function as a service, would you
> guys see a possibility for us to be more aligned or more deployment
> friendly for Openwhisk ?
>
> Cheers,
>
>
> On Wed, Sep 25, 2019 at 6:54 AM Will Stevens 
> wrote:
>
> > We see huge demand for K8s in our customer base. Just a note...
> >
> > On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
> >
> > > Do you guys see high demand for K8s?
> > >  From where I'm looking it seems to be going the way of Openstack,
> > > loads of hype, overcomplicated, near-impossible to upgrade.
> > > Not sure if it's worth investing resources for this.
> > >
> > > Lucian
> > >
> > > ---
> > > Sent from the Delta quadrant using Borg technology!
> > >
> > > On 2019-09-24 07:41, Abhishek Kumar wrote:
> > > > Hi all,
> > > >
> > > > I would like to propose developing a plugin for Kubernetes
> > > > integration in CloudStack, can be named CloudStack Kubernetes
> Service plugin.
> > > > I've written down an initial design document for it here,
> > > >
> > >
> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kube
> > rnetes+Service
> > > > Please review and provide your thoughts and suggestions.
> > > >
> > > > Regards,
> > > >
> > > >
> > > > Abhishek Kumar
> > > >
> > > > Software Engineer
> > > >
> > > > ShapeBlue
> > > >
> > > > abhishek.ku...@shapeblue.com
> > > >
> > > > www.shapeblue.com<http://www.shapeblue.com>
> > > >
> > > > abhishek.ku...@shapeblue.com
> > > > www.shapeblue.com<http://www.shapeblue.com>
> > > > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> > >
> >
>
>
> --
>
> *Pierre-Luc Dion*Lead Cloud Architect | Architecte infonuagique principal
> t 1.888.796.8364 ext. 1403
>
>
> <
> https://cloud.ca/?utm_source=email_medium=signature_content=cloud-ca-logo-1_campaign=general_email
> >
>


--

abhishek.ku...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 

RE: [DISCUSS] CloudStack Kubernetes Service plugin

[Paul Angus]

Hi Sven,

The cloudstack-kubernetes-provider is a plugin for Kubernetes which enables 
Kubernetes to drive CloudStack actions, such as opening firewall ports.
The CloudStack Kubernetes service, enables end users to request say, a 
Kubernetes cluster with 1 master and 4 workers (based on a user requested 
service offering).  CloudStack takes care of the plumbing and configuration to 
get the base cluster operational.


paul.an...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 


-Original Message-
From: Sven Vogel  
Sent: 25 September 2019 19:18
To: dev 
Cc: us...@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Sounds interesting.

For me there are also some questions like Pierre.

If I understand it correctly all nodes inclusive the masters will be deployed 
from a core os template?
What are the pvc or storage class backend which are available to the cluster 
nodes? (Local storage from the core os vms?)

And now a little bit sorting… what’s the difference between… its a little 
confusing ...

https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
or
https://github.com/apache/cloudstack-kubernetes-provider

Cheers

Sven


__

Sven Vogel
Teamlead Platform

EWERK DIGITAL GmbH
Brühl 24, D-04109 Leipzig
P +49 341 42649 - 99
F +49 341 42649 - 98
s.vo...@ewerk.com
www.ewerk.com

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Frank Richter
Registergericht: Leipzig HRB 9065

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 2-1:2011

ISAE 3402 Typ II Assessed

EWERK-Blog<https://blog.ewerk.com/> | 
LinkedIn<https://www.linkedin.com/company/ewerk-group> | 
Xing<https://www.xing.com/company/ewerk> | 
Twitter<https://twitter.com/EWERK_Group> | 
Facebook<https://de-de.facebook.com/EWERK.IT/>

Mit Handelsregistereintragung vom 09.07.2019 ist die EWERK RZ GmbH auf die 
EWERK IT GmbH verschmolzen und firmiert nun gemeinsam unter dem Namen: EWERK 
DIGITAL GmbH, für weitere Informationen klicken Sie 
hier<https://www.ewerk.com/ewerkdigital>.

Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Privacy:
Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist 
vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der 
bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, 
Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte 
informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die 
E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen 
Dank.

The contents of this e-mail (including any attachments) are confidential and 
may be legally privileged. If you are not the intended recipient of this 
e-mail, any disclosure, copying, distribution or use of its contents is 
strictly prohibited, and you should please notify the sender immediately and 
then delete it (including any attachments) from your system. Thank you.

Am 25.09.2019 um 19:29 schrieb Paul Angus 
mailto:paul.an...@shapeblue.com>>:

The FS is here:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service

I'll let Abhishek fill in any gaps between whats in the FS and your questions - 
it might be good to comment on the FS so all of this gets captured.
The one thing I would add is that we see this as just the next iteration of the 
feature, not the end goal.  So we would look to add functionality after it goes 
live, but we would also welcome any others wishing to extend the functionality 
too...

Kind regards
Paul.



paul.an...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue




-Original Message-
From: Pierre-Luc Dion 
Sent: 25 September 2019 18:12
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Make sense for the proposed implementation, would it handle redundant master?
How would the k8s cluster would be created, using Rancher tools, kubectl or 
other?

so far, the small part I understand from MaaS, it could be very interesting to 
integrate it to cloudstack in a way where it could be use to  scale Hypervisor 
host, specially KVM nodes.


On Wed, Sep 25, 2019 at 10:47 AM Paul Angus 
wrote:

The proposed implementation will create a master and n worker nodes.
It will also support (graceful) cluster resizing, the next step would be to 
enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive that 
scaling, so that you can scale with demand rather than needing to oversize you 
environment to begin with.

I've been keeping MaaS in mind as way of doing baremetal Kubernetes along side 
VM based Kubernetes clusters.  Interestingly a few people that I have spoken to 
have said that they prefer the use of VMs, because whole servers as the unit of 
scale is often very wasteful, unless you 'share' them whi

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Sven Vogel]

Sounds interesting.

For me there are also some questions like Pierre.

If I understand it correctly all nodes inclusive the masters will be deployed 
from a core os template?
What are the pvc or storage class backend which are available to the cluster 
nodes? (Local storage from the core os vms?)

And now a little bit sorting… what’s the difference between… its a little 
confusing ...

https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
or
https://github.com/apache/cloudstack-kubernetes-provider

Cheers

Sven


__

Sven Vogel
Teamlead Platform

EWERK DIGITAL GmbH
Brühl 24, D-04109 Leipzig
P +49 341 42649 - 99
F +49 341 42649 - 98
s.vo...@ewerk.com
www.ewerk.com

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Frank Richter
Registergericht: Leipzig HRB 9065

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 2-1:2011

ISAE 3402 Typ II Assessed

EWERK-Blog<https://blog.ewerk.com/> | 
LinkedIn<https://www.linkedin.com/company/ewerk-group> | 
Xing<https://www.xing.com/company/ewerk> | 
Twitter<https://twitter.com/EWERK_Group> | 
Facebook<https://de-de.facebook.com/EWERK.IT/>

Mit Handelsregistereintragung vom 09.07.2019 ist die EWERK RZ GmbH auf die 
EWERK IT GmbH verschmolzen und firmiert nun gemeinsam unter dem Namen: EWERK 
DIGITAL GmbH, für weitere Informationen klicken Sie 
hier<https://www.ewerk.com/ewerkdigital>.

Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Privacy:
Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist 
vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der 
bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, 
Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte 
informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die 
E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen 
Dank.

The contents of this e-mail (including any attachments) are confidential and 
may be legally privileged. If you are not the intended recipient of this 
e-mail, any disclosure, copying, distribution or use of its contents is 
strictly prohibited, and you should please notify the sender immediately and 
then delete it (including any attachments) from your system. Thank you.

Am 25.09.2019 um 19:29 schrieb Paul Angus 
mailto:paul.an...@shapeblue.com>>:

The FS is here:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service

I'll let Abhishek fill in any gaps between whats in the FS and your questions - 
it might be good to comment on the FS so all of this gets captured.
The one thing I would add is that we see this as just the next iteration of the 
feature, not the end goal.  So we would look to add functionality after it goes 
live, but we would also welcome any others wishing to extend the functionality 
too...

Kind regards
Paul.



paul.an...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue




-Original Message-
From: Pierre-Luc Dion 
Sent: 25 September 2019 18:12
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Make sense for the proposed implementation, would it handle redundant master?
How would the k8s cluster would be created, using Rancher tools, kubectl or 
other?

so far, the small part I understand from MaaS, it could be very interesting to 
integrate it to cloudstack in a way where it could be use to  scale Hypervisor 
host, specially KVM nodes.


On Wed, Sep 25, 2019 at 10:47 AM Paul Angus 
wrote:

The proposed implementation will create a master and n worker nodes.
It will also support (graceful) cluster resizing, the next step would
be to enable the CloudStack plugin for Kubernetes to allow Kubernetes
to drive that scaling, so that you can scale with demand rather than
needing to oversize you environment to begin with.

I've been keeping MaaS in mind as way of doing baremetal Kubernetes
along side VM based Kubernetes clusters.  Interestingly a few people
that I have spoken to have said that they prefer the use of VMs,
because whole servers as the unit of scale is often very wasteful,
unless you 'share' them which has all sorts of security implications...




paul.an...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue




-Original Message-
From: Pierre-Luc Dion 
Sent: 25 September 2019 15:31
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Paul,

Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
sure I'm curious to see how cloudstack could become more "other Apache
products friendly" but I don't have particular use case compared to k8s
integration. Has you are suggesting, would probably make sense to use Helm
to deploy any other application stack.

btw, we are still working on the Canonical MaaS 

RE: [DISCUSS] CloudStack Kubernetes Service plugin

[Paul Angus]

The FS is here:

https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service

I'll let Abhishek fill in any gaps between whats in the FS and your questions - 
it might be good to comment on the FS so all of this gets captured.
The one thing I would add is that we see this as just the next iteration of the 
feature, not the end goal.  So we would look to add functionality after it goes 
live, but we would also welcome any others wishing to extend the functionality 
too...

Kind regards
Paul.



paul.an...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 


-Original Message-
From: Pierre-Luc Dion  
Sent: 25 September 2019 18:12
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Make sense for the proposed implementation, would it handle redundant master?
How would the k8s cluster would be created, using Rancher tools, kubectl or 
other?

so far, the small part I understand from MaaS, it could be very interesting to 
integrate it to cloudstack in a way where it could be use to  scale Hypervisor 
host, specially KVM nodes.


On Wed, Sep 25, 2019 at 10:47 AM Paul Angus 
wrote:

> The proposed implementation will create a master and n worker nodes.
> It will also support (graceful) cluster resizing, the next step would 
> be to enable the CloudStack plugin for Kubernetes to allow Kubernetes 
> to drive that scaling, so that you can scale with demand rather than 
> needing to oversize you environment to begin with.
>
> I've been keeping MaaS in mind as way of doing baremetal Kubernetes 
> along side VM based Kubernetes clusters.  Interestingly a few people 
> that I have spoken to have said that they prefer the use of VMs, 
> because whole servers as the unit of scale is often very wasteful, 
> unless you 'share' them which has all sorts of security implications...
>
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 15:31
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Paul,
>
> Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
> sure I'm curious to see how cloudstack could become more "other Apache
> products friendly" but I don't have particular use case compared to k8s
> integration. Has you are suggesting, would probably make sense to use Helm
> to deploy any other application stack.
>
> btw, we are still working on the Canonical MaaS integration, a bit more
> challenging than anticipated...
>
>
> To get back to a *Kubernetes Service plugin*:
> To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I
> need to deploy monstrous instances for worker nodes.
> which doesn't make sense if I'm a cloud consumer. So I think we need to
> solve something challenging: a k8s service that would scale has needed
> while keeping in mind redundancy of worker nodes without sacrifice on
> security. Is the worker node is part of the ongoing work or it's more about
> offering a k8s master and api infrastructure to a user ?
>
> An easy path would be some kind of shared worker nodes pool but that
> involve possible security risk unless you would trust users that consume
> those workers.
>
>
> On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
> wrote:
>
> > Hi Pierre-Luc,
> >
> > (we missed you at CCCNA!) How are you seeing CloudStack being more
> > deployment friendly?  What you do think that we could do on top of
> > creating the Kubenetes Cluster to begin with?
> > [thinking out loud - we could pre-package Tiller to make it easier to
> > deploy openWhisk via Helm charts ? ]
> >
> > Kind regards
> >
> >
> > Paul.
> >
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Pierre-Luc Dion 
> > Sent: 25 September 2019 13:37
> > To: dev@cloudstack.apache.org
> > Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
> >
> > Hi Rohit, Nux,
> >
> > Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I
> agree
> > with your opinion, but there is a lot of interest for k8s and seams like
> a
> > lot of organisations are moving to container based infrastructures to
> > standardized their deployment.
> >
> > if we want to extent the discussion to function as a service, would you
> > guys see a possibility for us to be more aligned 

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Pierre-Luc Dion]

Make sense for the proposed implementation, would it handle redundant
master?
How would the k8s cluster would be created, using Rancher tools, kubectl or
other?

so far, the small part I understand from MaaS, it could be very interesting
to integrate it to cloudstack in a way where it could be use to  scale
Hypervisor host, specially KVM nodes.


On Wed, Sep 25, 2019 at 10:47 AM Paul Angus 
wrote:

> The proposed implementation will create a master and n worker nodes.
> It will also support (graceful) cluster resizing, the next step would be
> to enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive
> that scaling, so that you can scale with demand rather than needing to
> oversize you environment to begin with.
>
> I've been keeping MaaS in mind as way of doing baremetal Kubernetes along
> side VM based Kubernetes clusters.  Interestingly a few people that I have
> spoken to have said that they prefer the use of VMs, because whole servers
> as the unit of scale is often very wasteful, unless you 'share' them which
> has all sorts of security implications...
>
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 15:31
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Paul,
>
> Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
> sure I'm curious to see how cloudstack could become more "other Apache
> products friendly" but I don't have particular use case compared to k8s
> integration. Has you are suggesting, would probably make sense to use Helm
> to deploy any other application stack.
>
> btw, we are still working on the Canonical MaaS integration, a bit more
> challenging than anticipated...
>
>
> To get back to a *Kubernetes Service plugin*:
> To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I
> need to deploy monstrous instances for worker nodes.
> which doesn't make sense if I'm a cloud consumer. So I think we need to
> solve something challenging: a k8s service that would scale has needed
> while keeping in mind redundancy of worker nodes without sacrifice on
> security. Is the worker node is part of the ongoing work or it's more about
> offering a k8s master and api infrastructure to a user ?
>
> An easy path would be some kind of shared worker nodes pool but that
> involve possible security risk unless you would trust users that consume
> those workers.
>
>
> On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
> wrote:
>
> > Hi Pierre-Luc,
> >
> > (we missed you at CCCNA!) How are you seeing CloudStack being more
> > deployment friendly?  What you do think that we could do on top of
> > creating the Kubenetes Cluster to begin with?
> > [thinking out loud - we could pre-package Tiller to make it easier to
> > deploy openWhisk via Helm charts ? ]
> >
> > Kind regards
> >
> >
> > Paul.
> >
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Pierre-Luc Dion 
> > Sent: 25 September 2019 13:37
> > To: dev@cloudstack.apache.org
> > Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
> >
> > Hi Rohit, Nux,
> >
> > Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I
> agree
> > with your opinion, but there is a lot of interest for k8s and seams like
> a
> > lot of organisations are moving to container based infrastructures to
> > standardized their deployment.
> >
> > if we want to extent the discussion to function as a service, would you
> > guys see a possibility for us to be more aligned or more deployment
> > friendly for Openwhisk ?
> >
> > Cheers,
> >
> >
> > On Wed, Sep 25, 2019 at 6:54 AM Will Stevens 
> > wrote:
> >
> > > We see huge demand for K8s in our customer base. Just a note...
> > >
> > > On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
> > >
> > > > Do you guys see high demand for K8s?
> > > >  From where I'm looking it seems to be going the way of Openstack,
> > > > loads of hype, overcomplicated, near-impossible to upgrade.
> > > > Not sure if it's worth investing resources for this.
> > > >
> > > > Lucian
> > > >
> > > > ---
> > > > Sent from the Delta quadrant using Borg technology!
> &

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Riepl, Gregor (SWISS TXT)]

Hi all,

kubernetes-cloudstack-provider provides the missing link between Kubernetes and 
CloudStack resources (firewall, loadbalancer, node information, ...).

There is one other component that you still need, though: Suitable images.
I'm not sure if this is something that CloudStack should provide, but without 
them, automated resizing will be difficult.

Paul, do you already have an idea on how to do handle this?
Require users to build their own images?
Create a ready-to-use template like it's done for the system VMs?
How could PaaS deployments (for example, OpenShift) be handled?
What about node security?

We've been deploying Kubernetes very successfully via custom Ansible scripts so 
far. But having CloudStack do much of the heavy lifting might allow for some 
very interesting use cases.
If cluster scaling can be abstracted at the API level, it could also be added 
to the cloud provider - allowing infrastructure scaling from within k8s itself, 
or even based on load!
In such a case, initial setup should focus first and foremost on the control 
plane (i.e. bootstrapping master nodes), then allowing worker scaling via k8s 
resources.

Regards,
Gregor

From: Paul Angus 
Sent: 25 September 2019 16:47
To: dev@cloudstack.apache.org 
Subject: RE: [DISCUSS] CloudStack Kubernetes Service plugin

The proposed implementation will create a master and n worker nodes.
It will also support (graceful) cluster resizing, the next step would be to 
enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive that 
scaling, so that you can scale with demand rather than needing to oversize you 
environment to begin with.

I've been keeping MaaS in mind as way of doing baremetal Kubernetes along side 
VM based Kubernetes clusters.  Interestingly a few people that I have spoken to 
have said that they prefer the use of VMs, because whole servers as the unit of 
scale is often very wasteful, unless you 'share' them which has all sorts of 
security implications...




paul.an...@shapeblue.com
www.shapeblue.com<http://www.shapeblue.com>
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue




-Original Message-
From: Pierre-Luc Dion 
Sent: 25 September 2019 15:31
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Paul,

Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not sure 
I'm curious to see how cloudstack could become more "other Apache products 
friendly" but I don't have particular use case compared to k8s integration. Has 
you are suggesting, would probably make sense to use Helm to deploy any other 
application stack.

btw, we are still working on the Canonical MaaS integration, a bit more 
challenging than anticipated...


To get back to a *Kubernetes Service plugin*:
To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I need 
to deploy monstrous instances for worker nodes.
which doesn't make sense if I'm a cloud consumer. So I think we need to solve 
something challenging: a k8s service that would scale has needed while keeping 
in mind redundancy of worker nodes without sacrifice on security. Is the worker 
node is part of the ongoing work or it's more about offering a k8s master and 
api infrastructure to a user ?

An easy path would be some kind of shared worker nodes pool but that involve 
possible security risk unless you would trust users that consume those workers.


On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
wrote:

> Hi Pierre-Luc,
>
> (we missed you at CCCNA!) How are you seeing CloudStack being more
> deployment friendly?  What you do think that we could do on top of
> creating the Kubenetes Cluster to begin with?
> [thinking out loud - we could pre-package Tiller to make it easier to
> deploy openWhisk via Helm charts ? ]
>
> Kind regards
>
>
> Paul.
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 13:37
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Rohit, Nux,
>
> Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I agree
> with your opinion, but there is a lot of interest for k8s and seams like a
> lot of organisations are moving to container based infrastructures to
> standardized their deployment.
>
> if we want to extent the discussion to function as a service, would you
> guys see a possibility for us to be more aligned or more deployment
> friendly for Openwhisk ?
>
> Cheers,
>
>
> On Wed, Sep 25, 2019 at 6:54 AM Will Stevens 
> wrote:
>
> > We see huge demand for K8s in our customer base. Just a note...
> >
> > On Wed,

RE: [DISCUSS] CloudStack Kubernetes Service plugin

[Paul Angus]

The proposed implementation will create a master and n worker nodes.
It will also support (graceful) cluster resizing, the next step would be to 
enable the CloudStack plugin for Kubernetes to allow Kubernetes to drive that 
scaling, so that you can scale with demand rather than needing to oversize you 
environment to begin with.

I've been keeping MaaS in mind as way of doing baremetal Kubernetes along side 
VM based Kubernetes clusters.  Interestingly a few people that I have spoken to 
have said that they prefer the use of VMs, because whole servers as the unit of 
scale is often very wasteful, unless you 'share' them which has all sorts of 
security implications...




paul.an...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 


-Original Message-
From: Pierre-Luc Dion  
Sent: 25 September 2019 15:31
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Paul,

Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not sure 
I'm curious to see how cloudstack could become more "other Apache products 
friendly" but I don't have particular use case compared to k8s integration. Has 
you are suggesting, would probably make sense to use Helm to deploy any other 
application stack.

btw, we are still working on the Canonical MaaS integration, a bit more 
challenging than anticipated...


To get back to a *Kubernetes Service plugin*:
To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I need 
to deploy monstrous instances for worker nodes.
which doesn't make sense if I'm a cloud consumer. So I think we need to solve 
something challenging: a k8s service that would scale has needed while keeping 
in mind redundancy of worker nodes without sacrifice on security. Is the worker 
node is part of the ongoing work or it's more about offering a k8s master and 
api infrastructure to a user ?

An easy path would be some kind of shared worker nodes pool but that involve 
possible security risk unless you would trust users that consume those workers.


On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
wrote:

> Hi Pierre-Luc,
>
> (we missed you at CCCNA!) How are you seeing CloudStack being more 
> deployment friendly?  What you do think that we could do on top of 
> creating the Kubenetes Cluster to begin with?
> [thinking out loud - we could pre-package Tiller to make it easier to 
> deploy openWhisk via Helm charts ? ]
>
> Kind regards
>
>
> Paul.
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 13:37
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Rohit, Nux,
>
> Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I agree
> with your opinion, but there is a lot of interest for k8s and seams like a
> lot of organisations are moving to container based infrastructures to
> standardized their deployment.
>
> if we want to extent the discussion to function as a service, would you
> guys see a possibility for us to be more aligned or more deployment
> friendly for Openwhisk ?
>
> Cheers,
>
>
> On Wed, Sep 25, 2019 at 6:54 AM Will Stevens 
> wrote:
>
> > We see huge demand for K8s in our customer base. Just a note...
> >
> > On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
> >
> > > Do you guys see high demand for K8s?
> > >  From where I'm looking it seems to be going the way of Openstack,
> > > loads of hype, overcomplicated, near-impossible to upgrade.
> > > Not sure if it's worth investing resources for this.
> > >
> > > Lucian
> > >
> > > ---
> > > Sent from the Delta quadrant using Borg technology!
> > >
> > > On 2019-09-24 07:41, Abhishek Kumar wrote:
> > > > Hi all,
> > > >
> > > > I would like to propose developing a plugin for Kubernetes
> > > > integration in CloudStack, can be named CloudStack Kubernetes
> Service plugin.
> > > > I've written down an initial design document for it here,
> > > >
> > >
> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kube
> > rnetes+Service
> > > > Please review and provide your thoughts and suggestions.
> > > >
> > > > Regards,
> > > >
> > > >
> > > > Abhishek Kumar
> > > >
> > > > Software Engineer
> > > >
> > > > ShapeBlue
> > > >
> > > > abhishek.ku...@shapeblue.com
> > > >
> > > > www.shapeblue.com<http://www.shapeblue.com>
> > > >
> > > > abhishek.ku...@shapeblue.com
> > > > www.shapeblue.com
> > > > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> > >
> >
>
>
> --
>
> *Pierre-Luc Dion*Lead Cloud Architect | Architecte infonuagique principal
> t 1.888.796.8364 ext. 1403
>
>
> <
> https://cloud.ca/?utm_source=email_medium=signature_content=cloud-ca-logo-1_campaign=general_email
> >
>


--

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Pierre-Luc Dion]

Hi Paul,

Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not
sure I'm curious to see how cloudstack could become more
"other Apache products friendly" but I don't have particular use case
compared to k8s integration. Has you are suggesting,
would probably make sense to use Helm to deploy any other application stack.

btw, we are still working on the Canonical MaaS integration, a bit more
challenging than anticipated...


To get back to a *Kubernetes Service plugin*:
To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I
need to deploy monstrous instances for worker nodes.
which doesn't make sense if I'm a cloud consumer. So I think we need to
solve something challenging: a k8s service that would scale has needed
while keeping in mind redundancy of worker nodes without sacrifice on
security. Is the worker node is part of the ongoing work or it's more about
offering a k8s master and api infrastructure to a user ?

An easy path would be some kind of shared worker nodes pool but that
involve possible security risk unless you would trust users that consume
those workers.


On Wed, Sep 25, 2019 at 10:15 AM Paul Angus 
wrote:

> Hi Pierre-Luc,
>
> (we missed you at CCCNA!) How are you seeing CloudStack being more
> deployment friendly?  What you do think that we could do on top of creating
> the Kubenetes Cluster to begin with?
> [thinking out loud - we could pre-package Tiller to make it easier to
> deploy openWhisk via Helm charts ? ]
>
> Kind regards
>
>
> Paul.
>
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Pierre-Luc Dion 
> Sent: 25 September 2019 13:37
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin
>
> Hi Rohit, Nux,
>
> Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I agree
> with your opinion, but there is a lot of interest for k8s and seams like a
> lot of organisations are moving to container based infrastructures to
> standardized their deployment.
>
> if we want to extent the discussion to function as a service, would you
> guys see a possibility for us to be more aligned or more deployment
> friendly for Openwhisk ?
>
> Cheers,
>
>
> On Wed, Sep 25, 2019 at 6:54 AM Will Stevens 
> wrote:
>
> > We see huge demand for K8s in our customer base. Just a note...
> >
> > On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
> >
> > > Do you guys see high demand for K8s?
> > >  From where I'm looking it seems to be going the way of Openstack,
> > > loads of hype, overcomplicated, near-impossible to upgrade.
> > > Not sure if it's worth investing resources for this.
> > >
> > > Lucian
> > >
> > > ---
> > > Sent from the Delta quadrant using Borg technology!
> > >
> > > On 2019-09-24 07:41, Abhishek Kumar wrote:
> > > > Hi all,
> > > >
> > > > I would like to propose developing a plugin for Kubernetes
> > > > integration in CloudStack, can be named CloudStack Kubernetes
> Service plugin.
> > > > I've written down an initial design document for it here,
> > > >
> > >
> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kube
> > rnetes+Service
> > > > Please review and provide your thoughts and suggestions.
> > > >
> > > > Regards,
> > > >
> > > >
> > > > Abhishek Kumar
> > > >
> > > > Software Engineer
> > > >
> > > > ShapeBlue
> > > >
> > > > abhishek.ku...@shapeblue.com
> > > >
> > > > www.shapeblue.com<http://www.shapeblue.com>
> > > >
> > > > abhishek.ku...@shapeblue.com
> > > > www.shapeblue.com
> > > > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> > >
> >
>
>
> --
>
> *Pierre-Luc Dion*Lead Cloud Architect | Architecte infonuagique principal
> t 1.888.796.8364 ext. 1403
>
>
> <
> https://cloud.ca/?utm_source=email_medium=signature_content=cloud-ca-logo-1_campaign=general_email
> >
>


--

RE: [DISCUSS] CloudStack Kubernetes Service plugin

[Paul Angus]

Hi Pierre-Luc,

(we missed you at CCCNA!) How are you seeing CloudStack being more deployment 
friendly?  What you do think that we could do on top of creating the Kubenetes 
Cluster to begin with?
[thinking out loud - we could pre-package Tiller to make it easier to deploy 
openWhisk via Helm charts ? ]

Kind regards


Paul. 



paul.an...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 


-Original Message-
From: Pierre-Luc Dion  
Sent: 25 September 2019 13:37
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Rohit, Nux,

Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I agree with 
your opinion, but there is a lot of interest for k8s and seams like a lot of 
organisations are moving to container based infrastructures to standardized 
their deployment.

if we want to extent the discussion to function as a service, would you guys 
see a possibility for us to be more aligned or more deployment friendly for 
Openwhisk ?

Cheers,


On Wed, Sep 25, 2019 at 6:54 AM Will Stevens  wrote:

> We see huge demand for K8s in our customer base. Just a note...
>
> On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
>
> > Do you guys see high demand for K8s?
> >  From where I'm looking it seems to be going the way of Openstack, 
> > loads of hype, overcomplicated, near-impossible to upgrade.
> > Not sure if it's worth investing resources for this.
> >
> > Lucian
> >
> > ---
> > Sent from the Delta quadrant using Borg technology!
> >
> > On 2019-09-24 07:41, Abhishek Kumar wrote:
> > > Hi all,
> > >
> > > I would like to propose developing a plugin for Kubernetes 
> > > integration in CloudStack, can be named CloudStack Kubernetes Service 
> > > plugin.
> > > I've written down an initial design document for it here,
> > >
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kube
> rnetes+Service
> > > Please review and provide your thoughts and suggestions.
> > >
> > > Regards,
> > >
> > >
> > > Abhishek Kumar
> > >
> > > Software Engineer
> > >
> > > ShapeBlue
> > >
> > > abhishek.ku...@shapeblue.com
> > >
> > > www.shapeblue.com<http://www.shapeblue.com>
> > >
> > > abhishek.ku...@shapeblue.com
> > > www.shapeblue.com
> > > Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> >
>


-- 

*Pierre-Luc Dion*Lead Cloud Architect | Architecte infonuagique principal t 
1.888.796.8364 ext. 1403


<https://cloud.ca/?utm_source=email_medium=signature_content=cloud-ca-logo-1_campaign=general_email>

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Pierre-Luc Dion]

Hi Rohit, Nux,

Thanks Rohit for cloudstack-provider, that's exactly it ! :-D
Nux, I agree with your opinion, but there is a lot of interest for k8s and
seams like
a lot of organisations are moving to container based infrastructures to
standardized their deployment.

if we want to extent the discussion to function as a service, would you
guys see a possibility for us to
be more aligned or more deployment friendly for Openwhisk ?

Cheers,


On Wed, Sep 25, 2019 at 6:54 AM Will Stevens  wrote:

> We see huge demand for K8s in our customer base. Just a note...
>
> On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:
>
> > Do you guys see high demand for K8s?
> >  From where I'm looking it seems to be going the way of Openstack, loads
> > of hype, overcomplicated, near-impossible to upgrade.
> > Not sure if it's worth investing resources for this.
> >
> > Lucian
> >
> > ---
> > Sent from the Delta quadrant using Borg technology!
> >
> > On 2019-09-24 07:41, Abhishek Kumar wrote:
> > > Hi all,
> > >
> > > I would like to propose developing a plugin for Kubernetes integration
> > > in CloudStack, can be named CloudStack Kubernetes Service plugin.
> > > I've written down an initial design document for it here,
> > >
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
> > > Please review and provide your thoughts and suggestions.
> > >
> > > Regards,
> > >
> > >
> > > Abhishek Kumar
> > >
> > > Software Engineer
> > >
> > > ShapeBlue
> > >
> > > abhishek.ku...@shapeblue.com
> > >
> > > www.shapeblue.com
> > >
> > > abhishek.ku...@shapeblue.com
> > > www.shapeblue.com
> > > Amadeus House, Floral Street, London  WC2E 9DPUK
> > > @shapeblue
> >
>


-- 

*Pierre-Luc Dion*Lead Cloud Architect | Architecte infonuagique principal
t 1.888.796.8364 ext. 1403

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Will Stevens]

We see huge demand for K8s in our customer base. Just a note...

On Wed, Sep 25, 2019, 4:03 AM Nux!  wrote:

> Do you guys see high demand for K8s?
>  From where I'm looking it seems to be going the way of Openstack, loads
> of hype, overcomplicated, near-impossible to upgrade.
> Not sure if it's worth investing resources for this.
>
> Lucian
>
> ---
> Sent from the Delta quadrant using Borg technology!
>
> On 2019-09-24 07:41, Abhishek Kumar wrote:
> > Hi all,
> >
> > I would like to propose developing a plugin for Kubernetes integration
> > in CloudStack, can be named CloudStack Kubernetes Service plugin.
> > I've written down an initial design document for it here,
> >
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
> > Please review and provide your thoughts and suggestions.
> >
> > Regards,
> >
> >
> > Abhishek Kumar
> >
> > Software Engineer
> >
> > ShapeBlue
> >
> > abhishek.ku...@shapeblue.com
> >
> > www.shapeblue.com
> >
> > abhishek.ku...@shapeblue.com
> > www.shapeblue.com
> > Amadeus House, Floral Street, London  WC2E 9DPUK
> > @shapeblue
>

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Nux!]

Do you guys see high demand for K8s?
From where I'm looking it seems to be going the way of Openstack, loads 
of hype, overcomplicated, near-impossible to upgrade.

Not sure if it's worth investing resources for this.

Lucian

---
Sent from the Delta quadrant using Borg technology!

On 2019-09-24 07:41, Abhishek Kumar wrote:

Hi all,

I would like to propose developing a plugin for Kubernetes integration
in CloudStack, can be named CloudStack Kubernetes Service plugin.
I've written down an initial design document for it here,
https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
Please review and provide your thoughts and suggestions.

Regards,


Abhishek Kumar

Software Engineer

ShapeBlue

abhishek.ku...@shapeblue.com

www.shapeblue.com

abhishek.ku...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Rohit Yadav]

Hi PL,

I think what we can explore is to integrate 
https://github.com/apache/cloudstack-kubernetes-provider (or similar) with the 
k8s master(s) so any suitable operation such as exposing ports etc. could 
configure fw, pf and lb rules in CloudStack.

Regards.



Regards,

Rohit Yadav

Software Architect, ShapeBlue

https://www.shapeblue.com


From: Pierre-Luc Dion 
Sent: Tuesday, September 24, 2019 23:54
To: dev@cloudstack.apache.org 
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

hello,

That look interesting, but any plan on doing the other way around too?
Like having k8s consume CloudStack resources so a k8s cluster could update
load-balancing service of a VPC or other network service from cloudstack,
attach Data-volumes and such..



On Tue, Sep 24, 2019 at 2:42 AM Abhishek Kumar 
wrote:

> Hi all,
>
> I would like to propose developing a plugin for Kubernetes integration in
> CloudStack, can be named CloudStack Kubernetes Service plugin.
> I've written down an initial design document for it here,
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
> Please review and provide your thoughts and suggestions.
>
> Regards,
>
>
> Abhishek Kumar
>
> Software Engineer
>
> ShapeBlue
>
> abhishek.ku...@shapeblue.com
>
> www.shapeblue.com<http://www.shapeblue.com>
>
> abhishek.ku...@shapeblue.com
> www.shapeblue.com<http://www.shapeblue.com>
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>

--

*Pierre-Luc *

rohit.ya...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 

Re: [DISCUSS] CloudStack Kubernetes Service plugin

[Pierre-Luc Dion]

hello,

That look interesting, but any plan on doing the other way around too?
Like having k8s consume CloudStack resources so a k8s cluster could update
load-balancing service of a VPC or other network service from cloudstack,
attach Data-volumes and such..



On Tue, Sep 24, 2019 at 2:42 AM Abhishek Kumar 
wrote:

> Hi all,
>
> I would like to propose developing a plugin for Kubernetes integration in
> CloudStack, can be named CloudStack Kubernetes Service plugin.
> I've written down an initial design document for it here,
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
> Please review and provide your thoughts and suggestions.
>
> Regards,
>
>
> Abhishek Kumar
>
> Software Engineer
>
> ShapeBlue
>
> abhishek.ku...@shapeblue.com
>
> www.shapeblue.com
>
> abhishek.ku...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>

-- 

*Pierre-Luc *

[DISCUSS] CloudStack Kubernetes Service plugin

[Abhishek Kumar]

Hi all,

I would like to propose developing a plugin for Kubernetes integration in 
CloudStack, can be named CloudStack Kubernetes Service plugin.
I've written down an initial design document for it here, 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Kubernetes+Service
Please review and provide your thoughts and suggestions.

Regards,


Abhishek Kumar

Software Engineer

ShapeBlue

abhishek.ku...@shapeblue.com

www.shapeblue.com

abhishek.ku...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue