Re: CEPH / CloudStack features

[Andrija Panic]

Hi Dag,

I'm a bit too late to really share something not mentioned already above -
but in general most things work - (VM snapshots not...) - but all else is
there (resizing volumes, downloading volumes, templates, snapshots, etc),
live migration, etc - we use this with Ubuntu 14 stock libraries (recently
upgraded to versions from 16.04) - some features were originally missing
(volume resize of root vs data volumes), and hopefully the RAW vs QCOW2
format inside DB (what a mess... :) ), is also solved (we did back in the
days a lot of small internal patches, that were never validated with
community unfortunately - don't ask me why - beside proper snapshots
lifecycle (part of 4.8 an onwards) (i.e. keep really only last 1 snap on
CEPH, instead of 50+ garbage snapshots), etc.

If you need more precise info - I could even organize a small demo account
for you with private CEPH offering for VM and DATA (don't tell anyone :) )
- so you can actually see it yourself...

Cheers
Andrija

On Fri, 27 Jul 2018 at 16:28, Simon Weller  wrote:

> They're volume based snapshots at this point. We've looked at what it
> would take to support VMsnapshots, but we're not there yet, as the memory
> would need to be stored outside of the actual volume.
>
> Primary snapshots work well. We still need to reintroduce the code that
> allows for disabling primary to secondary coping of snapshots should an
> organization not want to do that.
>
>
> Templates are also pre-cached into Ceph to speed up deployment of VMs as
> Wido indicates below. This greatly reduced the secondary to primary copying
> of template images.
> Live migration works well land has since Wido introduced the Ceph features
> years ago.
>
> We have started looking at what it would take to support Ceph volume
> replication between zones/regions, as that would be a great Business
> Continuity feature.
>
>
> 
> From: Dag Sonstebo 
> Sent: Friday, July 27, 2018 8:32 AM
> To: dev@cloudstack.apache.org
> Subject: Re: CEPH / CloudStack features
>
> Excellent, thanks Wido.
>
> When you say snapshotting – is this VM snapshots, volume snapshots or both?
>
> How about live migration, does this work?
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 27/07/2018, 13:41, "Wido den Hollander"  wrote:
>
> Hi,
>
> On 07/27/2018 12:18 PM, Dag Sonstebo wrote:
> > Hi all,
> >
> > I’m trying to find out more about CEPH compatibility with CloudStack
> / KVM – i.e. trying to put together a feature matrix of what works  and
> what doesn’t compared to NFS (or other block storage platforms).
> > There’s not a lot of up to date information on this – the
> configuration guide on [1] is all I’ve located so far apart from a couple
> of one-liners in the official documentation.
> >
> > Could I get some feedback from the Ceph users in the community?
> >
>
> Yes! So, at first, Ceph is KVM-only. Other hypervisors do not support
> RBD (RADOS Block Device) from Ceph.
>
> What is supported:
>
> - Thin provisioning
> - Discard / fstrim (Requires VirtIO-SCSI)
> - Volume cloning
> - Snapshots
> - Disk I/O throttling (done by libvirt)
>
> Meaning, when a template is deployed for the first time in a Primary
> Storage it's written to Ceph and all other Instances afterwards are a
> clone of that primary image.
>
> You can snapshot a RBD image and then have it copied to Secondary
> Storage. Now, I'm not sure if keeping the snapshot in Primary Storage
> and reverting works yet, I haven't looked at that in recent times.
>
> The snapshotting part on Primary Storage is probably something that
> needs some love and attention, but otherwise I think all other features
> are supported.
>
> I would recommend a CentOS 7 or Ubuntu 16.04/18.04 hypervisor, both
> work
> just fine with Ceph.
>
> Wido
>
> > Regards,
> > Dag Sonstebo
> >
> > [1] http://docs.ceph.com/docs/master/rbd/rbd-cloudstack/
> >
> > dag.sonst...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
>
>
>
> dag.sonst...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>

-- 

Andrija Panić

Re: CEPH / CloudStack features

[Simon Weller]

They're volume based snapshots at this point. We've looked at what it would 
take to support VMsnapshots, but we're not there yet, as the memory would need 
to be stored outside of the actual volume.

Primary snapshots work well. We still need to reintroduce the code that allows 
for disabling primary to secondary coping of snapshots should an organization 
not want to do that.


Templates are also pre-cached into Ceph to speed up deployment of VMs as Wido 
indicates below. This greatly reduced the secondary to primary copying of 
template images.
Live migration works well land has since Wido introduced the Ceph features 
years ago.

We have started looking at what it would take to support Ceph volume 
replication between zones/regions, as that would be a great Business Continuity 
feature.



From: Dag Sonstebo 
Sent: Friday, July 27, 2018 8:32 AM
To: dev@cloudstack.apache.org
Subject: Re: CEPH / CloudStack features

Excellent, thanks Wido.

When you say snapshotting – is this VM snapshots, volume snapshots or both?

How about live migration, does this work?

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 27/07/2018, 13:41, "Wido den Hollander"  wrote:

Hi,

On 07/27/2018 12:18 PM, Dag Sonstebo wrote:
> Hi all,
>
> I’m trying to find out more about CEPH compatibility with CloudStack / 
KVM – i.e. trying to put together a feature matrix of what works  and what 
doesn’t compared to NFS (or other block storage platforms).
> There’s not a lot of up to date information on this – the configuration 
guide on [1] is all I’ve located so far apart from a couple of one-liners in 
the official documentation.
>
> Could I get some feedback from the Ceph users in the community?
>

Yes! So, at first, Ceph is KVM-only. Other hypervisors do not support
RBD (RADOS Block Device) from Ceph.

What is supported:

- Thin provisioning
- Discard / fstrim (Requires VirtIO-SCSI)
- Volume cloning
- Snapshots
- Disk I/O throttling (done by libvirt)

Meaning, when a template is deployed for the first time in a Primary
Storage it's written to Ceph and all other Instances afterwards are a
clone of that primary image.

You can snapshot a RBD image and then have it copied to Secondary
Storage. Now, I'm not sure if keeping the snapshot in Primary Storage
and reverting works yet, I haven't looked at that in recent times.

The snapshotting part on Primary Storage is probably something that
needs some love and attention, but otherwise I think all other features
are supported.

I would recommend a CentOS 7 or Ubuntu 16.04/18.04 hypervisor, both work
just fine with Ceph.

Wido

> Regards,
> Dag Sonstebo
>
> [1] http://docs.ceph.com/docs/master/rbd/rbd-cloudstack/
>
> dag.sonst...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>



dag.sonst...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

Combining Apache CloudStack Documentation

[Paul Angus]

Hi All,

Thank you to everyone for their appreciation of this little project.  In line 
with that and a couple of the comments, I've tweaked and added some links and 
fixed a load of internal links and references within the docs.

I've had a new repo created under our project [1] and linked it to ReadTheDocs 
[2].  I've been through all of the RTD settings and applied the same as the 
original ones had - including adding all of the existing maintainers.  It's 
just missing a web-hook, which I think infra will need to sort.

I've also done a load of work in the 'Doc Writers' section of the cwiki [3], to 
make getting started easier for people.

The 'new style' documentation is open for business wrt pull requests and merges 
by community people - so please get stuck in.

For anyone who is used to working with our documentation, please have a look at 
the Advanced Information section of [4] as it explains a couple of backend 
things that I've done, you should find that it makes things easier, but it 
explains why they're there and how they work.

[1] https://github.com/apache/cloudstack-documentation
[2] https://cloudstack-documentation.readthedocs.io/
[3] 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Doc+Writers?src=breadcrumbs-parent
[4] 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Getting+Started+Writing+Documentation

I'm on holiday with the family for a couple of weeks.
My TODO list when I return is:

- Update website to reflect new documentation location + 'pre 4.11 
documentation'
- update the redirect from http://docs.cloudstack.apache.org to the new 
location.
- add webhook to github repo to trigger builds when a commit happens
- Update pre 4.11 docs to make it clear that 4.11+ exists and add a link
- Make it clear on github that updates should be in new repo (maybe make 
readonly)
- port across any updates made to the old docs to the new docs during 
transition.





Kind regards,

Paul Angus


paul.an...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: CEPH / CloudStack features

[Dag Sonstebo]

Excellent, thanks Wido.

When you say snapshotting – is this VM snapshots, volume snapshots or both?

How about live migration, does this work?

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 27/07/2018, 13:41, "Wido den Hollander"  wrote:

Hi,

On 07/27/2018 12:18 PM, Dag Sonstebo wrote:
> Hi all,
> 
> I’m trying to find out more about CEPH compatibility with CloudStack / 
KVM – i.e. trying to put together a feature matrix of what works  and what 
doesn’t compared to NFS (or other block storage platforms).
> There’s not a lot of up to date information on this – the configuration 
guide on [1] is all I’ve located so far apart from a couple of one-liners in 
the official documentation.
> 
> Could I get some feedback from the Ceph users in the community?
> 

Yes! So, at first, Ceph is KVM-only. Other hypervisors do not support
RBD (RADOS Block Device) from Ceph.

What is supported:

- Thin provisioning
- Discard / fstrim (Requires VirtIO-SCSI)
- Volume cloning
- Snapshots
- Disk I/O throttling (done by libvirt)

Meaning, when a template is deployed for the first time in a Primary
Storage it's written to Ceph and all other Instances afterwards are a
clone of that primary image.

You can snapshot a RBD image and then have it copied to Secondary
Storage. Now, I'm not sure if keeping the snapshot in Primary Storage
and reverting works yet, I haven't looked at that in recent times.

The snapshotting part on Primary Storage is probably something that
needs some love and attention, but otherwise I think all other features
are supported.

I would recommend a CentOS 7 or Ubuntu 16.04/18.04 hypervisor, both work
just fine with Ceph.

Wido

> Regards,
> Dag Sonstebo
> 
> [1] http://docs.ceph.com/docs/master/rbd/rbd-cloudstack/
> 
> dag.sonst...@shapeblue.com 
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>   
>  
> 



dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: CEPH / CloudStack features

[Wido den Hollander]

Hi,

On 07/27/2018 12:18 PM, Dag Sonstebo wrote:
> Hi all,
> 
> I’m trying to find out more about CEPH compatibility with CloudStack / KVM – 
> i.e. trying to put together a feature matrix of what works  and what doesn’t 
> compared to NFS (or other block storage platforms).
> There’s not a lot of up to date information on this – the configuration guide 
> on [1] is all I’ve located so far apart from a couple of one-liners in the 
> official documentation.
> 
> Could I get some feedback from the Ceph users in the community?
> 

Yes! So, at first, Ceph is KVM-only. Other hypervisors do not support
RBD (RADOS Block Device) from Ceph.

What is supported:

- Thin provisioning
- Discard / fstrim (Requires VirtIO-SCSI)
- Volume cloning
- Snapshots
- Disk I/O throttling (done by libvirt)

Meaning, when a template is deployed for the first time in a Primary
Storage it's written to Ceph and all other Instances afterwards are a
clone of that primary image.

You can snapshot a RBD image and then have it copied to Secondary
Storage. Now, I'm not sure if keeping the snapshot in Primary Storage
and reverting works yet, I haven't looked at that in recent times.

The snapshotting part on Primary Storage is probably something that
needs some love and attention, but otherwise I think all other features
are supported.

I would recommend a CentOS 7 or Ubuntu 16.04/18.04 hypervisor, both work
just fine with Ceph.

Wido

> Regards,
> Dag Sonstebo
> 
> [1] http://docs.ceph.com/docs/master/rbd/rbd-cloudstack/
> 
> dag.sonst...@shapeblue.com 
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>   
>  
> 

RE: CloudStack ELK log management plugin

[Paul Angus]

That’s cool, looking forward to trying it out!


Kind regards,

Paul Angus

paul.an...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 


-Original Message-
From: Dag Sonstebo  
Sent: 27 July 2018 11:14
To: us...@cloudstack.apache.org; dev 
Subject: Re: CloudStack ELK log management plugin

Hi Ivan – well done and good work!

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 27/07/2018, 11:11, "Ivan Kudryavtsev"  wrote:

Dear CloudStack community,

Today we announce the first public release of CloudStack plugin for virtual
machines log management. The plugin uses ELK stack (specifically Filebeat,
Logstash, Elasticsearch) to gather, organize and access virtual machines
log through Apache CloudStack API.

We publish the plugin under the Apache 2 License and will be happy if you
find the product useful. If ApacheCloudStack community and leaders welcome
inclusion of the plugin in the main source tree, then we will be happy to
do it. However, now, It's delivered as a separate plug-in which can be
deployed as a prebuilt JAR or compiled by the interested user him/herself.

As for UI, we are out of capacity for UI development and unable to provide
the plugin with the UI but If someone could write UI part of it. We are
ready to collaborate and help with it.

Project link, source code and documentation:
https://github.com/bwsw/cloud-plugin-vm-logs



-- 
With best regards, Ivan Kudryavtsev
Bitworks Software, Ltd.
Cell: +7-923-414-1515
WWW: http://bitworks.software/ 



dag.sonst...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
  
 

CEPH / CloudStack features

[Dag Sonstebo]

Hi all,

I’m trying to find out more about CEPH compatibility with CloudStack / KVM – 
i.e. trying to put together a feature matrix of what works  and what doesn’t 
compared to NFS (or other block storage platforms).
There’s not a lot of up to date information on this – the configuration guide 
on [1] is all I’ve located so far apart from a couple of one-liners in the 
official documentation.

Could I get some feedback from the Ceph users in the community?

Regards,
Dag Sonstebo

[1] http://docs.ceph.com/docs/master/rbd/rbd-cloudstack/

dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: CloudStack ELK log management plugin

[Dag Sonstebo]

Hi Ivan – well done and good work!

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 27/07/2018, 11:11, "Ivan Kudryavtsev"  wrote:

Dear CloudStack community,

Today we announce the first public release of CloudStack plugin for virtual
machines log management. The plugin uses ELK stack (specifically Filebeat,
Logstash, Elasticsearch) to gather, organize and access virtual machines
log through Apache CloudStack API.

We publish the plugin under the Apache 2 License and will be happy if you
find the product useful. If ApacheCloudStack community and leaders welcome
inclusion of the plugin in the main source tree, then we will be happy to
do it. However, now, It's delivered as a separate plug-in which can be
deployed as a prebuilt JAR or compiled by the interested user him/herself.

As for UI, we are out of capacity for UI development and unable to provide
the plugin with the UI but If someone could write UI part of it. We are
ready to collaborate and help with it.

Project link, source code and documentation:
https://github.com/bwsw/cloud-plugin-vm-logs



-- 
With best regards, Ivan Kudryavtsev
Bitworks Software, Ltd.
Cell: +7-923-414-1515
WWW: http://bitworks.software/ 



dag.sonst...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

CloudStack ELK log management plugin

[Ivan Kudryavtsev]

Dear CloudStack community,

Today we announce the first public release of CloudStack plugin for virtual
machines log management. The plugin uses ELK stack (specifically Filebeat,
Logstash, Elasticsearch) to gather, organize and access virtual machines
log through Apache CloudStack API.

We publish the plugin under the Apache 2 License and will be happy if you
find the product useful. If ApacheCloudStack community and leaders welcome
inclusion of the plugin in the main source tree, then we will be happy to
do it. However, now, It's delivered as a separate plug-in which can be
deployed as a prebuilt JAR or compiled by the interested user him/herself.

As for UI, we are out of capacity for UI development and unable to provide
the plugin with the UI but If someone could write UI part of it. We are
ready to collaborate and help with it.

Project link, source code and documentation:
https://github.com/bwsw/cloud-plugin-vm-logs



-- 
With best regards, Ivan Kudryavtsev
Bitworks Software, Ltd.
Cell: +7-923-414-1515
WWW: http://bitworks.software/