ACS 4.8 + Xen / XenServer + Ceph

[(IMIS) Enzo Bettini]

Hi,

I have been doing a lot of searching to find out or work out how to get 
ACS 4.8 to work with XenServer 6.5 with a Ceph backend.
Currently I am only able to find outdated articles with experimental 
code being tested.


A little background:

We currently have a number of servers running CentOS 7 as KVM 
hypervisors with ACS 4.8 installed on a separate server (also CentOS 7).
The issue we have is that there is a bug in ACS where the disk cache 
mechanism for virtual disks is not being pushed through to the database 
or to the virtual machine.


Each host has 4 NICs. 2x 1Gbps and 2x 10Gbps.
Each pair of NICs is bonded together. Public, Guest and Ceph traffic is 
run on the 10Gbps bonded NICs.

Management and ACS Storage traffic is run on the 1Gbps NICs.

We have been informed that this is working with XenServer? However, we 
have been unable to get XenServer to play nice.
After installing XenServer and updating the network so that we have 
access to it. We are able to add the server to the XenServer cluster 
which was created.

But we are unable to deploy a VM on the newly added XenServer.

We have 2 primary storage options available. 1) NFS and 2) RBD. Neither 
one of the two are working.

We would prefer to use the RBD primary storage though.

The error we receive is that the host is unable to connect to primary 
storage [ID].


Are there guides or steps available to get this working?

We have also attempted to use the Xen Hypervisor installed on CentOS 7 
instead of XenServer, though that was until we read that ACS does not 
support the Xen Hypervisor on its own and only supports XenServer 5.6 
SP2 to 6.5 SP1.


Is XenServer the correct hypervisor to choose for an ACS and Ceph setup? 
Or is there a more preferred hypervisor?


Regards,
Enzo

VPN

[(IMIS) Enzo Bettini]

Hi Guys,

Does anyone have additional information related to the Remote Access VPN 
and the Site to Site VPN features in CloudStack, apart from what is 
available within the documentation.


The type of things I'm looking for is configuration examples within CS, 
and configuration examples from the client side. The client side is 
typically Linux based.
There does not seem to be a lot of information related to VPNs and CS. 
Is the feature not fully supported yet or something?


When connecting a private cloud to a public cloud, would it be best to:

1) Use a client / server VPN, i.e. have the public cloud be a client 
connecting to the server in the private cloud

2) Use a site to site VPN to connect the two sites / clouds

Thanks and Regards,
Enzo

Re: KVM disk cache option has no effect

[(IMIS) Enzo Bettini]

hin|
|
+---+-+--+-+-++
28 rows in set (0.00 sec)



| 151 | 4 | test_cache| a6c0b591-0ca7-4938-91f4-8ed961f490b6 | test_cache
  |  0 | Disk | NULL |  0 |  0 | NULL  |  0 |  1 | NULL | 2016-08-25
06:35:07 | 0 |1 | NULL | NULL | NULL |  NULL |  NULL | NULL | NULL
| Active   | NULL |writeback | thin  |


Can you show the structure of the table disk_offerings_view?


2016-08-25 15:06 GMT+03:00 Andrija Panic <andrija.pa...@gmail.com>:


Example (2 volumes on RBD,1 volume on NFS) - 4.5.1, Ubutnu 14.04


   
   
 
   
   
 
   
   
   
 41943040
 20971520
 100
 100
   
   
   
 
 
   
   
 
   
   
 
   
   
   
 125829120
 125829120
 1000
 1000
   
   
   
 
 
   
   
   
   
 125829120
 125829120
 1000
 1000
   
   

On 25 August 2016 at 14:02, Andrija Panic <andrija.pa...@gmail.com> wrote:


Guys, I', on 4.5.1, Ubuntu 14.04, and when I edit this field in
disk_offerings_view, it does work, and  ps aux | grep qemu clearly shows
cache=writeback

so this might be broken later, and would be good to understand when
exactly, since we plan upgrade soon to 4.8 release...

cheers

On 25 August 2016 at 11:09, Andrei Mikhailovsky

<and...@arhont.com.invalid

wrote:
I've experimented by using virsh and virtual-manager gui app. The acs

gui

settings make no difference to the cache settings. I am surprised it has
not been working for ages and no one actually fixed it.

Cheers

- Original Message -----

From: "(IMIS) Enzo Bettini" <enz...@imisglobal.com>
To: "users" <users@cloudstack.apache.org>
Sent: Wednesday, 24 August, 2016 09:24:50
Subject: Re: KVM disk cache option has no effect
Hi Andrei,

How did you get around this? Did you manually update the VM
configuration using virsh edit?

Regards,
Enzo

On 15/05/2016 00:31, Andrei Mikhailovsky wrote:

Not as far as I know (. The ticket status is closed

Andrei

- Original Message -

From: "Simon Weller" <swel...@ena.com>
To: "users" <users@cloudstack.apache.org>
Sent: Thursday, 12 May, 2016 14:38:35
Subject: Re: KVM disk cache option has no effect
All,

Is there a current issue in Jira on this?

- Si






From: Yuriy Karpel <yu...@karpel.su>
Sent: Thursday, May 12, 2016 7:07 AM
To: users@cloudstack.apache.org
Subject: Re: KVM disk cache option has no effect

The same function does not work on centos + ceph. CloudStack 4.7.1

2016-05-12 14:29 GMT+03:00 Andrei Mikhailovsky <and...@arhont.com>:


Hi Shweta,

thanks for your findings. I am very much surprised to see this was

not

discovered earlier, especially since this feature has been

implemented many

versions back (back in version 4.4 or 4.5 i think). I was under the
impression that people are testing and reporting on the new

features

before

they hit the release, which apparently is not the case, at least

for

some

new features. From what I can see this feature was completed about

a

year

ago.

I've tried to reopen this issue, but i don't have the rights due to

the

Jira being in a temporary Lockdown mode.

Could someone with the right access reopen this issue on the

grounds

that

it was reported (by at least two individuals) that this feature is

not

working.

Many thanks

Andrei

- Original Message -

From: "Shweta Agarwal" <shweta.agarw...@accelerite.com>
To: "users" <users@cloudstack.apache.org>
Sent: Thursday, 12 May, 2016 12:02:59
Subject: RE: KVM disk cache option has no effect
Hi Andrei,

Few days back I was also doing some testing in this area and then

we

found out

that cache field in disk offering is just a UI or API parameter.

But in

actual

implementation of the API we are just neglecting this parameter .

So

effectively these parameters in disk offering does nothing  .

Thanks
Shweta

-Original Message-
From: Andrei Mikhailovsky [mailto:and...@arhont.com]
Sent: Thursday, May 12, 2016 4:07 PM
To: users
Subject: KVM disk cache option has no effect

Hello

I've been trying to use cache = writeback option for my KVM

hypervisor

with ceph

backend storage. However, when I am launching a vm that uses the

disk

offering

with cache=writeback, the cache setting is still set to =none

according

to the

ps aux command.The same applies to the root as well as additional

data

volumes.

I am using ACS 4.7.1, both management and hypervisor servers are

Ubuntu

14.04.

Could someone please advise on how enable writeback cache?

Cheers

Andrei





DISCLAIMER
==
This e-mail may contain privileged and confidential information

which is

the

property of Accelerite, a Persistent Systems business. It is

intended

only for

the use of the individu

Re: KVM disk cache option has no effect

[(IMIS) Enzo Bettini]

Hi,

I can confirm the same behavior on CentOS 7.2.1511 with CloudStack 4.8.0.

Regards,
Enzo

On 25/08/2016 09:42, Andrei Mikhailovsky wrote:

I've noticed the same behaviour on kvm with ubuntu 14.04 servers on acs 4.7.1.1

Andrei

- Original Message -

From: "Yuriy Karpel" <yu...@karpel.su>
To: "users" <users@cloudstack.apache.org>
Sent: Thursday, 25 August, 2016 07:58:56
Subject: Re: KVM disk cache option has no effect
CentOS management and kvm node, Cloudstack 4.7.1, Storage RBD.

Added value in the table, UI shows that the caching policy WB:

151 4 test_cache a6c0b591-0ca7-4938-91f4-8ed961f490b6 test_cache 0 Disk
(null) 0 0 (null) 0 1 (null) 25.08.2016 6:35:07 0 1 (null) (null) (null)
(null) (null) (null) (null) Active (null) writeback thin



Created drive and connected it to the VM, the cache setting is "none":


  
  

  
  

  
  
  
  59053122a71145d5a801
  
  






2016-08-24 17:27 GMT+03:00 Andrija Panic <andrija.pa...@gmail.com>:


Hi Enzo,

just go to table/view "disk_offering_view" and in the field "cache_mode"
insert "writeback" value

Be aware, that if using writeback cache with CEPH - this is not really
needed, and perhaps better to use RBD cache on ceph.conf on KVM side...
Also note, with writeback cache set - if using NFS as storage - live
migrations will not work !
With ceph and writeback cache, live migration works (libvirt limitation,
you can google it).

Best,
Andrija

On 24 August 2016 at 10:24, (IMIS) Enzo Bettini <enz...@imisglobal.com>
wrote:


Hi Andrei,

How did you get around this? Did you manually update the VM configuration
using virsh edit?

Regards,
Enzo


On 15/05/2016 00:31, Andrei Mikhailovsky wrote:


Not as far as I know (. The ticket status is closed

Andrei

- Original Message -


From: "Simon Weller" <swel...@ena.com>
To: "users" <users@cloudstack.apache.org>
Sent: Thursday, 12 May, 2016 14:38:35
Subject: Re: KVM disk cache option has no effect
All,

Is there a current issue in Jira on this?

- Si






From: Yuriy Karpel <yu...@karpel.su>
Sent: Thursday, May 12, 2016 7:07 AM
To: users@cloudstack.apache.org
Subject: Re: KVM disk cache option has no effect

The same function does not work on centos + ceph. CloudStack 4.7.1

2016-05-12 14:29 GMT+03:00 Andrei Mikhailovsky <and...@arhont.com>:

Hi Shweta,

thanks for your findings. I am very much surprised to see this was not
discovered earlier, especially since this feature has been implemented
many
versions back (back in version 4.4 or 4.5 i think). I was under the
impression that people are testing and reporting on the new features
before
they hit the release, which apparently is not the case, at least for
some
new features. From what I can see this feature was completed about a
year
ago.

I've tried to reopen this issue, but i don't have the rights due to

the

Jira being in a temporary Lockdown mode.

Could someone with the right access reopen this issue on the grounds
that
it was reported (by at least two individuals) that this feature is not
working.

Many thanks

Andrei

- Original Message -


From: "Shweta Agarwal" <shweta.agarw...@accelerite.com>
To: "users" <users@cloudstack.apache.org>
Sent: Thursday, 12 May, 2016 12:02:59
Subject: RE: KVM disk cache option has no effect
Hi Andrei,

Few days back I was also doing some testing in this area and then we


found out


that cache field in disk offering is just a UI or API parameter. But

in

actual


implementation of the API we are just neglecting this parameter . So
effectively these parameters in disk offering does nothing  .

Thanks
Shweta

-Original Message-
From: Andrei Mikhailovsky [mailto:and...@arhont.com]
Sent: Thursday, May 12, 2016 4:07 PM
To: users
Subject: KVM disk cache option has no effect

Hello

I've been trying to use cache = writeback option for my KVM

hypervisor

with ceph


backend storage. However, when I am launching a vm that uses the disk


offering


with cache=writeback, the cache setting is still set to =none

according

to the


ps aux command.The same applies to the root as well as additional

data

volumes.


I am using ACS 4.7.1, both management and hypervisor servers are

Ubuntu

14.04.


Could someone please advise on how enable writeback cache?

Cheers

Andrei





DISCLAIMER
==
This e-mail may contain privileged and confidential information which
is


the


property of Accelerite, a Persistent Systems business. It is intended


only for


the use of the individual or entity to which it is addressed. If you
are


not


the intended recipient, you are not authorized to read, retain, copy,


print,


distribute or use this message. If you have received this

communication

in


error, please notify the sender and delete all copies of this

message.

Accelerite, a Persistent Systems business does not accept any

liability

for


virus infected mails.



--

Andrija Panić

Re: KVM disk cache option has no effect

[(IMIS) Enzo Bettini]

Hi Andrei,

How did you get around this? Did you manually update the VM 
configuration using virsh edit?


Regards,
Enzo

On 15/05/2016 00:31, Andrei Mikhailovsky wrote:

Not as far as I know (. The ticket status is closed

Andrei

- Original Message -

From: "Simon Weller" 
To: "users" 
Sent: Thursday, 12 May, 2016 14:38:35
Subject: Re: KVM disk cache option has no effect
All,

Is there a current issue in Jira on this?

- Si






From: Yuriy Karpel 
Sent: Thursday, May 12, 2016 7:07 AM
To: users@cloudstack.apache.org
Subject: Re: KVM disk cache option has no effect

The same function does not work on centos + ceph. CloudStack 4.7.1

2016-05-12 14:29 GMT+03:00 Andrei Mikhailovsky :


Hi Shweta,

thanks for your findings. I am very much surprised to see this was not
discovered earlier, especially since this feature has been implemented many
versions back (back in version 4.4 or 4.5 i think). I was under the
impression that people are testing and reporting on the new features before
they hit the release, which apparently is not the case, at least for some
new features. From what I can see this feature was completed about a year
ago.

I've tried to reopen this issue, but i don't have the rights due to the
Jira being in a temporary Lockdown mode.

Could someone with the right access reopen this issue on the grounds that
it was reported (by at least two individuals) that this feature is not
working.

Many thanks

Andrei

- Original Message -

From: "Shweta Agarwal" 
To: "users" 
Sent: Thursday, 12 May, 2016 12:02:59
Subject: RE: KVM disk cache option has no effect
Hi Andrei,

Few days back I was also doing some testing in this area and then we

found out

that cache field in disk offering is just a UI or API parameter. But in

actual

implementation of the API we are just neglecting this parameter . So
effectively these parameters in disk offering does nothing  .

Thanks
Shweta

-Original Message-
From: Andrei Mikhailovsky [mailto:and...@arhont.com]
Sent: Thursday, May 12, 2016 4:07 PM
To: users
Subject: KVM disk cache option has no effect

Hello

I've been trying to use cache = writeback option for my KVM hypervisor

with ceph

backend storage. However, when I am launching a vm that uses the disk

offering

with cache=writeback, the cache setting is still set to =none according

to the

ps aux command.The same applies to the root as well as additional data

volumes.

I am using ACS 4.7.1, both management and hypervisor servers are Ubuntu

14.04.


Could someone please advise on how enable writeback cache?

Cheers

Andrei





DISCLAIMER
==
This e-mail may contain privileged and confidential information which is

the

property of Accelerite, a Persistent Systems business. It is intended

only for

the use of the individual or entity to which it is addressed. If you are

not

the intended recipient, you are not authorized to read, retain, copy,

print,

distribute or use this message. If you have received this communication

in

error, please notify the sender and delete all copies of this message.
Accelerite, a Persistent Systems business does not accept any liability

for

virus infected mails.

Re: Testing Guest network

[(IMIS) Enzo Bettini]

Hi,

In case someone else has the same or similar issue.
We found (with Glenn's assistance) that the bridge interface for the 
guest network was not being brought up automatically.


We are waiting for more information as to why this is happening.

Regards,
Enzo

On 27/04/2016 20:44, (IMIS) Enzo Bettini wrote:

Hi,

We currently have CloudStack 4.8 installed on 12 CentOS 7.2 servers.
1 of these servers is being used as the management server.

We have been able to get the SSVM, CPVM and VR up and running, 
however, when a VM is created it does not have access to the given 
gateway (VR).


Is there a way to test that the guest network is sending packets 
correctly across the network?


I have manually created a VLAN on each server to ensure VLANs are 
working on the network, though I am unsure of whether or not the CS 
created VLAN interfaces are working correctly.


Any advice would be great and let me know if you need further 
information.


Regards,
Enzo

Testing Guest network

[(IMIS) Enzo Bettini]

Hi,

We currently have CloudStack 4.8 installed on 12 CentOS 7.2 servers.
1 of these servers is being used as the management server.

We have been able to get the SSVM, CPVM and VR up and running, however, 
when a VM is created it does not have access to the given gateway (VR).


Is there a way to test that the guest network is sending packets 
correctly across the network?


I have manually created a VLAN on each server to ensure VLANs are 
working on the network, though I am unsure of whether or not the CS 
created VLAN interfaces are working correctly.


Any advice would be great and let me know if you need further information.

Regards,
Enzo