Re: Management server reboot appears to cause vms on other hosts to shutdown?

2021-06-28 Thread Brian Fitzpatrick
ah...

Thanks Andrija that's good to know!

much appreciated

Brian


-Original Message-
From: Andrija Panic 
mailto:andrija%20panic%20%3candrija.pa...@gmail.com%3e>>
Reply-To: users@cloudstack.apache.org
To: users 
mailto:users%20%3cus...@cloudstack.apache.org%3e>>
Subject: Re: Management server reboot appears to cause vms on other hosts to 
shutdown?
Date: Mon, 28 Jun 2021 19:12:32 +0200


CAUTION !


This email was NOT sent using a University of Chester account, so we are unable 
to verify the identity of the sender. Do not click links or open attachments 
unless you recognise the sender and know the content is safe.


=



Each (KVM) cloudstacl agent executes a heartbeat script (every 1min or so),

trying to write to a primary NFS server, ensuring it has the connectivity

working.


If this heartbeat fails - agent will say - "ok I'm stupid and less

reliable, NFS storage must be HA, so let me reboot myself/host in order to

regain access to NFS" (which is on your mgmt server)


/usr/lib64/cloud/agent/scripts/vm/hypervisor/kvm/kvmheartbeat.sh


Comment the line " echo b > /proc/sysrq-trigger " and KVM agent will NOT

reboot itself when NFS is unavailable. Something that is also wise to do in

production as well (trust me ... )



Cheers,



On Mon, 28 Jun 2021 at 18:57, Brian Fitzpatrick <



b.fitzpatr...@chester.ac.uk

>

wrote:


Hi Andrija,


Thanks for the reply


There is NFS primary storage on the management server but it doesn't have

any vm volumes on it, they are on other NFS primary servers.


So I thought I should have been safe to reboot


All vms on other hosts, vm volumes on other nfs shares living on other

servers, system vms and routers also on other servers


So all (I am fairly certain) that was on the server I rebooted was the one

and only Management server and mysql


Thanks


Brian


-Original Message-

From: Andrija Panic <



andrija.pa...@gmail.com

mailto:andrija%20panic%20%3candrija.pa...@gmail.com>

andrija%20panic%20%3candrija.pa...@gmail.com

%3e>>

Reply-To:



users@cloudstack.apache.org

mailto:users@cloudstack.apache.org>

users@cloudstack.apache.org

>

To: users <



users@cloudstack.apache.org

mailto:users%20%3cus...@cloudstack.apache.org>

users%20%3cus...@cloudstack.apache.org

%3e>>

Subject: Re: Management server reboot appears to cause vms on other hosts

to shutdown?

Date: Mon, 28 Jun 2021 17:44:57 +0200



CAUTION !



This email was NOT sent using a University of Chester account, so we are

unable to verify the identity of the sender. Do not click links or open

attachments unless you recognise the sender and know the content is safe.



=




NFS primary storage also on your management server?



On Sat, 26 Jun 2021 at 10:36, Brian Fitzpatrick <


mailto:b.fitzpatr...@chester.ac.uk>

b.fitzpatr...@chester.ac.uk

>




b.fitzpatr...@chester.ac.uk





wrote:



Hi Jordan,



Thanks for your reply. Apologies I might not have been clear.



The management server is aware of the vm and when I set the host that is


also the same server that is running the management server (and mysql) into


maintenance mode, I can see it not longer has any running vms on it. They


have migrated to other hosts. Cloud stack can see them. Bu when I then to


an apt update and reboot the management server, the vms on the other hosts


seem to have shutdown.



The reboot did take a while (15-20 mins), but I am surprised that it has


affected other kvm hosts, which I thought should just carry on running.


Unless I have missed something that was still on the management(and mysql)


server.



Thanks



Brian



-Original Message-


From: Yordan Kostov <


mailto:yord...@nsogroup.com>

yord...@nsogroup.com

>




yord...@nsogroup.com



mailto:yordan%20kostov%20%3cyord...@nsogroup.com>

yordan%20kostov%20%3cyord...@nsogroup.com

>




yordan%20kostov%20%3cyord...@nsogroup.com



%3e>>


Reply-To:


mailto:users@cloudstack.apache.org>

users@cloudstack.apache.org

>




users@cloudstack.apache.org



mailto:users@cloudstack.apache.org>

users@cloudstack.apache.org

>




users@cloudstack.apache.org





To:


mailto:users@cloudstack.apache.org>

users@cloudstack.apache.org

>




users@cloudstack.apache.org



 <


mailto:users@cloudstack.apache.org>

users@cloudstack.apache.org

>




users@cloudstack.apache.org



mailto:22us...@cloudstack.apache.org>

22us...@cloudstack.apache.org

>




22us...@cloudstack.apache.org



mailto:%22%20%3cus...@cloudstack.apache.org>


Re: Management server reboot appears to cause vms on other hosts to shutdown?

2021-06-28 Thread Andrija Panic
Each (KVM) cloudstacl agent executes a heartbeat script (every 1min or so),
trying to write to a primary NFS server, ensuring it has the connectivity
working.

If this heartbeat fails - agent will say - "ok I'm stupid and less
reliable, NFS storage must be HA, so let me reboot myself/host in order to
regain access to NFS" (which is on your mgmt server)

/usr/lib64/cloud/agent/scripts/vm/hypervisor/kvm/kvmheartbeat.sh

Comment the line " echo b > /proc/sysrq-trigger " and KVM agent will NOT
reboot itself when NFS is unavailable. Something that is also wise to do in
production as well (trust me ... )


Cheers,


On Mon, 28 Jun 2021 at 18:57, Brian Fitzpatrick 
wrote:

> Hi Andrija,
>
> Thanks for the reply
>
> There is NFS primary storage on the management server but it doesn't have
> any vm volumes on it, they are on other NFS primary servers.
>
> So I thought I should have been safe to reboot
>
> All vms on other hosts, vm volumes on other nfs shares living on other
> servers, system vms and routers also on other servers
>
> So all (I am fairly certain) that was on the server I rebooted was the one
> and only Management server and mysql
>
> Thanks
>
> Brian
>
> -Original Message-
> From: Andrija Panic  andrija%20panic%20%3candrija.pa...@gmail.com%3e>>
> Reply-To: users@cloudstack.apache.org
> To: users  users%20%3cus...@cloudstack.apache.org%3e>>
> Subject: Re: Management server reboot appears to cause vms on other hosts
> to shutdown?
> Date: Mon, 28 Jun 2021 17:44:57 +0200
>
>
> CAUTION !
>
>
> This email was NOT sent using a University of Chester account, so we are
> unable to verify the identity of the sender. Do not click links or open
> attachments unless you recognise the sender and know the content is safe.
>
>
> =
>
>
>
> NFS primary storage also on your management server?
>
>
> On Sat, 26 Jun 2021 at 10:36, Brian Fitzpatrick <
>
> 
>
> b.fitzpatr...@chester.ac.uk
>
> >
>
> wrote:
>
>
> Hi Jordan,
>
>
> Thanks for your reply. Apologies I might not have been clear.
>
>
> The management server is aware of the vm and when I set the host that is
>
> also the same server that is running the management server (and mysql) into
>
> maintenance mode, I can see it not longer has any running vms on it. They
>
> have migrated to other hosts. Cloud stack can see them. Bu when I then to
>
> an apt update and reboot the management server, the vms on the other hosts
>
> seem to have shutdown.
>
>
> The reboot did take a while (15-20 mins), but I am surprised that it has
>
> affected other kvm hosts, which I thought should just carry on running.
>
> Unless I have missed something that was still on the management(and mysql)
>
> server.
>
>
> Thanks
>
>
> Brian
>
>
> -Original Message-
>
> From: Yordan Kostov <
>
> 
>
> yord...@nsogroup.com
>
> 
> 
>
> yordan%20kostov%20%3cyord...@nsogroup.com
>
> %3e>>
>
> Reply-To:
>
> 
>
> users@cloudstack.apache.org
>
> 
> 
>
> users@cloudstack.apache.org
>
> >
>
> To:
>
> 
>
> users@cloudstack.apache.org
>
>  <
>
> 
>
> users@cloudstack.apache.org
>
> 
> 
>
> 22us...@cloudstack.apache.org
>
> 
>
> %22%20%3cus...@cloudstack.apache.org
>
> %3e>>
>
> Subject: RE: Management server reboot appears to cause vms on other hosts
>
> to shutdown?
>
> Date: Fri, 25 Jun 2021 09:10:44 +
>
>
>
> CAUTION !
>
>
>
> This email was NOT sent using a University of Chester account, so we are
>
> unable to verify the identity of the sender. Do not click links or open
>
> attachments unless you recognise the sender and know the content is safe.
>
>
>
> =
>
>
>
>
> Hello Brian,
>
>
>
> May be I did not understand very well but from what you say I get
>
> that the management server + SQL and NFS are on the same physical hosts
>
> that are being managed by cloudstack?
>
>
> If those VMs are not visible in Cloudstack, the system is not
>
> aware that they exist so it wont try to roll them to another host if you
>
> perform hypervisor host reboot.
>
>
>
> Best regards,
>
>
> Jordan
>
>
>
> -Original Message-
>
>
> From: Brian Fitzpatrick <
>
>
> 
> 
>
> b.fitzpatr...@chester.ac.uk
>
> >
>
>
> 
>
> b.fitzpatr...@chester.ac.uk
>
>
>
>
>
> Sent: Friday, June 25, 2021 12:06 PM
>
>
> To:
>
>
> 
> 
>
> users@cloudstack.apache.org
>
> >
>
>
> 
>
> users@cloudstack.apache.org
>
>
>
>
> Subject: Management server reboot appears to cause vms on other hosts to
>
> shutdown?
>
>
>
>
> [X] This message came from outside your organization
>
>
>
>
> Hi 

Re: Management server reboot appears to cause vms on other hosts to shutdown?

2021-06-28 Thread Brian Fitzpatrick
Hi Andrija,

Thanks for the reply

There is NFS primary storage on the management server but it doesn't have any 
vm volumes on it, they are on other NFS primary servers.

So I thought I should have been safe to reboot

All vms on other hosts, vm volumes on other nfs shares living on other servers, 
system vms and routers also on other servers

So all (I am fairly certain) that was on the server I rebooted was the one and 
only Management server and mysql

Thanks

Brian

-Original Message-
From: Andrija Panic 
mailto:andrija%20panic%20%3candrija.pa...@gmail.com%3e>>
Reply-To: users@cloudstack.apache.org
To: users 
mailto:users%20%3cus...@cloudstack.apache.org%3e>>
Subject: Re: Management server reboot appears to cause vms on other hosts to 
shutdown?
Date: Mon, 28 Jun 2021 17:44:57 +0200


CAUTION !


This email was NOT sent using a University of Chester account, so we are unable 
to verify the identity of the sender. Do not click links or open attachments 
unless you recognise the sender and know the content is safe.


=



NFS primary storage also on your management server?


On Sat, 26 Jun 2021 at 10:36, Brian Fitzpatrick <



b.fitzpatr...@chester.ac.uk

>

wrote:


Hi Jordan,


Thanks for your reply. Apologies I might not have been clear.


The management server is aware of the vm and when I set the host that is

also the same server that is running the management server (and mysql) into

maintenance mode, I can see it not longer has any running vms on it. They

have migrated to other hosts. Cloud stack can see them. Bu when I then to

an apt update and reboot the management server, the vms on the other hosts

seem to have shutdown.


The reboot did take a while (15-20 mins), but I am surprised that it has

affected other kvm hosts, which I thought should just carry on running.

Unless I have missed something that was still on the management(and mysql)

server.


Thanks


Brian


-Original Message-

From: Yordan Kostov <



yord...@nsogroup.com

mailto:yordan%20kostov%20%3cyord...@nsogroup.com>

yordan%20kostov%20%3cyord...@nsogroup.com

%3e>>

Reply-To:



users@cloudstack.apache.org

mailto:users@cloudstack.apache.org>

users@cloudstack.apache.org

>

To:



users@cloudstack.apache.org

 <



users@cloudstack.apache.org

mailto:22us...@cloudstack.apache.org>

22us...@cloudstack.apache.org



%22%20%3cus...@cloudstack.apache.org

%3e>>

Subject: RE: Management server reboot appears to cause vms on other hosts

to shutdown?

Date: Fri, 25 Jun 2021 09:10:44 +



CAUTION !



This email was NOT sent using a University of Chester account, so we are

unable to verify the identity of the sender. Do not click links or open

attachments unless you recognise the sender and know the content is safe.



=




Hello Brian,



May be I did not understand very well but from what you say I get

that the management server + SQL and NFS are on the same physical hosts

that are being managed by cloudstack?


If those VMs are not visible in Cloudstack, the system is not

aware that they exist so it wont try to roll them to another host if you

perform hypervisor host reboot.



Best regards,


Jordan



-Original Message-


From: Brian Fitzpatrick <


mailto:b.fitzpatr...@chester.ac.uk>

b.fitzpatr...@chester.ac.uk

>




b.fitzpatr...@chester.ac.uk





Sent: Friday, June 25, 2021 12:06 PM


To:


mailto:users@cloudstack.apache.org>

users@cloudstack.apache.org

>




users@cloudstack.apache.org




Subject: Management server reboot appears to cause vms on other hosts to

shutdown?




[X] This message came from outside your organization




Hi all,



Still relatively new to CloudStack and learning, testing etc.



I have created 1 management server with mysql on it and created 2 clusters

with a nfs primary storage server in each and a number of hosts in each.



I have been working through the servers, putting them in maintenance mode

(noting the vm migrations), updating and rebooting them. All working fine



I then wanted to update and reboot the server running the management and

mysql. It is also a host, so I set it in maintenance mode so no vms running

on it.



I thought if I update it and reboot, all I would lose for a period of time

was access to the management server, the vms should keep running on their

various hosts



The reboot, took longer than usual, it seemed to hang for 15-20mins before

shutting down and rebooting. To my surprise though I lost contact to all

the vms on the other hosts.



They all shut down.



Apologies, if I have missed something here, I thought I understood. All

virtual routers and system vms 

Re: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Andrija Panic
my bad, wrongly understood you are using no-VNC.

Try migrating the target VM and the SSVM to the same host, and try again
then - is there any improvement?

Best,

On Mon, 28 Jun 2021 at 17:58, Adam Witwicki  wrote:

>
> I don’t have that option in CS version 4.13.1.0, This is the old VNC way
> is it not?
>
> Thanks
>
> Adam
>
> -Original Message-
> From: Andrija Panic 
> Sent: 28 June 2021 16:55
> To: users 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network. Treat
> hyperlinks and attachments in this email with caution. **
>
> Did you try switching back to VNC-based access - i.e. modify the global
> setting novnc.console.default=false and see if the old VNC way works fine.
>
> Best,
>
> On Mon, 28 Jun 2021 at 17:49, Adam Witwicki 
> wrote:
>
> > Hi Andrija
> >
> > Yes, no issues accessing the VNC port directly on the KVM server.
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Andrija Panic 
> > Sent: 28 June 2021 16:48
> > To: users 
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Adam,
> >
> > "
> > Adam,
> >
> > did you try accessing the VM console via standalone VNC viewer, based
> > on the way Rohit explained  - dump the XML of the VM, check the
> > IP/port and password details - and use those to access
> >  and see if that connections is established quick
> enough.
> >
> > Best,
> > "
> >
> > Best,
> >
> > On Mon, 28 Jun 2021 at 11:32, Adam Witwicki 
> > wrote:
> >
> > > Am I able to get some help with this?
> > >
> > > Cloudstack really is unusable
> > > Is it related to the speed issues with SSL?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > > -Original Message-
> > > From: Adam Witwicki
> > > Sent: 07 June 2021 14:08
> > > To: users@cloudstack.apache.org
> > > Subject: RE: VM console keeps pausing to the point of being unusable
> > >
> > > Forgive me if I am wrong
> > >
> > > But this is where the exception lies
> > > https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b
> > > 9a
> > > 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/c
> > > on
> > > soleproxy/vnc/VncClientPacketSender.java#L42
> > > private final BlockingQueue queue = new
> > > ArrayBlockingQueue(30);
> > >
> > > I guess I need to understand why objects are not leaving the queue?
> > >
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > > -Original Message-
> > > From: Adam Witwicki 
> > > Sent: 07 June 2021 11:49
> > > To: users@cloudstack.apache.org
> > > Subject: RE: VM console keeps pausing to the point of being unusable
> > >
> > > ** This mail originated from OUTSIDE the Oakford corporate network.
> > > Treat hyperlinks and attachments in this email with caution. **
> > >
> > > Rohit, sorry the long delay
> > >
> > > Yes all servers and VMs are in time sync.
> > > It does seem to be an issue with the console proxy, no attempt of
> > > increasing its resources is improving the situation.
> > > What else can we try?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > > -Original Message-
> > > From: Rohit Yadav 
> > > Sent: 05 May 2021 09:21
> > > To: users@cloudstack.apache.org
> > > Subject: Re: VM console keeps pausing to the point of being unusable
> > >
> > > ** This mail originated from OUTSIDE the Oakford corporate network.
> > > Treat hyperlinks and attachments in this email with caution. **
> > >
> > > Hi Adam - can you check and sync time on your KVM hosts, management
> > > servers and CPVM using ntp? This is because SSL-enabled connection
> > > are time sensitive.
> > > In order to test VNC directly, you can ssh into the host and do
> > > something
> > > like:
> > >
> > > # virsh list # find the VM
> > >
> > > Then run dumpxml and grab the IP/port and password, for example:
> > >
> > > # virsh dumpxml --security-info s-180-VM | grep vnc
> > >  listen='192.168.1.10'
> > > passwd='_u6LayCdnCrr_JuUwCrq2A'>
> > >
> > >
> > > If you're on the management network, you can use any VNC client and
> > > details you find to connect to the VNC directly. I often connect
> > > virt-manager (UI) to a KVM host over SSH and use the console
> > > directly (the only trick is to grab the password, by clicking the
> > > information tab -> go to VNC -> click on show password -> copy and
> > > use it to see
> > console).
> > >
> > >
> > > Regards.
> > >
> > > 
> > > From: David Jumani 
> > > Sent: Wednesday, May 5, 2021 10:32
> > > To: users@cloudstack.apache.org 
> > > Subject: Re: VM console keeps pausing to the point of being unusable
> > >
> > > I agree, try checking the number of concurrent connections as well
> > > as increasing the CPVM capacity.
> > > Also check the network for any glitches / lag between the CPVM and
> > > the KVM 

Re: AW: CloudStack and Ansible

2021-06-28 Thread Andrija Panic
For those of you who have VMware parent cloud, and need to build tons of
nested ACS envs for testing purposes (VMware, XC/XCP-ng, KVM), or at least
to examine some setup/code - those guys have some weird thing callied
Trillian ;)

https://github.com/shapeblue/trillian

A couple of thousands of nested environments built in last 3 years

Cheers.

On Sat, 26 Jun 2021 at 10:47, Rene Moser  wrote:

> Hi Peter
>
> On 25.06.21 10:55, peter.murysh...@zv.fraunhofer.de wrote:
> > Hi Rafael,
> >
> > as a follow-up to your great talk at the CSEUG session: in your email
> you wrote,
> >
> > "The Ansible implementation for ACS is very complete and robust. It made
> it possible for us to fully automate from metal to the service."
> >
> > Which Ansible implementation do you mean? The one I can find addresses
> rather API usage [1]; for full automation there is probably more scripting
> required to setup the actual
> > cluster, possibly with some variations depending on the architecture.
> >
> > [1]
> https://docs.ansible.com/ansible/latest/collections/ngine_io/cloudstack/index.html#plugins-in-ngine-io-cloudstack
> To provision your hardware, OS, and install cloudstack, like any other
> application, and dep services like DB, java, storage, nfs servers,
> firewall, networking (e.g. cisco switches), ansible is a perfect match
> but depending on your infra and choices.
>
> The cloudstack integration addresses the api usage only, it is the
> missing piece after you (automated) installed cloudstack to fully
> automate the configuration of the cloud.
>
> Hope this clarifies.
>
> Regards
> René
>


-- 

Andrija Panić


RE: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Adam Witwicki

I don’t have that option in CS version 4.13.1.0, This is the old VNC way is it 
not?

Thanks

Adam

-Original Message-
From: Andrija Panic 
Sent: 28 June 2021 16:55
To: users 
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Did you try switching back to VNC-based access - i.e. modify the global setting 
novnc.console.default=false and see if the old VNC way works fine.

Best,

On Mon, 28 Jun 2021 at 17:49, Adam Witwicki  wrote:

> Hi Andrija
>
> Yes, no issues accessing the VNC port directly on the KVM server.
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Andrija Panic 
> Sent: 28 June 2021 16:48
> To: users 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Adam,
>
> "
> Adam,
>
> did you try accessing the VM console via standalone VNC viewer, based
> on the way Rohit explained  - dump the XML of the VM, check the
> IP/port and password details - and use those to access
>  and see if that connections is established quick enough.
>
> Best,
> "
>
> Best,
>
> On Mon, 28 Jun 2021 at 11:32, Adam Witwicki 
> wrote:
>
> > Am I able to get some help with this?
> >
> > Cloudstack really is unusable
> > Is it related to the speed issues with SSL?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki
> > Sent: 07 June 2021 14:08
> > To: users@cloudstack.apache.org
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > Forgive me if I am wrong
> >
> > But this is where the exception lies
> > https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b
> > 9a
> > 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/c
> > on
> > soleproxy/vnc/VncClientPacketSender.java#L42
> > private final BlockingQueue queue = new
> > ArrayBlockingQueue(30);
> >
> > I guess I need to understand why objects are not leaving the queue?
> >
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki 
> > Sent: 07 June 2021 11:49
> > To: users@cloudstack.apache.org
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Rohit, sorry the long delay
> >
> > Yes all servers and VMs are in time sync.
> > It does seem to be an issue with the console proxy, no attempt of
> > increasing its resources is improving the situation.
> > What else can we try?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Rohit Yadav 
> > Sent: 05 May 2021 09:21
> > To: users@cloudstack.apache.org
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Hi Adam - can you check and sync time on your KVM hosts, management
> > servers and CPVM using ntp? This is because SSL-enabled connection
> > are time sensitive.
> > In order to test VNC directly, you can ssh into the host and do
> > something
> > like:
> >
> > # virsh list # find the VM
> >
> > Then run dumpxml and grab the IP/port and password, for example:
> >
> > # virsh dumpxml --security-info s-180-VM | grep vnc
> >  > passwd='_u6LayCdnCrr_JuUwCrq2A'>
> >
> >
> > If you're on the management network, you can use any VNC client and
> > details you find to connect to the VNC directly. I often connect
> > virt-manager (UI) to a KVM host over SSH and use the console
> > directly (the only trick is to grab the password, by clicking the
> > information tab -> go to VNC -> click on show password -> copy and
> > use it to see
> console).
> >
> >
> > Regards.
> >
> > 
> > From: David Jumani 
> > Sent: Wednesday, May 5, 2021 10:32
> > To: users@cloudstack.apache.org 
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > I agree, try checking the number of concurrent connections as well
> > as increasing the CPVM capacity.
> > Also check the network for any glitches / lag between the CPVM and
> > the KVM hosts 
> > From: Hean Seng 
> > Sent: Tuesday, May 4, 2021 4:03 PM
> > To: users@cloudstack.apache.org 
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > Do you know how many concurrent access to VNC  from your user ?
> >
> > Or you want to increase the Console Proxy Capacity?
> >
> > Also, please make sure the console proxy Ip/Network is up when you
> > having issue on it.
> >
> >
> >
> >
> > On Tue, May 4, 2021 at 5:43 PM Adam Witwicki
> > 
> > wrote:
> >
> > > This bug is making 

Re: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Andrija Panic
Did you try switching back to VNC-based access - i.e. modify the global
setting novnc.console.default=false and see if the old VNC way works fine.

Best,

On Mon, 28 Jun 2021 at 17:49, Adam Witwicki  wrote:

> Hi Andrija
>
> Yes, no issues accessing the VNC port directly on the KVM server.
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Andrija Panic 
> Sent: 28 June 2021 16:48
> To: users 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network. Treat
> hyperlinks and attachments in this email with caution. **
>
> Adam,
>
> "
> Adam,
>
> did you try accessing the VM console via standalone VNC viewer, based on
> the way Rohit explained  - dump the XML of the VM, check the IP/port and
> password details - and use those to access  and see if
> that connections is established quick enough.
>
> Best,
> "
>
> Best,
>
> On Mon, 28 Jun 2021 at 11:32, Adam Witwicki 
> wrote:
>
> > Am I able to get some help with this?
> >
> > Cloudstack really is unusable
> > Is it related to the speed issues with SSL?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki
> > Sent: 07 June 2021 14:08
> > To: users@cloudstack.apache.org
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > Forgive me if I am wrong
> >
> > But this is where the exception lies
> > https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a
> > 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/con
> > soleproxy/vnc/VncClientPacketSender.java#L42
> > private final BlockingQueue queue = new
> > ArrayBlockingQueue(30);
> >
> > I guess I need to understand why objects are not leaving the queue?
> >
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki 
> > Sent: 07 June 2021 11:49
> > To: users@cloudstack.apache.org
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Rohit, sorry the long delay
> >
> > Yes all servers and VMs are in time sync.
> > It does seem to be an issue with the console proxy, no attempt of
> > increasing its resources is improving the situation.
> > What else can we try?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Rohit Yadav 
> > Sent: 05 May 2021 09:21
> > To: users@cloudstack.apache.org
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Hi Adam - can you check and sync time on your KVM hosts, management
> > servers and CPVM using ntp? This is because SSL-enabled connection are
> > time sensitive.
> > In order to test VNC directly, you can ssh into the host and do
> > something
> > like:
> >
> > # virsh list # find the VM
> >
> > Then run dumpxml and grab the IP/port and password, for example:
> >
> > # virsh dumpxml --security-info s-180-VM | grep vnc
> >  > passwd='_u6LayCdnCrr_JuUwCrq2A'>
> >
> >
> > If you're on the management network, you can use any VNC client and
> > details you find to connect to the VNC directly. I often connect
> > virt-manager (UI) to a KVM host over SSH and use the console directly
> > (the only trick is to grab the password, by clicking the information
> > tab -> go to VNC -> click on show password -> copy and use it to see
> console).
> >
> >
> > Regards.
> >
> > 
> > From: David Jumani 
> > Sent: Wednesday, May 5, 2021 10:32
> > To: users@cloudstack.apache.org 
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > I agree, try checking the number of concurrent connections as well as
> > increasing the CPVM capacity.
> > Also check the network for any glitches / lag between the CPVM and the
> > KVM hosts 
> > From: Hean Seng 
> > Sent: Tuesday, May 4, 2021 4:03 PM
> > To: users@cloudstack.apache.org 
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > Do you know how many concurrent access to VNC  from your user ?
> >
> > Or you want to increase the Console Proxy Capacity?
> >
> > Also, please make sure the console proxy Ip/Network is up when you
> > having issue on it.
> >
> >
> >
> >
> > On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
> > wrote:
> >
> > > This bug is making cloudstack  completely unusable
> > >
> > > Is there a way to test VNC directly on KVM?
> > >
> > > Thanks
> > >
> > > Adam
> > >
> > >
> > > -Original Message-
> > > From: Adam Witwicki
> > > Sent: 29 April 2021 14:04
> > > To: 'users@cloudstack.apache.org' 
> > > Subject: RE: VM console keeps pausing to the point of being unusable
> > >
> > > It didn't go away forever, and now the same issue is back 

RE: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Adam Witwicki
Hi Andrija

Yes, no issues accessing the VNC port directly on the KVM server.

Thanks

Adam


-Original Message-
From: Andrija Panic 
Sent: 28 June 2021 16:48
To: users 
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Adam,

"
Adam,

did you try accessing the VM console via standalone VNC viewer, based on the 
way Rohit explained  - dump the XML of the VM, check the IP/port and password 
details - and use those to access  and see if that 
connections is established quick enough.

Best,
"

Best,

On Mon, 28 Jun 2021 at 11:32, Adam Witwicki  wrote:

> Am I able to get some help with this?
>
> Cloudstack really is unusable
> Is it related to the speed issues with SSL?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki
> Sent: 07 June 2021 14:08
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Forgive me if I am wrong
>
> But this is where the exception lies
> https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a
> 403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/con
> soleproxy/vnc/VncClientPacketSender.java#L42
> private final BlockingQueue queue = new
> ArrayBlockingQueue(30);
>
> I guess I need to understand why objects are not leaving the queue?
>
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 07 June 2021 11:49
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Rohit, sorry the long delay
>
> Yes all servers and VMs are in time sync.
> It does seem to be an issue with the console proxy, no attempt of
> increasing its resources is improving the situation.
> What else can we try?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Rohit Yadav 
> Sent: 05 May 2021 09:21
> To: users@cloudstack.apache.org
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam - can you check and sync time on your KVM hosts, management
> servers and CPVM using ntp? This is because SSL-enabled connection are
> time sensitive.
> In order to test VNC directly, you can ssh into the host and do
> something
> like:
>
> # virsh list # find the VM
>
> Then run dumpxml and grab the IP/port and password, for example:
>
> # virsh dumpxml --security-info s-180-VM | grep vnc
>  passwd='_u6LayCdnCrr_JuUwCrq2A'>
>
>
> If you're on the management network, you can use any VNC client and
> details you find to connect to the VNC directly. I often connect
> virt-manager (UI) to a KVM host over SSH and use the console directly
> (the only trick is to grab the password, by clicking the information
> tab -> go to VNC -> click on show password -> copy and use it to see console).
>
>
> Regards.
>
> 
> From: David Jumani 
> Sent: Wednesday, May 5, 2021 10:32
> To: users@cloudstack.apache.org 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> I agree, try checking the number of concurrent connections as well as
> increasing the CPVM capacity.
> Also check the network for any glitches / lag between the CPVM and the
> KVM hosts 
> From: Hean Seng 
> Sent: Tuesday, May 4, 2021 4:03 PM
> To: users@cloudstack.apache.org 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> Do you know how many concurrent access to VNC  from your user ?
>
> Or you want to increase the Console Proxy Capacity?
>
> Also, please make sure the console proxy Ip/Network is up when you
> having issue on it.
>
>
>
>
> On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
> wrote:
>
> > This bug is making cloudstack  completely unusable
> >
> > Is there a way to test VNC directly on KVM?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki
> > Sent: 29 April 2021 14:04
> > To: 'users@cloudstack.apache.org' 
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > It didn't go away forever, and now the same issue is back Same logs
> > as before https://pastebin.com/YS6XCy6y
> >
> > Adam
> > -Original Message-
> > From: Adam Witwicki
> > Sent: 27 April 2021 07:30
> > To: users@cloudstack.apache.org
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > Hi Nicolas,
> >
> > It was persisting over console systemVM destroy and creation, and
> > any instance over 3 KVM hosts.
> > Annoying we did not see the error in the console VM logs yesterday
> > and users are reporting the console is currently working ok.
> >
> 

Re: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Andrija Panic
Adam,

"
Adam,

did you try accessing the VM console via standalone VNC viewer, based on
the way Rohit explained  - dump the XML of the VM, check the IP/port and
password details - and use those to access  and see if
that connections is established quick enough.

Best,
"

Best,

On Mon, 28 Jun 2021 at 11:32, Adam Witwicki  wrote:

> Am I able to get some help with this?
>
> Cloudstack really is unusable
> Is it related to the speed issues with SSL?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki
> Sent: 07 June 2021 14:08
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Forgive me if I am wrong
>
> But this is where the exception lies
> https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/consoleproxy/vnc/VncClientPacketSender.java#L42
> private final BlockingQueue queue = new
> ArrayBlockingQueue(30);
>
> I guess I need to understand why objects are not leaving the queue?
>
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki 
> Sent: 07 June 2021 11:49
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network. Treat
> hyperlinks and attachments in this email with caution. **
>
> Rohit, sorry the long delay
>
> Yes all servers and VMs are in time sync.
> It does seem to be an issue with the console proxy, no attempt of
> increasing its resources is improving the situation.
> What else can we try?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Rohit Yadav 
> Sent: 05 May 2021 09:21
> To: users@cloudstack.apache.org
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network. Treat
> hyperlinks and attachments in this email with caution. **
>
> Hi Adam - can you check and sync time on your KVM hosts, management
> servers and CPVM using ntp? This is because SSL-enabled connection are time
> sensitive.
> In order to test VNC directly, you can ssh into the host and do something
> like:
>
> # virsh list # find the VM
>
> Then run dumpxml and grab the IP/port and password, for example:
>
> # virsh dumpxml --security-info s-180-VM | grep vnc
>  passwd='_u6LayCdnCrr_JuUwCrq2A'>
>
>
> If you're on the management network, you can use any VNC client and
> details you find to connect to the VNC directly. I often connect
> virt-manager (UI) to a KVM host over SSH and use the console directly (the
> only trick is to grab the password, by clicking the information tab -> go
> to VNC -> click on show password -> copy and use it to see console).
>
>
> Regards.
>
> 
> From: David Jumani 
> Sent: Wednesday, May 5, 2021 10:32
> To: users@cloudstack.apache.org 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> I agree, try checking the number of concurrent connections as well as
> increasing the CPVM capacity.
> Also check the network for any glitches / lag between the CPVM and the KVM
> hosts 
> From: Hean Seng 
> Sent: Tuesday, May 4, 2021 4:03 PM
> To: users@cloudstack.apache.org 
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> Do you know how many concurrent access to VNC  from your user ?
>
> Or you want to increase the Console Proxy Capacity?
>
> Also, please make sure the console proxy Ip/Network is up when you having
> issue on it.
>
>
>
>
> On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
> wrote:
>
> > This bug is making cloudstack  completely unusable
> >
> > Is there a way to test VNC directly on KVM?
> >
> > Thanks
> >
> > Adam
> >
> >
> > -Original Message-
> > From: Adam Witwicki
> > Sent: 29 April 2021 14:04
> > To: 'users@cloudstack.apache.org' 
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > It didn't go away forever, and now the same issue is back Same logs as
> > before https://pastebin.com/YS6XCy6y
> >
> > Adam
> > -Original Message-
> > From: Adam Witwicki
> > Sent: 27 April 2021 07:30
> > To: users@cloudstack.apache.org
> > Subject: RE: VM console keeps pausing to the point of being unusable
> >
> > Hi Nicolas,
> >
> > It was persisting over console systemVM destroy and creation, and any
> > instance over 3 KVM hosts.
> > Annoying we did not see the error in the console VM logs yesterday and
> > users are reporting the console is currently working ok.
> >
> > Kind Regards
> >
> > Adam
> >
> > -Original Message-
> > From: Nicolas Vazquez 
> > Sent: 26 April 2021 21:26
> > To: users@cloudstack.apache.org
> > Subject: Re: VM console keeps pausing to the point of being unusable
> >
> > ** This mail originated from OUTSIDE the Oakford corporate network.
> > Treat hyperlinks and attachments in this email with caution. **
> >
> > Hi Adam,
> 

Re: Management server reboot appears to cause vms on other hosts to shutdown?

2021-06-28 Thread Andrija Panic
NFS primary storage also on your management server?

On Sat, 26 Jun 2021 at 10:36, Brian Fitzpatrick 
wrote:

> Hi Jordan,
>
> Thanks for your reply. Apologies I might not have been clear.
>
> The management server is aware of the vm and when I set the host that is
> also the same server that is running the management server (and mysql) into
> maintenance mode, I can see it not longer has any running vms on it. They
> have migrated to other hosts. Cloud stack can see them. Bu when I then to
> an apt update and reboot the management server, the vms on the other hosts
> seem to have shutdown.
>
> The reboot did take a while (15-20 mins), but I am surprised that it has
> affected other kvm hosts, which I thought should just carry on running.
> Unless I have missed something that was still on the management(and mysql)
> server.
>
> Thanks
>
> Brian
>
> -Original Message-
> From: Yordan Kostov  yordan%20kostov%20%3cyord...@nsogroup.com%3e>>
> Reply-To: users@cloudstack.apache.org
> To: users@cloudstack.apache.org  22us...@cloudstack.apache.org%22%20%3cus...@cloudstack.apache.org%3e>>
> Subject: RE: Management server reboot appears to cause vms on other hosts
> to shutdown?
> Date: Fri, 25 Jun 2021 09:10:44 +
>
>
> CAUTION !
>
>
> This email was NOT sent using a University of Chester account, so we are
> unable to verify the identity of the sender. Do not click links or open
> attachments unless you recognise the sender and know the content is safe.
>
>
> =
>
>
>
> Hello Brian,
>
>
> May be I did not understand very well but from what you say I get
> that the management server + SQL and NFS are on the same physical hosts
> that are being managed by cloudstack?
>
> If those VMs are not visible in Cloudstack, the system is not
> aware that they exist so it wont try to roll them to another host if you
> perform hypervisor host reboot.
>
>
> Best regards,
>
> Jordan
>
>
> -Original Message-
>
> From: Brian Fitzpatrick <
>
> 
>
> b.fitzpatr...@chester.ac.uk
>
> >
>
> Sent: Friday, June 25, 2021 12:06 PM
>
> To:
>
> 
>
> users@cloudstack.apache.org
>
>
> Subject: Management server reboot appears to cause vms on other hosts to
> shutdown?
>
>
>
> [X] This message came from outside your organization
>
>
>
> Hi all,
>
>
> Still relatively new to CloudStack and learning, testing etc.
>
>
> I have created 1 management server with mysql on it and created 2 clusters
> with a nfs primary storage server in each and a number of hosts in each.
>
>
> I have been working through the servers, putting them in maintenance mode
> (noting the vm migrations), updating and rebooting them. All working fine
>
>
> I then wanted to update and reboot the server running the management and
> mysql. It is also a host, so I set it in maintenance mode so no vms running
> on it.
>
>
> I thought if I update it and reboot, all I would lose for a period of time
> was access to the management server, the vms should keep running on their
> various hosts
>
>
> The reboot, took longer than usual, it seemed to hang for 15-20mins before
> shutting down and rebooting. To my surprise though I lost contact to all
> the vms on the other hosts.
>
>
> They all shut down.
>
>
> Apologies, if I have missed something here, I thought I understood. All
> virtual routers and system vms appeared to be running on the other hosts.
>
>
> Is it because the management server took a while to reboot, the other
> hosts have lost contact and shutdown their vms? seems odd?
>
>
> Any suggestions, help welcome. As I say, still learning!
>
>
> Thanks
>
>
> Brian
>


-- 

Andrija Panić


Re: [DISCUSS] Rocky 8.4 and CloudStack

2021-06-28 Thread Nathan McGarvey
Rohit,
Agreed. on the el8 rename for the repos. I'd recommend keeping a
symlink back to centos just for folks running automated scripts and such
downstream. Make sure the rsync daemon still works for both, too.

Do you know how difficult it would be to change the CI/CD build
processes to point to point to either multiple OSes or change to another
OS for testing? E.g. Don't actually switch off of CentOS 8 quite yet,
but be able to test alternatives before the end of the year.

Thanks,
-Nathan McGarvey

On 6/28/21 6:02 AM, Rohit Yadav wrote:
> Great thanks all for the discussion, so what we mostly agree on are:
> 
>   *   CentOS8, Rocky Linux 8 and other initiatives may all be binary 
> compatible
>   *   We can host all el8 repos which these distros may use
>   *   The community may help validate the CloudStack el8 pkgs among one or 
> more clear winner with time
> 
> As an immediate action, let's us publish all "centos8" or "rocky8" package 
> repos under generic "el8" repos? For example, 
> http://download.cloudstack.org/testing/nightly/latest/ we can add symlink or 
> rename dirs as "el8", "el7".
> 
> 
> Regards.
> 
> 
> From: n...@li.nux.ro 
> Sent: Thursday, June 24, 2021 21:12
> To: d...@cloudstack.apache.org 
> Cc: Nathan McGarvey 
> Subject: Re: [DISCUSS] Rocky 8.4 and CloudStack
> 
> That's a very good suggestion, I'm sure we can sort out something.
> 
> Regards,
> Lucian
> 
> 
>  
> 
> On 2021-06-24 14:40, Nathan McGarvey wrote:
>> Nux,
>> Also agree regarding EL8.
>>
>> I wonder if it is possible to build on a RHEL "development" license
>> where builds and smoke tests and such can be done without licensing
>> cost.
>> (https://developers.redhat.com/articles/faqs-no-cost-red-hat-enterprise-linux,
>> https://developers.redhat.com/terms-and-conditions)
>>
>> I'm not a lawyer and the terms seem murky as to how an Open-Source
>> project like CloudStack would interact with those terms, even in a
>> non-production sense. Do any other ASF projects use RHEL for build/test
>> servers or anything like that?
>>
>>
>> Thanks,
>> -Nathan McGarvey
>>
>>
>>
>> On 6/24/21 8:17 AM, Sven Vogel wrote:
>>> @nux
>>>
>>> „Might be then worth going for supporting "EL8" and by that include
>>> any
>>> of Rocky, Alma, OtherClone etc.“
>>>
>>> Agree
>>>
>>> __
>>>
>>> Sven Vogel
>>> Senior Manager Research and Development - Cloud and Infrastructure
>>>
>>> EWERK DIGITAL GmbH
>>> Brühl 24, D-04109 Leipzig
>>> P +49 341 42649 - 99
>>> F +49 341 42649 - 98
>>> s.vo...@ewerk.com
>>> www.ewerk.com
>>>
>>> Geschäftsführer:
>>> Dr. Erik Wende, Hendrik Schubert, Tassilo Möschke
>>> Registergericht: Leipzig HRB 9065
>>>
>>> Support:
>>> +49 341 42649 555
>>>
>>> Zertifiziert nach:
>>> ISO/IEC 27001:2013
>>> DIN EN ISO 9001:2015
>>> DIN ISO/IEC 2-1:2018
>>>
>>> ISAE 3402 Typ II Assessed
>>>
>>> EWERK-Blog |
>>> LinkedIn |
>>> Xing |
>>> Twitter |
>>> Facebook
>>>
>>>
>>> Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.
>>>
>>> Disclaimer Privacy:
>>> Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien)
>>> ist vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht
>>> der bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung,
>>> Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte
>>> informieren Sie in diesem Fall unverzüglich den Absender und löschen
>>> Sie die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem
>>> System. Vielen Dank.
>>>
>>> The contents of this e-mail (including any attachments) are
>>> confidential and may be legally privileged. If you are not the
>>> intended recipient of this e-mail, any disclosure, copying,
>>> distribution or use of its contents is strictly prohibited, and you
>>> should please notify the sender immediately and then delete it
>>> (including any attachments) from your system. Thank you.
>>>
>>> 
>>> Von: n...@li.nux.ro 
>>> Gesendet: Thursday, June 24, 2021 2:57:24 PM
>>> An: d...@cloudstack.apache.org 
>>> Betreff: Re: [DISCUSS] Rocky 8.4 and CloudStack
>>>
>>> Point taken. Good find with gdm, wonder if there are others.
>>> I'm hoping this kind of problems disappear in time as the machine gets
>>> "oiled" better.
>>>
>>> What I wanted to underline is that the situation is sort of like this:
>>> Updates -> QA -> Stream -> RHEL
>>>
>>> Might be then worth going for supporting "EL8" and by that include any
>>> of Rocky, Alma, OtherClone etc.
>>>
>>>
>>>
>>> On 2021-06-23 19:03, Nathan McGarvey wrote:
 Nux,
 Overall, I agree that it should be possible to use any other
 clone
 as they should be binary compatible.

 I don't quite understand your "pass through QA" and "basically
 

Re: DEBUG message: Cannot release reservation, Found VM: VM[User|i-5-106-VM] Stopped but reserved on host 1. How to fixed?

2021-06-28 Thread Kalil de Albuquerque Carvalho

Hello Suresh.

Thanks for the tip, worked fine.

Best regards.


Em 28/06/2021 01:37, Suresh Anaparti escreveu:

Hi Kalil,

Can you check the config setting 'capacity.skipcounting.hours ', which is the 
wait time before releasing the VM resources.

The setting 'host.reservation.release.period' is the time interval to check and 
release the host reservations, but the resources are not released until the 
duration specified through 'capacity.skipcounting.hours' setting after VM is 
stopped.

Regards,
Suresh

On 25/06/21, 7:28 PM, "Kalil de Albuquerque Carvalho" 
 wrote:

 Hello all.

 Some days ago I asked how to release the resources when my instances
 been halted. A member reply me with "host.reservation.release.period"
 setting, on global configuration. I changed to 5, the statement, reboot
 the CloudStack service but it is not releasing the resources and it is
 showing me this messages in the management server:

 2021-06-25 09:45:54,680 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (HostReservationReleaseChecker:ctx-6a943f41) (logid:fa97e34d) Checking
 if any host reservation can be released ...
 2021-06-25 09:45:54,686 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (HostReservationReleaseChecker:ctx-6a943f41) (logid:fa97e34d) Cannot
 release reservation, Found VM: VM[User|i-5-106-VM] Stopped but reserved
 on host 1
 2021-06-25 09:45:54,691 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (HostReservationReleaseChecker:ctx-6a943f41) (logid:fa97e34d) Cannot
 release reservation, Found VM: VM[User|i-2-105-VM] Stopped but reserved
 on host 3
 2021-06-25 09:45:54,695 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (HostReservationReleaseChecker:ctx-6a943f41) (logid:fa97e34d) Cannot
 release reservation, Found 1 VMs Running on host 4
 2021-06-25 09:45:54,700 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
 (HostReservationReleaseChecker:ctx-6a943f41) (logid:fa97e34d) Cannot
 release reservation, Found 3 VMs Running on host 5


 this situation keep going and not release the resources.

 All my instances are halted, just System VM's and Virtual Routers are
 running.

 My environment is:

 What am I doing wrong?

 Where can I fix this?

 CloudStack: 4.15

 Distro: CentOS 7.9

 Kernel: 3.10.0-1160.25.1.el7.x86_64

 Best regards.




  



Re: Scoping service offerings to individual accounts

2021-06-28 Thread Darrin Hüsselmann
Hi Rudi,

I think this would require some code changes, currently the 
createServiceOffering and listServiceOffering API doesn’t support account.

Regards
Darrin

On 2021/06/06 06:26:13, Rudraksh MK  wrote:
> Hello,>
>
> Something I’ve been thinking about for a while - how do you go about 
> restricting the use of a service offering to an individual account? One 
> option that seems the most obvious is creating a separate domain for an 
> account, and scoping a service offering - or a set of them - to that domain. 
> But I feel that can mean lots of individual domains in the long run.>
>
> I was wondering how others are thinking about this scenario - or dealing with 
> it without writing a ton of wrappers on top?>
> Thanks!>
>
> Best,>
>
> Rudi.>
>
Sent from Mail for Windows 10



Re: [DISCUSS] Rocky 8.4 and CloudStack

2021-06-28 Thread Rohit Yadav
Great thanks all for the discussion, so what we mostly agree on are:

  *   CentOS8, Rocky Linux 8 and other initiatives may all be binary compatible
  *   We can host all el8 repos which these distros may use
  *   The community may help validate the CloudStack el8 pkgs among one or more 
clear winner with time

As an immediate action, let's us publish all "centos8" or "rocky8" package 
repos under generic "el8" repos? For example, 
http://download.cloudstack.org/testing/nightly/latest/ we can add symlink or 
rename dirs as "el8", "el7".


Regards.


From: n...@li.nux.ro 
Sent: Thursday, June 24, 2021 21:12
To: d...@cloudstack.apache.org 
Cc: Nathan McGarvey 
Subject: Re: [DISCUSS] Rocky 8.4 and CloudStack

That's a very good suggestion, I'm sure we can sort out something.

Regards,
Lucian


 

On 2021-06-24 14:40, Nathan McGarvey wrote:
> Nux,
> Also agree regarding EL8.
>
> I wonder if it is possible to build on a RHEL "development" license
> where builds and smoke tests and such can be done without licensing
> cost.
> (https://developers.redhat.com/articles/faqs-no-cost-red-hat-enterprise-linux,
> https://developers.redhat.com/terms-and-conditions)
>
> I'm not a lawyer and the terms seem murky as to how an Open-Source
> project like CloudStack would interact with those terms, even in a
> non-production sense. Do any other ASF projects use RHEL for build/test
> servers or anything like that?
>
>
> Thanks,
> -Nathan McGarvey
>
>
>
> On 6/24/21 8:17 AM, Sven Vogel wrote:
>> @nux
>>
>> „Might be then worth going for supporting "EL8" and by that include
>> any
>> of Rocky, Alma, OtherClone etc.“
>>
>> Agree
>>
>> __
>>
>> Sven Vogel
>> Senior Manager Research and Development - Cloud and Infrastructure
>>
>> EWERK DIGITAL GmbH
>> Brühl 24, D-04109 Leipzig
>> P +49 341 42649 - 99
>> F +49 341 42649 - 98
>> s.vo...@ewerk.com
>> www.ewerk.com
>>
>> Geschäftsführer:
>> Dr. Erik Wende, Hendrik Schubert, Tassilo Möschke
>> Registergericht: Leipzig HRB 9065
>>
>> Support:
>> +49 341 42649 555
>>
>> Zertifiziert nach:
>> ISO/IEC 27001:2013
>> DIN EN ISO 9001:2015
>> DIN ISO/IEC 2-1:2018
>>
>> ISAE 3402 Typ II Assessed
>>
>> EWERK-Blog |
>> LinkedIn |
>> Xing |
>> Twitter |
>> Facebook
>>
>>
>> Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.
>>
>> Disclaimer Privacy:
>> Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien)
>> ist vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht
>> der bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung,
>> Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte
>> informieren Sie in diesem Fall unverzüglich den Absender und löschen
>> Sie die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem
>> System. Vielen Dank.
>>
>> The contents of this e-mail (including any attachments) are
>> confidential and may be legally privileged. If you are not the
>> intended recipient of this e-mail, any disclosure, copying,
>> distribution or use of its contents is strictly prohibited, and you
>> should please notify the sender immediately and then delete it
>> (including any attachments) from your system. Thank you.
>>
>> 
>> Von: n...@li.nux.ro 
>> Gesendet: Thursday, June 24, 2021 2:57:24 PM
>> An: d...@cloudstack.apache.org 
>> Betreff: Re: [DISCUSS] Rocky 8.4 and CloudStack
>>
>> Point taken. Good find with gdm, wonder if there are others.
>> I'm hoping this kind of problems disappear in time as the machine gets
>> "oiled" better.
>>
>> What I wanted to underline is that the situation is sort of like this:
>> Updates -> QA -> Stream -> RHEL
>>
>> Might be then worth going for supporting "EL8" and by that include any
>> of Rocky, Alma, OtherClone etc.
>>
>>
>>
>> On 2021-06-23 19:03, Nathan McGarvey wrote:
>>> Nux,
>>> Overall, I agree that it should be possible to use any other
>>> clone
>>> as they should be binary compatible.
>>>
>>> I don't quite understand your "pass through QA" and "basically
>>> RHEL
>>> packages" comment. There are already instances of breaking changes in
>>> CentOS 8 Stream that didn't make it into RHEL or CentOS non-stream.
>>> CentOS Stream is the only one where you *don't* know exactly what you
>>> are getting since it is no longer downstream of RHEL:
>>>
>>>
>>> Just one example:
>>> https://bugzilla.redhat.com/show_bug.cgi?id=1911827
>>>
>>>
>>> RHEL 8 versions published (at least that I could find on their errata
>>> pages)
>>> gdm-3.28.3-34.el8.x86_64.rpm  <-- not broken
>>> gdm-3.28.3-39.el8.x86_64.rpm  <-- not broken
>>>
>>>
>>>
>>> CentOS 8 (not stream) versions line up with RHEL as expected:
>>> gdm-3.28.3-34.el8.src.rpm 2020-09-17 17:27  <-- not broken
>>> 

[VOTE] Apache CloudStack 4.15.1.0 (RC3)

2021-06-28 Thread Rohit Yadav
Hi All,

I've created a 4.15.1.0 release, with the following artifacts up for a vote:

Git Branch:
https://github.com/apache/cloudstack/tree/4.15.1.0-RC20210628T1527
Commit SHA:
379454caae76279329c52aa6ae3eea389741d935

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/4.15.1.0/

PGP release keys (signed using 5ED1E1122DC5E8A4A45112C2484248210EE3D884):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

The vote will be open this week until 2 July 2021.

For sanity in tallying the vote, can PMC members please be sure to indicate
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

For users convenience, the packages from this release candidate and 4.15.1
systemvmtemplates are available here:
https://download.cloudstack.org/testing/4.15.1.0-RC3/
https://download.cloudstack.org/systemvm/4.15/

Documentation is not published yet, but the following may be referenced for
upgrade related tests: (there's a new 4.15.1 systemvmtemplate to be
registered prior to upgrade)
https://github.com/apache/cloudstack-documentation/tree/4.15/source/upgrading/upgrade

Regards.


Ceph+ CloudStack

2021-06-28 Thread Ivet Petrova
Hello and Happy Monday to all of you!

I am writing an article for the combination of CloudStack and Ceph for cloud 
service/IaaS providers. The article targets to show why the combination is good 
and what benefits and flexibility it provides.
Are there any users of CloudStack + Ceph here?
Will some of you want provide 2-3 sentence quotes on the topic, which I can 
include in an article?

Thanks in advance for the help!

Kind regards,


 



RE: VM console keeps pausing to the point of being unusable

2021-06-28 Thread Adam Witwicki
Am I able to get some help with this?

Cloudstack really is unusable
Is it related to the speed issues with SSL?

Thanks

Adam


-Original Message-
From: Adam Witwicki
Sent: 07 June 2021 14:08
To: users@cloudstack.apache.org
Subject: RE: VM console keeps pausing to the point of being unusable

Forgive me if I am wrong

But this is where the exception lies 
https://github.com/apache/cloudstack/blob/64f792bd7c3a2017d760b0d47b9a403cb88bab99/services/console-proxy/server/src/main/java/com/cloud/consoleproxy/vnc/VncClientPacketSender.java#L42
private final BlockingQueue queue = new 
ArrayBlockingQueue(30);

I guess I need to understand why objects are not leaving the queue?


Thanks

Adam


-Original Message-
From: Adam Witwicki 
Sent: 07 June 2021 11:49
To: users@cloudstack.apache.org
Subject: RE: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Rohit, sorry the long delay

Yes all servers and VMs are in time sync.
It does seem to be an issue with the console proxy, no attempt of increasing 
its resources is improving the situation.
What else can we try?

Thanks

Adam


-Original Message-
From: Rohit Yadav 
Sent: 05 May 2021 09:21
To: users@cloudstack.apache.org
Subject: Re: VM console keeps pausing to the point of being unusable

** This mail originated from OUTSIDE the Oakford corporate network. Treat 
hyperlinks and attachments in this email with caution. **

Hi Adam - can you check and sync time on your KVM hosts, management servers and 
CPVM using ntp? This is because SSL-enabled connection are time sensitive.
In order to test VNC directly, you can ssh into the host and do something like:

# virsh list # find the VM

Then run dumpxml and grab the IP/port and password, for example:

# virsh dumpxml --security-info s-180-VM | grep vnc



If you're on the management network, you can use any VNC client and details you 
find to connect to the VNC directly. I often connect virt-manager (UI) to a KVM 
host over SSH and use the console directly (the only trick is to grab the 
password, by clicking the information tab -> go to VNC -> click on show 
password -> copy and use it to see console).


Regards.


From: David Jumani 
Sent: Wednesday, May 5, 2021 10:32
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

I agree, try checking the number of concurrent connections as well as 
increasing the CPVM capacity.
Also check the network for any glitches / lag between the CPVM and the KVM 
hosts 
From: Hean Seng 
Sent: Tuesday, May 4, 2021 4:03 PM
To: users@cloudstack.apache.org 
Subject: Re: VM console keeps pausing to the point of being unusable

Do you know how many concurrent access to VNC  from your user ?

Or you want to increase the Console Proxy Capacity?

Also, please make sure the console proxy Ip/Network is up when you having issue 
on it.




On Tue, May 4, 2021 at 5:43 PM Adam Witwicki 
wrote:

> This bug is making cloudstack  completely unusable
>
> Is there a way to test VNC directly on KVM?
>
> Thanks
>
> Adam
>
>
> -Original Message-
> From: Adam Witwicki
> Sent: 29 April 2021 14:04
> To: 'users@cloudstack.apache.org' 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> It didn't go away forever, and now the same issue is back Same logs as
> before https://pastebin.com/YS6XCy6y
>
> Adam
> -Original Message-
> From: Adam Witwicki
> Sent: 27 April 2021 07:30
> To: users@cloudstack.apache.org
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Hi Nicolas,
>
> It was persisting over console systemVM destroy and creation, and any
> instance over 3 KVM hosts.
> Annoying we did not see the error in the console VM logs yesterday and
> users are reporting the console is currently working ok.
>
> Kind Regards
>
> Adam
>
> -Original Message-
> From: Nicolas Vazquez 
> Sent: 26 April 2021 21:26
> To: users@cloudstack.apache.org
> Subject: Re: VM console keeps pausing to the point of being unusable
>
> ** This mail originated from OUTSIDE the Oakford corporate network.
> Treat hyperlinks and attachments in this email with caution. **
>
> Hi Adam,
>
> That's an error I've never hit before, does the issue persist after
> destroying and recreating the console proxy VM?
>
> Regards,
> Nicolas Vazquez
> 
> From: Adam Witwicki 
> Sent: Thursday, April 22, 2021 7:17 AM
> To: users@cloudstack.apache.org 
> Subject: RE: VM console keeps pausing to the point of being unusable
>
> Paste is now working!
>
> Thanks
>
> Adam
>
> nicolas.vazq...@shapeblue.com
> www.shapeblue.com
> 3 London Bridge Street,  3rd floor, News Building, London  SE1 9SGUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Adam Witwicki 
> 

Re: How to use ansible for cloudstack initialization

2021-06-28 Thread Rudraksh MK
Hi Rafael,

Yes it could. Bit dependent on what the lookup/discovery platform is, and 
having some sort of structured schema to it, along with endpoints for querying 
that data. But yes, it could be done.


Best!

Rudraksh Mukta Kulshreshtha
Vice-President - DevOps & R
IndiQus Technologies
O +91 11 4055 1411 | M +91 99589 54879
indiqus.com

This message is intended only for the use of the individual or entity to which 
it is addressed and may contain information that is confidential and/or 
privileged. If you are not the intended recipient please delete the original 
message and any copy of it from your computer system. You are hereby notified 
that any dissemination, distribution or copying of this communication is 
strictly prohibited unless proper authorization has been obtained for such 
action. If you have received this communication in error, please notify the 
sender immediately. Although IndiQus attempts to sweep e-mail and attachments 
for viruses, it does not guarantee that both are virus-free and accepts no 
liability for any damage sustained as a result of viruses.
On 28 Jun 2021, 12:55 PM +0530, Rafael del Valle , 
wrote:
> Hi Rudraksh,
> Interesting.
>
> it may also be possible to turn your python scripting to read the files that 
> customers provide into an alternative lookup plugin if CSV doesn't fit well.
>
> Regards,
> Rafael
>
>
> On Mon, 2021-06-28 07:50 AM, Rudraksh MK  wrote:
> > Hi Rene!
> >
> > My apologies, I ought to have been a little clearer. Your playbooks are 
> > just perfect, when it comes to configuring an ACS deployment with zones and 
> > clusters and pods and so on. In our use case though, what typically happens 
> > is that a service provider usually provides spreadsheets with details about 
> > the zones and all they want. While Ansible has the capability when it comes 
> > to reading CSVs, it felt more verbose to write playbooks to do that; 
> > scripting it in Python felt easier.
> >
> > Having said that, I think I’d like to take a shot at this again, and see if 
> > we can use spreadsheets containing config details with your collection.
> >
> > Oh and thank you for your work on this :)
> >
> >
> > Best!
> >
> > Rudraksh Mukta Kulshreshtha
> > Vice-President - DevOps & R
> > IndiQus Technologies
> > O +91 11 4055 1411 | M +91 99589 54879
> > indiqus.com
> >
> > This message is intended only for the use of the individual or entity to 
> > which it is addressed and may contain information that is confidential 
> > and/or privileged. If you are not the intended recipient please delete the 
> > original message and any copy of it from your computer system. You are 
> > hereby notified that any dissemination, distribution or copying of this 
> > communication is strictly prohibited unless proper authorization has been 
> > obtained for such action. If you have received this communication in error, 
> > please notify the sender immediately. Although IndiQus attempts to sweep 
> > e-mail and attachments for viruses, it does not guarantee that both are 
> > virus-free and accepts no liability for any damage sustained as a result of 
> > viruses.
> > On 27 Jun 2021, 7:17 PM +0530, Rene Moser " 
> > target="_blank">, wrote:
> > > Hi Jerry
> > >
> > > I am one of the authors of the cloudstack ansible integration, you can
> > > find the docs about every ansible module here
> > > https://docs.ansible.com/ansible/latest/collections/ngine_io/cloudstack/index.html
> > >
> > > We have intregration tests playbooks, which also creates zones, pods,
> > > cluster, etc., which you can find here
> > > https://github.com/ngine-io/ansible-collection-cloudstack/tree/master/tests/integration/targets
> > >
> > > further, Rafael (in cc) showed on the last cloudstack europe meetup how
> > > they provisioned cloudstack using ansible. You may get in touch with.
> > >
> > > And I can not confirm that "Ansible felt slightly..clunky in this
> > > context." We made it as easy and reliable as possible to use ansible
> > > with cloudstack and continue to do so, if you feel, something is
> > > missing, feel free to get in touch.
> > >
> > > On 26.06.21 10:34, li jerry wrote:
> > > > Hello everyone
> > > >
> > > > Does anyone use ansible to add zone/pod/cluster/host/storage to 
> > > > cloudstack?
> > >
> > >
> > > > Currently I can only use ansible to complete the deployment of 
> > > > cloudstack, nfs, mysql and other services.
> > > > I can't use ansible to complete operations such as adding zone/pod
> > > >
> > > > Can someone provide relevant documents or solutions?
> > >
> > >


Re: [VOTE] Apache CloudStack 4.15.1.0 (RC2)

2021-06-28 Thread Rohit Yadav
All,

I close this thread and will start another voting thread for RC3 later today 
since we've not received any further blocker/critical bug reports and all 
outstanding issues have been tested/fixed/merged: 
https://github.com/apache/cloudstack/milestone/17

Thanks and regards.


From: Rohit Yadav 
Sent: Thursday, June 24, 2021 11:18
To: d...@cloudstack.apache.org 
Cc: users@cloudstack.apache.org 
Subject: Re: [VOTE] Apache CloudStack 4.15.1.0 (RC2)

I think the issue cannot be classified as blocker as it's specific to just UI, 
a user may still use the API for the specific case where offering has root 
disk. There are some other issues reported like this as well.

RC3 may not be strictly necessary but I'm willing to cut it, but let's do it on 
Monday. Let's keep testing, reporting bugs until then.

Regards.

Regards,
Rohit Yadav


From: Gabriel Bräscher 
Sent: Thursday, June 24, 2021 3:52:43 AM
To: dev 
Cc: users@cloudstack.apache.org 
Subject: Re: [VOTE] Apache CloudStack 4.15.1.0 (RC2)

I hate to bring bad news, but I found an issue caused by PR #5085 [1].

The issue affects only VM deployment via UI when using an offering that has
root disk size.
I've just opened PR #5150 [2]; tested it and this fixes the issue.
Sorry for the inconvenience but this might require a third round. What do
you think?

The good news: all raised issues on RC1 have been correctly addressed and
RC2 works as expected.
Apart from the issue raised in #5150, all tests look good.

[1] https://github.com/apache/cloudstack/pull/5085
[2] https://github.com/apache/cloudstack/pull/5150

Regards,
Gabriel.

Em qua., 23 de jun. de 2021 às 09:45, Abhishek Kumar <
abhishek.ku...@shapeblue.com> escreveu:

> +1
>
> Did some manual tests with RC2 packages deploying a new environment.
>
> (Advanced zone with 2x XCP-ng 8.2 hosts, 2x NFS storage pools)
>
>   *   VM - deploy, stop-start, reset, migrate, expunge
>   *   Volumes - attach, detach, migrate
>   *   Templates - register, delete
>   *   Network - restart, cleanup
>   *   k8s cluster - start, upgrade, destroy
>   *   Hosts - maintenance, enable-disable
>   *   SystemVMs - destroy, migrate
>   *   Some basic UI - accounts, domains, offerings, config, etc
>
> Regards,
> Abhishek
>
> 
> From: Rohit Yadav 
> Sent: 16 June 2021 21:57
> To: d...@cloudstack.apache.org ;
> users@cloudstack.apache.org 
> Subject: [VOTE] Apache CloudStack 4.15.1.0 (RC2)
>
> Hi All,
>
> I've created a 4.15.1.0 release, with the following artifacts up for a
> vote:
>
> Git Branch:
> https://github.com/apache/cloudstack/tree/4.15.1.0-RC20210616T2128
> Commit SHA:
> 3afd37022b9dac52cd146dccada6012e47a80232
>
> Source release (checksums and signatures are available at the same
> location):
> https://dist.apache.org/repos/dist/dev/cloudstack/4.15.1.0/
>
> PGP release keys (signed using 5ED1E1122DC5E8A4A45112C2484248210EE3D884):
> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>
> The vote will be open for the next week until 22 June 2021.
>
> For sanity in tallying the vote, can PMC members please be sure to indicate
> "(binding)" with their vote?
>
> [ ] +1  approve
> [ ] +0  no opinion
> [ ] -1  disapprove (and reason why)
>
> For users convenience, the packages from this release candidate and 4.15.1
> systemvmtemplates are available here:
> https://download.cloudstack.org/testing/4.15.1.0-RC2/
> https://download.cloudstack.org/systemvm/4.15/
>
> Documentation is not published yet, but the following may be referenced for
> upgrade related tests: (there's a new 4.15.1 systemvmtemplate to be
> registered prior to upgrade)
>
> https://github.com/apache/cloudstack-documentation/tree/4.15/source/upgrading/upgrade
>
> Regards.
>
>
>
>




 



Re: How to use ansible for cloudstack initialization

2021-06-28 Thread Rafael del Valle
Hi Rudraksh,
Interesting.

it may also be possible to turn your python scripting to read the files that 
customers provide into an alternative lookup plugin if CSV doesn't fit well.

Regards,
Rafael


On Mon, 2021-06-28 07:50 AM, Rudraksh MK  wrote:
> Hi Rene!
> 
> My apologies, I ought to have been a little clearer. Your playbooks are just 
> perfect, when it comes to configuring an ACS deployment with zones and 
> clusters and pods and so on. In our use case though, what typically happens 
> is that a service provider usually provides spreadsheets with details about 
> the zones and all they want. While Ansible has the capability when it comes 
> to reading CSVs, it felt more verbose to write playbooks to do that; 
> scripting it in Python felt easier.
> 
> Having said that, I think I’d like to take a shot at this again, and see if 
> we can use spreadsheets containing config details with your collection.
> 
> Oh and thank you for your work on this :)
> 
> 
> Best!
> 
> Rudraksh Mukta Kulshreshtha
> Vice-President - DevOps & R
> IndiQus Technologies
> O +91 11 4055 1411 | M +91 99589 54879
> indiqus.com
> 
> This message is intended only for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential and/or 
> privileged. If you are not the intended recipient please delete the original 
> message and any copy of it from your computer system. You are hereby notified 
> that any dissemination, distribution or copying of this communication is 
> strictly prohibited unless proper authorization has been obtained for such 
> action. If you have received this communication in error, please notify the 
> sender immediately. Although IndiQus attempts to sweep e-mail and attachments 
> for viruses, it does not guarantee that both are virus-free and accepts no 
> liability for any damage sustained as a result of viruses.
> On 27 Jun 2021, 7:17 PM +0530, Rene Moser " 
> target="_blank">, wrote:
> > Hi Jerry
> >
> > I am one of the authors of the cloudstack ansible integration, you can
> > find the docs about every ansible module here
> > https://docs.ansible.com/ansible/latest/collections/ngine_io/cloudstack/index.html
> >
> > We have intregration tests playbooks, which also creates zones, pods,
> > cluster, etc., which you can find here
> > https://github.com/ngine-io/ansible-collection-cloudstack/tree/master/tests/integration/targets
> >
> > further, Rafael (in cc) showed on the last cloudstack europe meetup how
> > they provisioned cloudstack using ansible. You may get in touch with.
> >
> > And I can not confirm that "Ansible felt slightly..clunky in this
> > context." We made it as easy and reliable as possible to use ansible
> > with cloudstack and continue to do so, if you feel, something is
> > missing, feel free to get in touch.
> >
> > On 26.06.21 10:34, li jerry wrote:
> > > Hello everyone
> > >
> > > Does anyone use ansible to add zone/pod/cluster/host/storage to 
> > > cloudstack?
> >
> >
> > > Currently I can only use ansible to complete the deployment of 
> > > cloudstack, nfs, mysql and other services.
> > > I can't use ansible to complete operations such as adding zone/pod
> > >
> > > Can someone provide relevant documents or solutions?
> >
> >
> 

Re: How to use ansible for cloudstack initialization

2021-06-28 Thread Rafael del Valle
Hi Jerry,

I am happy to help.

Have a look at https://privaz.io in the gitlab project there is an example that 
covers that phase of the ACS cloud provisioning.

Regards,
Rafael


On Sun, 2021-06-27 03:40 PM, Rene Moser  wrote:
> 
Hi Jerry
> 
> I am one of the authors of the cloudstack ansible integration, you can 
> find the docs about every ansible module here 
> https://docs.ansible.com/ansible/latest/collections/ngine_io/cloudstack/index.html
> 
> We have intregration tests playbooks, which also creates zones, pods, 
> cluster, etc., which you can find here 
> https://github.com/ngine-io/ansible-collection-cloudstack/tree/master/tests/integration/targets
> 
> further, Rafael (in cc) showed on the last cloudstack europe meetup how 
> they provisioned cloudstack using ansible. You may get in touch with.
> 
> And I can not confirm that "Ansible felt slightly..clunky in this 
> context." We made it as easy and reliable as possible to use ansible 
> with cloudstack and continue to do so, if you feel, something is 
> missing, feel free to get in touch.
> 
> On 26.06.21 10:34, li jerry wrote:
> > Hello everyone
> > 
> > Does anyone use ansible to add zone/pod/cluster/host/storage to cloudstack?
> 
> 
> > Currently I can only use ansible to complete the deployment of cloudstack, 
> > nfs, mysql and other services.
> > I can't use ansible to complete operations such as adding zone/pod
> > 
> > Can someone provide relevant documents or solutions?
> 
> 
> 


RE: RE: XCP-NG 8.2 LTS

2021-06-28 Thread Yordan Kostov
Its on my to-do list to update it.

Best regards,
Jordan 

-Original Message-
From: Jermaine Kendall  
Sent: Friday, June 25, 2021 11:46 PM
To: users@cloudstack.apache.org
Subject: Re: RE: XCP-NG 8.2 LTS


[X] This message came from outside your organization


Thank you for the reply. It is very much appreciated. Can the documentation be 
upgraded for XCP-NG hypervisor setup and let me know it's done

On 2021/06/25 20:33:08, Yordan Kostov  wrote:
> Hello Jermaine,
>
>   Long story short:
>   1. Install XCP-NG 8.2
>   1.1. Make a a note of the name of the interface OR bond that is 
> going to be used for management traffic (this can be seen when you go to 
> CLUSTER -> networking tab
>   1.2. Make a note of the name of the interface OR bond that is 
> going to be used for user/public traffic if it is different then the 
> management
>   For example I use ETH0 for management and have bonded eth2 and eth3 and 
> use that bond for Public and user traffic - 
> https://urldefense.com/v3/__https://imgur.com/nbV2aAu__;!!A6UyJA!wDUMW6z5oiy9Dn5sjnQg0lEHza62apzb8T-x4oNAB42Sh99wLL6e3w9RjmN59FNHoLQ2vcyqdMZ2$
>   So the labels here are MGMT and DATA.
>   2. If you use presetup storage (for example fiber) attach it as you 
> usually do to the XCP cluster and note the name of the LUN in XenCenter.
>   3. Install Cloudstack somewhere (4.15) and deploy a zone by filling up 
> the guide from start to end using the interface labels and the LUN name for 
> primary storage.
>   4. Launch the zone deployment and wait for it to fail.
>   5. Cancel the wizard and go to Infrastruture tab. You will see that 
> Zone, Pod, cluster and hosts are deployed.
>   6. select primary storage tab. Add new one with presetup type and fill 
> in the storage LUN name. It will be added properly.
>   7. Deploy secondary storage (it was not deployed initially 
> because the zone wizard was interrupted before that step)
>
>   You environment is now ready!
>
>   Note: the deployment guide should be edited as it says XenServer switch 
> needs to be in bridge mode in order the system to work which is not correct 
> as ACS fully supports OVS.
>   May be bridge mode is required for some specific network design setting 
> which I am not aware of at the moment.
>
> Best regards,
> Jordan
>
>
> -Original Message-
> From: Jermaine Kendall 
> Sent: Friday, June 25, 2021 10:49 PM
> To: users@cloudstack.apache.org
> Subject: Re: XCP-NG 8.2 LTS
>
>
> [X] This message came from outside your organization
>
>
> On 2021/05/05 09:50:58, Andrija Panic  wrote:
> > If you use officially unsupported hypevisor with 4.14 (XCP-ng 8.2), 
> > you will be missing the records in the guest_os_hypervisor table, 
> > and that means your VMs would be i.e. started as PV instead of HVM etc.
> >
> > Be warned :)
> >
> > Best,
> > Andrija
> >
> > On Wed, 5 May 2021 at 09:09, Yordan Kostov  wrote:
> >
> > > One more problem is that if you deploy a zone with presetup 
> > > storage it will give an error when it is at the step when the storage is 
> > > configured.
> > > It is already fixed in 4.15.1:
> > >
> > > https://urldefense.com/v3/__https://github.com/apache/cloudstack/p
> > > ul 
> > > l/4845__;!!A6UyJA!xbgZNCFeV-go7cGrUjQ---_MlaAER2Fdumg-cMdW4msQVKLQ
> > > Oh
> > > yt15t8yi-mQoUBNEaGjZ6RgICA$
> > >
> > > Best regards,
> > > Jordan
> > >
> > > -Original Message-
> > > From: Dominik Czerepiński 
> > > Sent: Tuesday, May 4, 2021 3:06 PM
> > > To: users@cloudstack.apache.org
> > > Subject: Re: XCP-NG 8.2 LTS
> > >
> > >
> > > [X] This message came from outside your organization
> > >
> > >
> > > Me. Works stable. One problem is if You don’t use SSL for 
> > > consoleproxy change noVNC to older version.
> > >
> > > Wysłane z iPhone'a
> > >
> > > > Wiadomość napisana przez Matheus Fontes  w 
> > > > dniu
> > > 04.05.2021, o godz. 03:18:
> > > >
> > > > I saw in cloudstack 4.15 documentation that it supports xcp-ng
> > > > 8.1 Does someone tried 8.2 LTS version?
> > > >
> > > > thanks
> > > > Matheus Fontes
> > >
> >
> >
> > --
> >
> > Andrija Panić
> > Hi, I have a few questions with regard to setting up xcp-ng with 
> > cloudstack, I have never been successful so far. I followed the xenserver 
> > hypervisor setup and ran into some issues. Do you have any instructions 
> > specifically for setting up XCP-NG with cloudstack? Also is the CSP package 
> > needed for XCP-NG becuase the download link is no longer available. The 
> > network labels, are they necessary and why can't I use the default 
> > networking for XCP-NG which is OVS?
>