Re: [jira] [Commented] (CLOUDSTACK-9813) Use configdrive for userdata, metadata & password

2017-07-12 Thread Marcus
Can we not rely on secondary storage for config drive? I'd much rather see
it generated dynamically into a temp space during VM start, or (less
desirable) even during VM create on primary storage (perhaps in a
configdrive) directory where the root disk resides.  It just seems like a
bad idea to rely on mounting and availability of secondary storage (which
by design is supposed to be out of band from running VMs) to have a healthy
VM. People put a lot of work into their primary storage for VM
availability, not as much for secondary storage.

On Wed, Jul 12, 2017 at 5:01 PM ilya musayev (JIRA)  wrote:

>
> [
> https://issues.apache.org/jira/browse/CLOUDSTACK-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084678#comment-16084678
> ]
>
> ilya musayev commented on CLOUDSTACK-9813:
> --
>
> Hey [~KrisSterckx] [~waegemae]
>
> The idea of storing config drive on secondary store - is actually bad and
> wont be approved by Information Security teams.
>
> Regards,
> ilya
>
> > Use configdrive for userdata, metadata & password
> > --
> >
> > Key: CLOUDSTACK-9813
> > URL:
> https://issues.apache.org/jira/browse/CLOUDSTACK-9813
> > Project: CloudStack
> >  Issue Type: New Feature
> >  Security Level: Public(Anyone can view this level - this is the
> default.)
> >  Components: KVM, Network Controller, Secondary Storage,
> SystemVM, VMware
> >Affects Versions: Future
> >Reporter: Eric Waegeman
> >Assignee: Kris Sterckx
> >
> > To avoid the use of an extra VM for the virtual router we implement
> configdrive for userdata, metadata & password.
> > The configdrive ISO is created on the secondary store and the KVM &
> VMware plugins are adapted to accept the configdrive ISO as second cdrom.
> > Is applicable for isolated, VPC and shared networks.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.4.14#64029)
>


Re: [jira] [Commented] (CLOUDSTACK-9813) Use configdrive for userdata, metadata & password

2017-07-12 Thread Marcus
We've also seen in the past initiatives like object store and 'secondary
storage free' zones. We may not want to cement the idea that we have
secondary storage as a mountable filesystem that is highly available.

On Wed, Jul 12, 2017 at 5:40 PM Marcus  wrote:

> Can we not rely on secondary storage for config drive? I'd much rather see
> it generated dynamically into a temp space during VM start, or (less
> desirable) even during VM create on primary storage (perhaps in a
> configdrive) directory where the root disk resides.  It just seems like a
> bad idea to rely on mounting and availability of secondary storage (which
> by design is supposed to be out of band from running VMs) to have a healthy
> VM. People put a lot of work into their primary storage for VM
> availability, not as much for secondary storage.
>
> On Wed, Jul 12, 2017 at 5:01 PM ilya musayev (JIRA) 
> wrote:
>
>>
>> [
>> https://issues.apache.org/jira/browse/CLOUDSTACK-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084678#comment-16084678
>> ]
>>
>> ilya musayev commented on CLOUDSTACK-9813:
>> --
>>
>> Hey [~KrisSterckx] [~waegemae]
>>
>> The idea of storing config drive on secondary store - is actually bad and
>> wont be approved by Information Security teams.
>>
>> Regards,
>> ilya
>>
>> > Use configdrive for userdata, metadata & password
>> > --
>> >
>> > Key: CLOUDSTACK-9813
>> > URL:
>> https://issues.apache.org/jira/browse/CLOUDSTACK-9813
>> > Project: CloudStack
>> >  Issue Type: New Feature
>> >  Security Level: Public(Anyone can view this level - this is the
>> default.)
>> >  Components: KVM, Network Controller, Secondary Storage,
>> SystemVM, VMware
>> >Affects Versions: Future
>> >Reporter: Eric Waegeman
>> >Assignee: Kris Sterckx
>> >
>> > To avoid the use of an extra VM for the virtual router we implement
>> configdrive for userdata, metadata & password.
>> > The configdrive ISO is created on the secondary store and the KVM &
>> VMware plugins are adapted to accept the configdrive ISO as second cdrom.
>> > Is applicable for isolated, VPC and shared networks.
>>
>>
>>
>> --
>> This message was sent by Atlassian JIRA
>> (v6.4.14#64029)
>>
>


Re: [DISCUSS] CloudStack 4.9.3.0 (LTS)

2017-07-12 Thread Outback Dingo
On Wed, Jul 12, 2017 at 10:41 AM, Rohit Yadav  wrote:
> All,
>
>
> Please send me a list of PRs you would like to see in 4.9.3.0 so we can 
> freeze the scope for 4.9.3.0, no promises but it may be possible to have a 
> release plan as soon as next week.
>
>

Support for XenServer 7.1 would be nice


> - Rohit
>
> 
> From: Wido den Hollander 
> Sent: 12 July 2017 01:27:30
> To: Rohit Yadav; dev@cloudstack.apache.org; us...@cloudstack.apache.org
> Subject: Re: [DISCUSS] CloudStack 4.9.3.0 (LTS)
>
> Hi,
>
> I would suggest: https://github.com/apache/cloudstack/pull/2131
>
> Serious issue with Ubuntu 16.04 and statistics gathering on KVM.
>
> Wido
>
>> Op 11 juli 2017 om 11:49 schreef Rohit Yadav :
>>
>>
>> Hi Sean,
>>
>>
>> Thanks for sharing.
>>
>>
>> - Rohit
>>
>> 
>> From: Sean Lair 
>> Sent: 11 July 2017 03:41:17
>> To: dev@cloudstack.apache.org
>> Cc: us...@cloudstack.apache.org
>> Subject: RE: [DISCUSS] CloudStack 4.9.3.0 (LTS)
>>
>> Here are three issues we ran into in 4.9.2.0.  We have been running all of 
>> these fixes for several months without issues.  The code changes are all 
>> very easy/small, but had a big impact for us.
>>
>> I'd respectfully suggest they go into 4.9.3.0:
>>
>> https://github.com/apache/cloudstack/pull/2041 (VR related jobs scheduled 
>> and run twice on mgmt servers)
>> https://github.com/apache/cloudstack/pull/2040 (Bug in monitoring of S2S 
>> VPNs - also exists in 4.10)
>> https://github.com/apache/cloudstack/pull/1966 (IPSEC VPNs do not work after 
>> vRouter reboot)
>>
>> Thanks
>> Sean
>>
>> rohit.ya...@shapeblue.com
>> www.shapeblue.com
>> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>> @shapeblue
>>
>>
>>
>>
>> -Original Message-
>> From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com]
>> Sent: Friday, July 7, 2017 1:14 AM
>> To: dev@cloudstack.apache.org
>> Cc: us...@cloudstack.apache.org
>> Subject: [DISCUSS] CloudStack 4.9.3.0 (LTS)
>>
>> All,
>>
>>
>> With 4.10.0.0 voted, I would like to start some initial discussion around 
>> the next minor LTS release 4.9.3.0. At the moment I don't have a timeline, 
>> plans or dates to share but I would like to engage with the community to 
>> gather list of issues, commits, PRs that we should consider for the next LTS 
>> release 4.9.3.0.
>>
>>
>> To reduce our test and QA scope, we don't want to consider changes that are 
>> new feature, or enhancements but strictly blockers/critical/major bugfixes 
>> and security related fixes, and we can consider reverting any already 
>> committed/merged PR(s) on 4.9 branch (committed since 4.9.2.0).
>>
>>
>> Please go through list of commits since 4.9.2.0 (you can also run, git log 
>> 4.9.2.0..4.9) and let us know if there is any change we should consider 
>> reverting:
>>
>> https://github.com/apache/cloudstack/commits/4.9
>>
>>
>> I started backporting some 
>> fixes on the 4.9 branch, please go through the following PR and raise 
>> objections on changes/commits that we should not backport or revert:
>>
>> https://github.com/apache/cloudstack/pull/2052
>>
>>
>> Lastly, please also share any PRs that we should consider reviewing+merging 
>> on 4.9 branch for the 4.9.3.0 release effort.
>>
>>
>> - Rohit
>>
>> rohit.ya...@shapeblue.com
>> www.shapeblue.com
>> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
>>
>>
>>
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>


Re: [DISCUSS] Host HA in 4.11

2017-07-12 Thread Simon Weller
We are very excited about this feature set, as it adds some really important 
features for KVM.

We don't use NFS, so I think our goal will be seeing what we can contribute to 
include Ceph on the supported storage list.

- Si

From: Rohit Yadav 
Sent: Wednesday, July 12, 2017 5:43 AM
To: dev@cloudstack.apache.org
Subject: [DISCUSS] Host HA in 4.11

All,


Few months ago I had started discussion on Host HA for CloudStack and given 
4.10 is voted and to be announced with master branch cut I would like to 
re-kick discussion around reviewing and acceptance of the feature that is 
pending since Feb 2017.


To briefly share some key points:

- This feature is disabled by default and provides zone/cluster/host level kill 
switches

- This brings in a reliable way to fence (power off) and recover (reboot) a host

- Allows implementation of HA provider plugin specific to a hypervisor and 
storage stack, by default we've implemented a plugin for hosts that have KVM+NFS

- For more details please read the FS: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Host+HA
Host HA - Apache Cloudstack - Apache Software 
Foundation
cwiki.apache.org
CLOUDSTACK-9782. Branch. Yet to start, share the PR. Introduction. CloudStack 
lacks a way to reliably fence a host, the idea of the host-ha feature is to 
provide a ...





I had also given a talk about this feature during CCCNA17:

Reliable host fencing - 
http://rohit.yadav.xyz/files/talks/cccna17-reliable-host-fencing.pdf


Pull request: https://github.com/apache/cloudstack/pull/1960 (as soon as the 
4.10->4.11 db upgrade paths are fixed, I can rebase and fix the branch)
[https://avatars1.githubusercontent.com/u/95203?v=3=400]

[4.11/Future] CLOUDSTACK-9782: Host HA and KVM HA provider by rhtyd · Pull 
Request #1960 · 
apache/cloudstack
github.com
Host-HA offers investigation, fencing and recovery mechanisms for host that for 
any reason are malfunctioning. It uses Activity and Health checks to determine 
current host state based on which it m...





- Rohit

rohit.ya...@shapeblue.com
www.shapeblue.com
[http://www.shapeblue.com/wp-content/uploads/2017/06/logo.png]

Shapeblue - The CloudStack Company
www.shapeblue.com
Rapid deployment framework for Apache CloudStack IaaS Clouds. CSForge is a 
framework developed by ShapeBlue to deliver the rapid deployment of a 
standardised ...



53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue





Re: [DISCUSS] CloudStack 4.9.3.0 (LTS)

2017-07-12 Thread Rohit Yadav
All,


Please send me a list of PRs you would like to see in 4.9.3.0 so we can freeze 
the scope for 4.9.3.0, no promises but it may be possible to have a release 
plan as soon as next week.


- Rohit


From: Wido den Hollander 
Sent: 12 July 2017 01:27:30
To: Rohit Yadav; dev@cloudstack.apache.org; us...@cloudstack.apache.org
Subject: Re: [DISCUSS] CloudStack 4.9.3.0 (LTS)

Hi,

I would suggest: https://github.com/apache/cloudstack/pull/2131

Serious issue with Ubuntu 16.04 and statistics gathering on KVM.

Wido

> Op 11 juli 2017 om 11:49 schreef Rohit Yadav :
>
>
> Hi Sean,
>
>
> Thanks for sharing.
>
>
> - Rohit
>
> 
> From: Sean Lair 
> Sent: 11 July 2017 03:41:17
> To: dev@cloudstack.apache.org
> Cc: us...@cloudstack.apache.org
> Subject: RE: [DISCUSS] CloudStack 4.9.3.0 (LTS)
>
> Here are three issues we ran into in 4.9.2.0.  We have been running all of 
> these fixes for several months without issues.  The code changes are all very 
> easy/small, but had a big impact for us.
>
> I'd respectfully suggest they go into 4.9.3.0:
>
> https://github.com/apache/cloudstack/pull/2041 (VR related jobs scheduled and 
> run twice on mgmt servers)
> https://github.com/apache/cloudstack/pull/2040 (Bug in monitoring of S2S VPNs 
> - also exists in 4.10)
> https://github.com/apache/cloudstack/pull/1966 (IPSEC VPNs do not work after 
> vRouter reboot)
>
> Thanks
> Sean
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>
> -Original Message-
> From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com]
> Sent: Friday, July 7, 2017 1:14 AM
> To: dev@cloudstack.apache.org
> Cc: us...@cloudstack.apache.org
> Subject: [DISCUSS] CloudStack 4.9.3.0 (LTS)
>
> All,
>
>
> With 4.10.0.0 voted, I would like to start some initial discussion around the 
> next minor LTS release 4.9.3.0. At the moment I don't have a timeline, plans 
> or dates to share but I would like to engage with the community to gather 
> list of issues, commits, PRs that we should consider for the next LTS release 
> 4.9.3.0.
>
>
> To reduce our test and QA scope, we don't want to consider changes that are 
> new feature, or enhancements but strictly blockers/critical/major bugfixes 
> and security related fixes, and we can consider reverting any already 
> committed/merged PR(s) on 4.9 branch (committed since 4.9.2.0).
>
>
> Please go through list of commits since 4.9.2.0 (you can also run, git log 
> 4.9.2.0..4.9) and let us know if there is any change we should consider 
> reverting:
>
> https://github.com/apache/cloudstack/commits/4.9
>
>
> I started backporting some 
> fixes on the 4.9 branch, please go through the following PR and raise 
> objections on changes/commits that we should not backport or revert:
>
> https://github.com/apache/cloudstack/pull/2052
>
>
> Lastly, please also share any PRs that we should consider reviewing+merging 
> on 4.9 branch for the 4.9.3.0 release effort.
>
>
> - Rohit
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
>
>
>

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 



Re: Cloudstack dev Noob start :-)

2017-07-12 Thread Daan Hoogland
Sorry Oliver, I don't think we use such a tag. Good suggestion though. For now, 
look at findbugs and such tools for things you could re-factor.

On 12/07/17 13:42, "Olivier Lamy"  wrote:

Hi
Yes I dropped all databases.
But I was trying to create manually by myself all the databases and initial
schemas manually..
Well finally reading the thread "Developer Guide - Current Setup Guide"
helped me and I found what I missed to do :-) (sorry for the noise)

As a starter I'd like to know if you have any issue flagged as
"starter/noob" level? (just some easy issue I could have a look to discover
the code)
Thanks!

Cheers
Olivier


daan.hoogl...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

On 11 July 2017 at 00:56, Daan Hoogland  wrote:

> Oliver, I am pretty sure you where having a mysql version error at
> first. This one is new to me. Did you fully remove mysql and the cloud
> database and then install mariadb? Maybe you can drop all tables and
> run the mvn command for installing a db instead of the create db
> script. just for checking
>
> On Mon, Jul 10, 2017 at 9:39 AM, Olivier Lamy  wrote:
> > Hi
> > Looks more to be a permission issue
> > Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException:
> ALTER
> > command denied to user 'cloud'@'localhost' for table 'account'
> >
> > When running create-database script I get this warning.
> >
> > sql> GRANT ALL ON cloud.* to cloud@`%` identified by 'cloud'
> > [2017-07-07 09:47:56] [HY000][1287] Using GRANT statement to modify
> > existing user's properties other than privileges is deprecated and will
> be
> > removed in future release. Use ALTER USER statement for this operation.
> >
> > Anyway I changed to MariaBD and made some progress :-)  but still an
> error.
> >
> > My steps:
> >
> > * running the following scripts to create databases: 
create-database.sql,
> > create-database-premium.sql, create-database-simulator.sql.
> >
> > * running the following scripts to create base schemas:
> create-schema.sql,
> > create-schema-premium.sql, create-schema-simulator.sql
> >
> > * start the ui with mvn -pl :cloud-client-ui jetty:run
> >
> > But now it fail with (stack trace truncated but full available here:
> > https://gist.github.com/olamy/b13e5f831b933829dd2ced7ddb5dc59b
> >
> > INFO  [c.c.u.DatabaseUpgradeChecker] (main:null) (logid:) Cleanup 
upgrade
> > Upgrade441to442 to upgrade from 4.4.1-4.4.2 to 4.4.2
> >
> > ERROR [c.c.u.d.ScriptRunner] (main:null) (logid:) Error executing: ALTER
> > TABLE `cloud`.`guest_os_hypervisor` ADD FOREIGN KEY (`guest_os_id`)
> > REFERENCES `cloud`.`guest_os`(`id`)
> >
> > ERROR [c.c.u.d.ScriptRunner] (main:null) (logid:)
> > com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViol
> ationException:
> > Cannot add or update a child row: a foreign key constraint fails
> > (`cloud`.`#sql-882f_27`, CONSTRAINT `#sql-882f_27_ibfk_1` FOREIGN KEY
> > (`guest_os_id`) REFERENCES `guest_os` (`id`))
> >
> > ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) (logid:) Unable to
> execute
> > upgrade script:
> > /Users/olamy/dev/sources/open-sources/cloudstack/cloudstack/
> client/target/utilities/scripts/db/db/schema-442to450.sql
> >
> > com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViol
> ationException:
> > Cannot add or update a child row: a foreign key constraint fails
> > (`cloud`.`#sql-882f_27`, CONSTRAINT `#sql-882f_27_ibfk_1` FOREIGN KEY
> > (`guest_os_id`) REFERENCES `guest_os` (`id`))
> >
> > ERROR [c.c.u.DatabaseUpgradeChecker] (main:null) (logid:) Unable to
> upgrade
> > the database
> >
> > com.cloud.utils.exception.CloudRuntimeException: Unable to execute
> upgrade
> > script:
> > /Users/olamy/dev/sources/open-sources/cloudstack/cloudstack/
> client/target/utilities/scripts/db/db/schema-442to450.sql
> >
> > Not sure what to do here :-(
> >
> > On 6 July 2017 at 19:22, Wido den Hollander  wrote:
> >
> >>
> >> > Op 6 juli 2017 om 9:02 schreef Olivier Lamy :
> >> >
> >> >
> >> > Hi,
> >> > Long time I didn't participate here.
> >> > I'd like to do some hacking.
> >> > I'm not clear on the process for noob :-)
> >> > I ran sql scripts:
> >> > * create-database.sql
> >> > * create-schema.sql
> >> >
> >> > Then I start with mvn -pl :cloud-client-ui jetty:run
> >> > But I got the this error (see stacktrace below)
> >> > I use osx, mysql 5.7.18_1 installed with brew
> >> >
> >> > Thanks a lot for your help
> >> >
> 

Re: Travis failing on PRs

2017-07-12 Thread Rohit Yadav
All,


Based on the reviews and Marvin test runs, I've merged and fwd-merged the 
branch to 4.10 and master branches. From now onwards, our PRs will get tested 
against latest Travis images using openjdk (previously used oraclejdk).


- Rohit


From: Rohit Yadav 
Sent: 11 July 2017 17:20:34
To: dev@cloudstack.apache.org
Subject: Travis failing on PRs

All,


Please see:

https://blog.travis-ci.com/2017-06-19-trusty-updates-2017-Q2


OracleJDK7 is no 
longer supported by Travis, switching to oraclejdk7 yields error.

Please help review and merge before 4.10 branch is cut and master is opened 
(officially) for accepting new PRs:

https://github.com/apache/cloudstack/pull/2172



- Rohit

rohit.ya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue




rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 



[DISCUSS] Host HA in 4.11

2017-07-12 Thread Rohit Yadav
All,


Few months ago I had started discussion on Host HA for CloudStack and given 
4.10 is voted and to be announced with master branch cut I would like to 
re-kick discussion around reviewing and acceptance of the feature that is 
pending since Feb 2017.


To briefly share some key points:

- This feature is disabled by default and provides zone/cluster/host level kill 
switches

- This brings in a reliable way to fence (power off) and recover (reboot) a host

- Allows implementation of HA provider plugin specific to a hypervisor and 
storage stack, by default we've implemented a plugin for hosts that have KVM+NFS

- For more details please read the FS: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Host+HA


I had also given a talk about this feature during CCCNA17:

Reliable host fencing - 
http://rohit.yadav.xyz/files/talks/cccna17-reliable-host-fencing.pdf


Pull request: https://github.com/apache/cloudstack/pull/1960 (as soon as the 
4.10->4.11 db upgrade paths are fixed, I can rebase and fix the branch)


- Rohit

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 



Re: [DISCUSS] drop support for CentOS6 with 4.10

2017-07-12 Thread Will Stevens
Thanks Rohit.

On Jul 12, 2017 6:32 AM, "Rohit Yadav"  wrote:

Hi Will,


I'm not sure what you want, but the scripts/files are here:

https://github.com/shapeblue/Trillian/tree/master/Ansible/roles


- Rohit


From: Will Stevens 
Sent: 11 July 2017 17:47:06
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] drop support for CentOS6 with 4.10

Can you link the appropriate config files so we can review the
configuration?  Thanks...



On Jul 11, 2017 8:05 AM, "Rohit Yadav"  wrote:

Will, I'll be on holidays next week and have tight schedules this month.
I'll ping Paul if he has bandwidth to contribute them.


- Rohit


From: Will Stevens 
Sent: 11 July 2017 16:41:41
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] drop support for CentOS6 with 4.10

Pierre-Luc is asking because he has been the only person contributing to
the upgrade documentation released with the new releases since around 4.4.

Rohit, would you be able to contribute an upgrade path for CentOS6
installations in the documentation for the 4.10 release?

On Jul 11, 2017 5:59 AM, "Rohit Yadav"  wrote:

> PL - yes Trillian has tested with CentOS6 + JDK8 with 4.10.0.0/master+.
>
> JRE/JDK8 are available in additional repositories on CentOS6 so at least
> for 4.10.0.0 (already votes, to be announced) we cannot deprecate it.
> However, we can discuss that for 4.11.0.0 and onwards. However, I think
> unless we're breaking major compatibilities such as API, upgrades etc. we
> should not call the next release 5.x.
>
>
> - Rohit
>
> 
> From: Pierre-Luc Dion 
> Sent: 10 July 2017 18:51:33
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] drop support for CentOS6 with 4.10
>
> In this case, if we say 4.10.0.0 can be install on centos6 it mean we need
> to provide some instruction on how to install it, and is there anyone that
> tested 4.10 packages on CentOS6 ?
>
> Cheers,
>
> On Mon, Jul 10, 2017 at 3:03 AM, Paul Angus 
> wrote:
>
> > I would suggest that this would justify a 5.0 release.. might be a good
> > time to get in any other major changes
> >
> >
> >
> > Kind regards,
> >
> > Paul Angus
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Pierre-Luc Dion [mailto:pdion...@apache.org]
> > Sent: 09 July 2017 13:46
> > To: dev@cloudstack.apache.org
> > Subject: [DISCUSS] drop support for CentOS6 with 4.10
> >
> > Since 4.10 require JDK8, should we drop support for CentOS 6 as OS for
> > management-server and usage ?
> >
> > all the Upgrade path tests I've made was by creating new management
> server
> > on CentOS 7 that have updated tomcat and openJDK 8.  our packages (RPMs)
> > install well on centos7 and I'm not away somebody test them on centos6.
> >
> > Should we call a vote on this?  I'm writing the upgrade part of the
> > release notes and I would focus on centos7 only. we should also update
> our
> > Quick Install Guide...
> >
> >
> > Thanks,
> >
> > PL
> >
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>

rohit.ya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

rohit.ya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue


Re: [DISCUSS] drop support for CentOS6 with 4.10

2017-07-12 Thread Rohit Yadav
Hi Will,


I'm not sure what you want, but the scripts/files are here:

https://github.com/shapeblue/Trillian/tree/master/Ansible/roles


- Rohit


From: Will Stevens 
Sent: 11 July 2017 17:47:06
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] drop support for CentOS6 with 4.10

Can you link the appropriate config files so we can review the
configuration?  Thanks...



On Jul 11, 2017 8:05 AM, "Rohit Yadav"  wrote:

Will, I'll be on holidays next week and have tight schedules this month.
I'll ping Paul if he has bandwidth to contribute them.


- Rohit


From: Will Stevens 
Sent: 11 July 2017 16:41:41
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] drop support for CentOS6 with 4.10

Pierre-Luc is asking because he has been the only person contributing to
the upgrade documentation released with the new releases since around 4.4.

Rohit, would you be able to contribute an upgrade path for CentOS6
installations in the documentation for the 4.10 release?

On Jul 11, 2017 5:59 AM, "Rohit Yadav"  wrote:

> PL - yes Trillian has tested with CentOS6 + JDK8 with 4.10.0.0/master+.
>
> JRE/JDK8 are available in additional repositories on CentOS6 so at least
> for 4.10.0.0 (already votes, to be announced) we cannot deprecate it.
> However, we can discuss that for 4.11.0.0 and onwards. However, I think
> unless we're breaking major compatibilities such as API, upgrades etc. we
> should not call the next release 5.x.
>
>
> - Rohit
>
> 
> From: Pierre-Luc Dion 
> Sent: 10 July 2017 18:51:33
> To: dev@cloudstack.apache.org
> Subject: Re: [DISCUSS] drop support for CentOS6 with 4.10
>
> In this case, if we say 4.10.0.0 can be install on centos6 it mean we need
> to provide some instruction on how to install it, and is there anyone that
> tested 4.10 packages on CentOS6 ?
>
> Cheers,
>
> On Mon, Jul 10, 2017 at 3:03 AM, Paul Angus 
> wrote:
>
> > I would suggest that this would justify a 5.0 release.. might be a good
> > time to get in any other major changes
> >
> >
> >
> > Kind regards,
> >
> > Paul Angus
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Pierre-Luc Dion [mailto:pdion...@apache.org]
> > Sent: 09 July 2017 13:46
> > To: dev@cloudstack.apache.org
> > Subject: [DISCUSS] drop support for CentOS6 with 4.10
> >
> > Since 4.10 require JDK8, should we drop support for CentOS 6 as OS for
> > management-server and usage ?
> >
> > all the Upgrade path tests I've made was by creating new management
> server
> > on CentOS 7 that have updated tomcat and openJDK 8.  our packages (RPMs)
> > install well on centos7 and I'm not away somebody test them on centos6.
> >
> > Should we call a vote on this?  I'm writing the upgrade part of the
> > release notes and I would focus on centos7 only. we should also update
> our
> > Quick Install Guide...
> >
> >
> > Thanks,
> >
> > PL
> >
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>

rohit.ya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 



Re: Usage Server in Docker Simulator

2017-07-12 Thread Daan Hoogland
John,



too bad but that indeed means it isn’t running. You can double check with



# service cloudstack-usage status

cloudstack-usage is stopped



and if need be



# service cloudstack-usage start

Starting CloudStack Usage Monitor cloudstack-usage [  OK  ]



I am not running the container usually so I am not sure if it uses systemctl 
for controlling services instead. Just running it in hindsight should™n’t hurt 
your use case.



On 12/07/17 00:24, "John McDonnell"  wrote:



Hi,



I asked this back in April on the Users mailing list and the response

I got was that the usage server should be on by default in the docker

container.  I got sidetracked by other things and am coming back to

this issue.



Is it meant to be running by default? or is there something needed to

do to turn it on in the container?  (wasn't sure if this is a defect,

so thought I'd ask here.)





I use the container as a development tool(to avoid using a real life

system) to test the API out and usage collection is a major part of

what I use the API for.





Steps to reproduce:



(Have docker installed)

$ docker pull cloudstack/simulator

$ docker run --name cloudstack -d -p 8080:8080 cloudstack/simulator

$ docker exec -ti cloudstack python \

/root/tools/marvin/marvin/deployDataCenter.py -i 
/root/setup/dev/advanced.cfg



After a while login to the UI: localhost:8080/client (admin:password)



And usually, after a while, there will be a General Alert saying there

is no Usage Server running.  Even before this message, if I add an

instance, and attempt to collection usage with the API, I don't get

anything back.



Any help?



daan.hoogl...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 



Re: Usage Server in Docker Simulator

2017-07-12 Thread Daan Hoogland
Ok, then it isn’t installed but that it can. 
# yum install cloudstack-usageit makes sense to look at the docker definition 
and do it there

On 12/07/17 09:07, "John McDonnell"  wrote:

Hi,

Any idea how to start it when running in the Docker simulator?

Obviously the service talked about here[1] isn’t available in the 
container, so I can’t just 'service cloudstack-usage restart’.


[1]: 
https://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.8/usage.html#configuring-the-usage-server
 



John


daan.hoogl...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

> On 12 Jul 2017, at 06:33, Erik Weber  wrote:
> 
> Are you running the usage server?
> 
> It is a different service and run independently of the mgmt server
> 
> -- 
> Erik
> 
> ons. 12. jul. 2017 kl. 00.25 skrev John McDonnell 
> :
> 
>> Hi,
>> 
>> I asked this back in April on the Users mailing list and the response
>> I got was that the usage server should be on by default in the docker
>> container.  I got sidetracked by other things and am coming back to
>> this issue.
>> 
>> Is it meant to be running by default? or is there something needed to
>> do to turn it on in the container?  (wasn't sure if this is a defect,
>> so thought I'd ask here.)
>> 
>> 
>> I use the container as a development tool(to avoid using a real life
>> system) to test the API out and usage collection is a major part of
>> what I use the API for.
>> 
>> 
>> Steps to reproduce:
>> 
>> (Have docker installed)
>> $ docker pull cloudstack/simulator
>> $ docker run --name cloudstack -d -p 8080:8080 cloudstack/simulator
>> $ docker exec -ti cloudstack python \
>> /root/tools/marvin/marvin/deployDataCenter.py -i
>> /root/setup/dev/advanced.cfg
>> 
>> After a while login to the UI: localhost:8080/client (admin:password)
>> 
>> And usually, after a while, there will be a General Alert saying there
>> is no Usage Server running.  Even before this message, if I add an
>> instance, and attempt to collection usage with the API, I don't get
>> anything back.
>> 
>> Any help?
>> 





Re: Usage Server in Docker Simulator

2017-07-12 Thread Daan Hoogland
maybe a double post due to mail issues:

Ok, then it isn’t installed but that it can.
# yum install cloudstack-usage
assuming centos as base. It makes sense to look at the docker
definition and do it there

On Wed, Jul 12, 2017 at 9:07 AM, John McDonnell
 wrote:
> Hi,
>
> Any idea how to start it when running in the Docker simulator?
>
> Obviously the service talked about here[1] isn’t available in the container, 
> so I can’t just 'service cloudstack-usage restart’.
>
>
> [1]: 
> https://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.8/usage.html#configuring-the-usage-server
>  
> 
>
>
> John
>
>> On 12 Jul 2017, at 06:33, Erik Weber  wrote:
>>
>> Are you running the usage server?
>>
>> It is a different service and run independently of the mgmt server
>>
>> --
>> Erik
>>
>> ons. 12. jul. 2017 kl. 00.25 skrev John McDonnell >> :
>>
>>> Hi,
>>>
>>> I asked this back in April on the Users mailing list and the response
>>> I got was that the usage server should be on by default in the docker
>>> container.  I got sidetracked by other things and am coming back to
>>> this issue.
>>>
>>> Is it meant to be running by default? or is there something needed to
>>> do to turn it on in the container?  (wasn't sure if this is a defect,
>>> so thought I'd ask here.)
>>>
>>>
>>> I use the container as a development tool(to avoid using a real life
>>> system) to test the API out and usage collection is a major part of
>>> what I use the API for.
>>>
>>>
>>> Steps to reproduce:
>>>
>>> (Have docker installed)
>>> $ docker pull cloudstack/simulator
>>> $ docker run --name cloudstack -d -p 8080:8080 cloudstack/simulator
>>> $ docker exec -ti cloudstack python \
>>> /root/tools/marvin/marvin/deployDataCenter.py -i
>>> /root/setup/dev/advanced.cfg
>>>
>>> After a while login to the UI: localhost:8080/client (admin:password)
>>>
>>> And usually, after a while, there will be a General Alert saying there
>>> is no Usage Server running.  Even before this message, if I add an
>>> instance, and attempt to collection usage with the API, I don't get
>>> anything back.
>>>
>>> Any help?
>>>
>



-- 
Daan


Re: Usage Server in Docker Simulator

2017-07-12 Thread John McDonnell
Hi,

Any idea how to start it when running in the Docker simulator?

Obviously the service talked about here[1] isn’t available in the container, so 
I can’t just 'service cloudstack-usage restart’.


[1]: 
https://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.8/usage.html#configuring-the-usage-server
 



John

> On 12 Jul 2017, at 06:33, Erik Weber  wrote:
> 
> Are you running the usage server?
> 
> It is a different service and run independently of the mgmt server
> 
> -- 
> Erik
> 
> ons. 12. jul. 2017 kl. 00.25 skrev John McDonnell > :
> 
>> Hi,
>> 
>> I asked this back in April on the Users mailing list and the response
>> I got was that the usage server should be on by default in the docker
>> container.  I got sidetracked by other things and am coming back to
>> this issue.
>> 
>> Is it meant to be running by default? or is there something needed to
>> do to turn it on in the container?  (wasn't sure if this is a defect,
>> so thought I'd ask here.)
>> 
>> 
>> I use the container as a development tool(to avoid using a real life
>> system) to test the API out and usage collection is a major part of
>> what I use the API for.
>> 
>> 
>> Steps to reproduce:
>> 
>> (Have docker installed)
>> $ docker pull cloudstack/simulator
>> $ docker run --name cloudstack -d -p 8080:8080 cloudstack/simulator
>> $ docker exec -ti cloudstack python \
>> /root/tools/marvin/marvin/deployDataCenter.py -i
>> /root/setup/dev/advanced.cfg
>> 
>> After a while login to the UI: localhost:8080/client (admin:password)
>> 
>> And usually, after a while, there will be a General Alert saying there
>> is no Usage Server running.  Even before this message, if I add an
>> instance, and attempt to collection usage with the API, I don't get
>> anything back.
>> 
>> Any help?
>> 



Re: [4.10] repos

2017-07-12 Thread Daan Hoogland
https://builds.cloudstack.org/view/release/job/build-systemvm is configured to 
push the systemvm for a version taken from a parameter

On 12/07/17 08:45, "Rajani Karuturi"  wrote:

AFAIK, there is no job that automatically pushes templates. I
manually copied the templates from build
https://builds.cloudstack.org/view/master/job/build-master-systemvm/272/
to http://download.cloudstack.org/systemvm/4.10/

Thanks,

~ Rajani

http://cloudplatform.accelerite.com/

On July 12, 2017 at 5:36 AM, Pierre-Luc Dion
(pdion...@apache.org) wrote:

Hi,

I've created new jenkins jobs [1] to create package for our
release, The
jobs pushed rpm's but for systemvm, look like there is a wget
job somewhere
that download systemvm template from jenkins from build of
master branch,
I've created a set of systemvm templates that I would like to
published on
download.cloudstack.org but they are most likely going to be
overwritten,
could we disable that job ?

[1] https://builds.cloudstack.org/view/release/

PL


daan.hoogl...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 



Re: next major release

2017-07-12 Thread Daan Hoogland
Thanks Rajani,
I created the upgrade paths and am no test compiling. Expect a PR in the next 
hour (I added the new path to every version not just past 4.0)

On 12/07/17 08:41, "Rajani Karuturi"  wrote:

I made the pom changes on master to 4.11.0.0-SNAPSHOT

4.10 branch is created

master and 4.10 can now accept changes once the upgrade paths are
in place.

Release notes and release announcement are the pending items now.

Thanks,

~ Rajani

http://cloudplatform.accelerite.com/

On July 12, 2017 at 1:23 AM, Wido den Hollander (w...@widodh.nl)
wrote:

I would say 4.11

5.0 should have major changes (like mentioned), API changes or
other big things. It should have 'killer features'. New GUI, New
API, etc. That kind of things.

Wido

Op 10 juli 2017 om 7:09 schreef Rajani Karuturi
:

should it be 4.11.0.0 or 5.0.0.0?

~Rajani
http://cloudplatform.accelerite.com/


daan.hoogl...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 



Re: [4.10] repos

2017-07-12 Thread Rajani Karuturi
AFAIK, there is no job that automatically pushes templates. I
manually copied the templates from build
https://builds.cloudstack.org/view/master/job/build-master-systemvm/272/
to http://download.cloudstack.org/systemvm/4.10/

Thanks,

~ Rajani

http://cloudplatform.accelerite.com/

On July 12, 2017 at 5:36 AM, Pierre-Luc Dion
(pdion...@apache.org) wrote:

Hi,

I've created new jenkins jobs [1] to create package for our
release, The
jobs pushed rpm's but for systemvm, look like there is a wget
job somewhere
that download systemvm template from jenkins from build of
master branch,
I've created a set of systemvm templates that I would like to
published on
download.cloudstack.org but they are most likely going to be
overwritten,
could we disable that job ?

[1] https://builds.cloudstack.org/view/release/

PL

Re: next major release

2017-07-12 Thread Rajani Karuturi
I made the pom changes on master to 4.11.0.0-SNAPSHOT

4.10 branch is created

master and 4.10 can now accept changes once the upgrade paths are
in place.

Release notes and release announcement are the pending items now.

Thanks,

~ Rajani

http://cloudplatform.accelerite.com/

On July 12, 2017 at 1:23 AM, Wido den Hollander (w...@widodh.nl)
wrote:

I would say 4.11

5.0 should have major changes (like mentioned), API changes or
other big things. It should have 'killer features'. New GUI, New
API, etc. That kind of things.

Wido

Op 10 juli 2017 om 7:09 schreef Rajani Karuturi
:

should it be 4.11.0.0 or 5.0.0.0?

~Rajani
http://cloudplatform.accelerite.com/

Re: Usage Server in Docker Simulator

2017-07-12 Thread Erik Weber
Are you running the usage server?

It is a different service and run independently of the mgmt server

-- 
Erik

ons. 12. jul. 2017 kl. 00.25 skrev John McDonnell :

> Hi,
>
> I asked this back in April on the Users mailing list and the response
> I got was that the usage server should be on by default in the docker
> container.  I got sidetracked by other things and am coming back to
> this issue.
>
> Is it meant to be running by default? or is there something needed to
> do to turn it on in the container?  (wasn't sure if this is a defect,
> so thought I'd ask here.)
>
>
> I use the container as a development tool(to avoid using a real life
> system) to test the API out and usage collection is a major part of
> what I use the API for.
>
>
> Steps to reproduce:
>
> (Have docker installed)
> $ docker pull cloudstack/simulator
> $ docker run --name cloudstack -d -p 8080:8080 cloudstack/simulator
> $ docker exec -ti cloudstack python \
> /root/tools/marvin/marvin/deployDataCenter.py -i
> /root/setup/dev/advanced.cfg
>
> After a while login to the UI: localhost:8080/client (admin:password)
>
> And usually, after a while, there will be a General Alert saying there
> is no Usage Server running.  Even before this message, if I add an
> instance, and attempt to collection usage with the API, I don't get
> anything back.
>
> Any help?
>


Re: [4.10] repos

2017-07-12 Thread Daan Hoogland
Monsieur,

The job should be altered to go into 4.11. lemme look.

On 12/07/17 02:06, "Pierre-Luc Dion"  wrote:

Hi,

I've created new jenkins jobs [1] to create package for our release, The
jobs pushed rpm's but for systemvm, look like there is a wget job somewhere
that download systemvm template from jenkins from build of master branch,
I've created a set of systemvm templates that I would like to published on
download.cloudstack.org but they are most likely going to be overwritten,
could we disable that job ?

[1] https://builds.cloudstack.org/view/release/

PL



daan.hoogl...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue