Re: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC3]

2018-06-22 Thread Tutkowski, Mike
+1 (binding) (Based on my testing of RC1 and not seeing anything that concerned 
me going into RC2 or RC3.)

On 6/21/18, 9:59 AM, "Paul Angus"  wrote:

Hi All,



I've created a 4.11.1.0 release (RC3), with the following artefacts up for 
testing and a vote:
The changes since RC2 are listed at the end of this email.



Git Branch and Commit SH:


https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.11.1.0-RC20180621T1552

Commit: 2cb2dacbe75a23f5068b80f6ea45031c29052c31



Source release (checksums and signatures are available at the same

location):

https://dist.apache.org/repos/dist/dev/cloudstack/4.11.1.0/



PGP release keys (signed using 8B309F7251EE0BC8):

https://dist.apache.org/repos/dist/release/cloudstack/KEYS



The vote will be open for at least 72hrs.



For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?



[ ] +1  approve

[ ] +0  no opinion

[ ] -1  disapprove (and reason why)





Additional information:



For users' convenience, I've built packages from 
5f48487dc62fd1decaabc4ab2a10f549d6c82400 and published RC1 repository here:

http://packages.shapeblue.com/testing/4111rc3/



The release notes are still work-in-progress, but the systemvm template 
upgrade section has been updated. You may refer the following for systemvm 
template upgrade testing:


http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/index.html



4.11.1 systemvm templates are available from here:

http://packages.shapeblue.com/systemvmtemplate/4.11.1-rc1/




Changes Since RC2:

Merged #2712 reuse ip for non redundant VPC 6 hours ago
Merged #2714 send unsupported answer only when applicable 10 hours ago
Merged #2715 smoketest: Fix test_vm_life_cycle secure migration tests a day 
ago
Merged #2493 CLOUDSTACK-10326: Prevent hosts fall into Maintenance when 
there are running VMs on it a day ago
Merged #2716 configdrive: make fewer mountpoints on hosts a day ago
Merged #2681 Source NAT option on Private Gateway 2 days ago
Merged #2710 comply with api key constraint 2 days ago
Merged #2706 packaging: use libuuid x86_64 package for cloudstack-common 2 
days ago

Kind regards,

Paul Angus


paul.an...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 





Re: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC3]

2018-06-22 Thread Daan Hoogland
Sean,
I've been busy with that scenario for a while and it is not a consistent
error. I have the feeling that it happens more4 lately but just yesterday I
manually testit several times 2 VPC with connected private gw and static
routes to each other. I could restart with no problem.

On Fri, Jun 22, 2018 at 5:46 PM, Sean Lair  wrote:

> Would someone mind testing testing a Restart VPC w/ Cleanup on a VPC that
> has a private gateway configured?  The test 
> "test_03_vpc_privategw_restart_vpc_cleanup"
> is failing due to the following (according to logs).  My test environment
> is not available right now so I can't check myself.  I don't have this
> problem in my 4.9.3 prod environment.
>
> 
> Java.lang.NullPointerException
> at com.cloud.network.router.NicProfileHelperImpl.
> createPrivateNicProfileForGateway(NicProfileHelperImpl.java:95)
> 
>
> 
> NicProfileHelperImpl.java (Lines 93 - 95)
> 
> final PrivateIpAddress ip =
> new PrivateIpAddress(ipVO, 
> privateNetwork.getBroadcastUri().toString(),
> privateNetwork.getGateway(), netmask,
> NetUtils.long2Mac(NetUtils.
> createSequenceBasedMacAddress(ipVO.getMacAddress(),
> NetworkModel.MACIdentifier.value(;
>
>
> Thanks
> Sean
>
> -Original Message-
> From: Paul Angus [mailto:paul.an...@shapeblue.com]
> Sent: Thursday, June 21, 2018 11:00 AM
> To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
> Subject: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC3]
>
> Hi All,
>
>
>
> I've created a 4.11.1.0 release (RC3), with the following artefacts up for
> testing and a vote:
> The changes since RC2 are listed at the end of this email.
>
>
>
> Git Branch and Commit SH:
>
> https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=
> shortlog;h=refs/heads/4.11.1.0-RC20180621T1552
>
> Commit: 2cb2dacbe75a23f5068b80f6ea45031c29052c31
>
>
>
> Source release (checksums and signatures are available at the same
>
> location):
>
> https://dist.apache.org/repos/dist/dev/cloudstack/4.11.1.0/
>
>
>
> PGP release keys (signed using 8B309F7251EE0BC8):
>
> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>
>
>
> The vote will be open for at least 72hrs.
>
>
>
> For sanity in tallying the vote, can PMC members please be sure to
> indicate "(binding)" with their vote?
>
>
>
> [ ] +1  approve
>
> [ ] +0  no opinion
>
> [ ] -1  disapprove (and reason why)
>
>
>
>
>
> Additional information:
>
>
>
> For users' convenience, I've built packages from
> 5f48487dc62fd1decaabc4ab2a10f549d6c82400 and published RC1 repository
> here:
>
> http://packages.shapeblue.com/testing/4111rc3/
>
>
>
> The release notes are still work-in-progress, but the systemvm template
> upgrade section has been updated. You may refer the following for systemvm
> template upgrade testing:
>
> http://docs.cloudstack.apache.org/projects/cloudstack-
> release-notes/en/latest/index.html
>
>
>
> 4.11.1 systemvm templates are available from here:
>
> http://packages.shapeblue.com/systemvmtemplate/4.11.1-rc1/
>
>
>
>
> Changes Since RC2:
>
> Merged #2712 reuse ip for non redundant VPC 6 hours ago Merged #2714 send
> unsupported answer only when applicable 10 hours ago Merged #2715
> smoketest: Fix test_vm_life_cycle secure migration tests a day ago Merged
> #2493 CLOUDSTACK-10326: Prevent hosts fall into Maintenance when there are
> running VMs on it a day ago Merged #2716 configdrive: make fewer
> mountpoints on hosts a day ago Merged #2681 Source NAT option on Private
> Gateway 2 days ago Merged #2710 comply with api key constraint 2 days ago
> Merged #2706 packaging: use libuuid x86_64 package for cloudstack-common 2
> days ago
>
> Kind regards,
>
> Paul Angus
>
>
> paul.an...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
>
>
>
>


-- 
Daan


RE: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC3]

2018-06-22 Thread Sean Lair
Would someone mind testing testing a Restart VPC w/ Cleanup on a VPC that has a 
private gateway configured?  The test 
"test_03_vpc_privategw_restart_vpc_cleanup" is failing due to the following 
(according to logs).  My test environment is not available right now so I can't 
check myself.  I don't have this problem in my 4.9.3 prod environment. 


Java.lang.NullPointerException
at 
com.cloud.network.router.NicProfileHelperImpl.createPrivateNicProfileForGateway(NicProfileHelperImpl.java:95)



NicProfileHelperImpl.java (Lines 93 - 95)

final PrivateIpAddress ip =
new PrivateIpAddress(ipVO, 
privateNetwork.getBroadcastUri().toString(), privateNetwork.getGateway(), 
netmask,

NetUtils.long2Mac(NetUtils.createSequenceBasedMacAddress(ipVO.getMacAddress(), 
NetworkModel.MACIdentifier.value(;


Thanks
Sean

-Original Message-
From: Paul Angus [mailto:paul.an...@shapeblue.com] 
Sent: Thursday, June 21, 2018 11:00 AM
To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
Subject: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC3]

Hi All,



I've created a 4.11.1.0 release (RC3), with the following artefacts up for 
testing and a vote:
The changes since RC2 are listed at the end of this email.



Git Branch and Commit SH:

https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.11.1.0-RC20180621T1552

Commit: 2cb2dacbe75a23f5068b80f6ea45031c29052c31



Source release (checksums and signatures are available at the same

location):

https://dist.apache.org/repos/dist/dev/cloudstack/4.11.1.0/



PGP release keys (signed using 8B309F7251EE0BC8):

https://dist.apache.org/repos/dist/release/cloudstack/KEYS



The vote will be open for at least 72hrs.



For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?



[ ] +1  approve

[ ] +0  no opinion

[ ] -1  disapprove (and reason why)





Additional information:



For users' convenience, I've built packages from 
5f48487dc62fd1decaabc4ab2a10f549d6c82400 and published RC1 repository here:

http://packages.shapeblue.com/testing/4111rc3/



The release notes are still work-in-progress, but the systemvm template upgrade 
section has been updated. You may refer the following for systemvm template 
upgrade testing:

http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/index.html



4.11.1 systemvm templates are available from here:

http://packages.shapeblue.com/systemvmtemplate/4.11.1-rc1/




Changes Since RC2:

Merged #2712 reuse ip for non redundant VPC 6 hours ago Merged #2714 send 
unsupported answer only when applicable 10 hours ago Merged #2715 smoketest: 
Fix test_vm_life_cycle secure migration tests a day ago Merged #2493 
CLOUDSTACK-10326: Prevent hosts fall into Maintenance when there are running 
VMs on it a day ago Merged #2716 configdrive: make fewer mountpoints on hosts a 
day ago Merged #2681 Source NAT option on Private Gateway 2 days ago Merged 
#2710 comply with api key constraint 2 days ago Merged #2706 packaging: use 
libuuid x86_64 package for cloudstack-common 2 days ago

Kind regards,

Paul Angus


paul.an...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
  
 



Infra Shutdown (Jenkins?)

2018-06-22 Thread Will Stevens
Hey Everyone,
So CloudOps took over paying for a Citrix AWS account a couple years ago
which apparently has VMs which is supporting the ACS community.  This
account has been costing us about $500/month, so we want to make sure the
VMs are actually used.

I am shutting down the following VMs and if things stop working, please let
me know...

- jenkins.cloudstack.org | IP: 75.101.146.23 | KeyPair: davidnalley
- deb build large | IP: 54.242.16.44 | KeyPair: edison
-  | IP: 54.90.178.215 | KeyPair: davidnalley
- PEOPLE AND FPASTE | IP: 107.21.237.59 | KeyPair: davidnalley

If any of these VMs mean anything to you, please reach out to me.  I can't
justify paying for them if I don't know they are used.

Thanks,

*Will Stevens*
Chief Technology Officer
c 514.826.0190




Re: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC3]

2018-06-22 Thread Boris Stoyanov
+1

I’ve executed an upgrade from 4.9 and 4.10 and was able to execute some basic 
lifecycle operations around VMs. Also VR upgrade was successful and registering 
and using new templates. Smoketest results are also looking good. I’ve 
performed my testing on KVM(centOS7) VMware 55u3 and Xen 65sp1.

Regards,
Bobby.


boris.stoya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

On 22 Jun 2018, at 8:52, Rohit Yadav 
mailto:rohit.ya...@shapeblue.com>> wrote:

+1 (binding) based on smoketests results [1] and manual tests on building and 
testing in a local env.


[1] https://github.com/apache/cloudstack/pull/2376#issuecomment-399059806


For reference, the tarball artifacts only had the signature file missing, I've 
added the asc file now and verified localy against the tar.bz2 file:

gpg -v --verify apache-cloudstack-4.11.1.0-src.tar.bz2.asc 
apache-cloudstack-4.11.1.0-src.tar.bz2
gpg: Signature made Fri 22 Jun 2018 11:15:02 AM IST
gpg:using RSA key 484248210EE3D884
gpg: using pgp trust model
gpg: Good signature from "Rohit Yadav (code signing key) 
mailto:ro...@apache.org>>" [ultimate]
gpg: aka "Rohit Yadav 
mailto:rohit@yadav.cloud>>" [ultimate]
gpg: aka "Rohit Yadav 
mailto:ro...@scaleninja.com>>" [ultimate]
gpg: aka "Rohit Yadav 
mailto:rohit.ya...@shapeblue.com>>" [ultimate]
gpg: binary signature, digest algorithm SHA256, key algorithm rsa4096



- Rohit

>




From: Paul Angus mailto:paul.an...@shapeblue.com>>
Sent: Thursday, June 21, 2018 9:29:47 PM
To: dev@cloudstack.apache.org; 
us...@cloudstack.apache.org
Subject: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC3]

Hi All,



I've created a 4.11.1.0 release (RC3), with the following artefacts up for 
testing and a vote:
The changes since RC2 are listed at the end of this email.



Git Branch and Commit SH:

https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.11.1.0-RC20180621T1552

Commit: 2cb2dacbe75a23f5068b80f6ea45031c29052c31



Source release (checksums and signatures are available at the same

location):

https://dist.apache.org/repos/dist/dev/cloudstack/4.11.1.0/



PGP release keys (signed using 8B309F7251EE0BC8):

https://dist.apache.org/repos/dist/release/cloudstack/KEYS



The vote will be open for at least 72hrs.



For sanity in tallying the vote, can PMC members please be sure to indicate 
"(binding)" with their vote?



[ ] +1  approve

[ ] +0  no opinion

[ ] -1  disapprove (and reason why)





Additional information:



For users' convenience, I've built packages from 
5f48487dc62fd1decaabc4ab2a10f549d6c82400 and published RC1 repository here:

http://packages.shapeblue.com/testing/4111rc3/



The release notes are still work-in-progress, but the systemvm template upgrade 
section has been updated. You may refer the following for systemvm template 
upgrade testing:

http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/index.html



4.11.1 systemvm templates are available from here:

http://packages.shapeblue.com/systemvmtemplate/4.11.1-rc1/




Changes Since RC2:

Merged #2712 reuse ip for non redundant VPC 6 hours ago
Merged #2714 send unsupported answer only when applicable 10 hours ago
Merged #2715 smoketest: Fix test_vm_life_cycle secure migration tests a day ago
Merged #2493 CLOUDSTACK-10326: Prevent hosts fall into Maintenance when there 
are running VMs on it a day ago
Merged #2716 configdrive: make fewer mountpoints on hosts a day ago
Merged #2681 Source NAT option on Private Gateway 2 days ago
Merged #2710 comply with api key constraint 2 days ago
Merged #2706 packaging: use libuuid x86_64 package for cloudstack-common 2 days 
ago

Kind regards,

Paul Angus


paul.an...@shapeblue.com
www.shapeblue.com>
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue




rohit.ya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue



Re: cyclic package dependncy in KVM hypervisor plugin

2018-06-22 Thread Rohit Yadav
Yes, I'm bothered by this as well Daan. But I can live with this pattern.


- Rohit






From: Daan Hoogland 
Sent: Monday, June 18, 2018 4:57:18 PM
To: dev
Subject: cyclic package dependncy in KVM hypervisor plugin

Devs,

I just noticed that com.cloud.hypervisor.kvm.resource.wrapper and its
parent package com.cloud.hypervisor.kvm.resource have a number cyclic
dependencies. These seem to be very old and only a way of organising the
command wrappers. They do prevent intellij from navigating properly though.
Anybody else is bothered by this, or just me?

--
Daan

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 



Re: [DISCUSS] Blocking the creation of new Basic Networking zones

2018-06-22 Thread Rohit Yadav
Good idea, but a lot of things supported in advanced zone with KVM may not be 
supported in case of VMware, XenServer etc. The larger refactoring will need to 
account for how in various places checks exists how behaviors are enforced when 
the zone is basic or not, and what kind of impact will it have on non-KVM users 
using basic zone (if any) along with having an upgrade path for such users.


If the overall functionality is retained and a seamless upgrade path can be 
created a new major release 5.0 is not be necessary (that should be a different 
thread with inputs from various stakeholders on various topics).


Wrt support of the next Java version, we'll need to consider the distro 
provided Java version for a long time Java8 will be supported [1] but newer 
versions Java 9/10 onwards are short-term non-LTS releases, debian testing/next 
don't even have openjdk-9/10 packages yet.


[1] http://www.oracle.com/technetwork/java/javase/eol-135779.html


- Rohit






From: Wido den Hollander 
Sent: Thursday, June 21, 2018 8:26:40 PM
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] Blocking the creation of new Basic Networking zones

For now I've created a Pull Request so we can have a discussion about it
there: https://github.com/apache/cloudstack/pull/2720

Wido

On 06/21/2018 02:34 PM, Gabriel Beims Bräscher wrote:
> +1
>
> We have an empty page regarding 5.0 [1] in the Design documents section
> [2]. It might be a good spot to sort out CloudStack 5.0 plans.
>
> [1]
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/5.0+Design+Documents
> [2] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Design
>
> 2018-06-21 5:58 GMT-03:00 Daan Hoogland :
>
>> well, that one is a good one to update, but there was a dedicated 5.0 page
>> at some time. I think we can just use this from here on in and merge
>> anything else in it when we find it ;)
>>
>> On Thu, Jun 21, 2018 at 8:49 AM, Rafael Weingärtner <
>> rafaelweingart...@gmail.com> wrote:
>>
>>> This one [1]?
>>>
>>> [1] https://cwiki.apache.org/confluence/display/CLOUDSTACK/Roadmap
>>>
>>> On Thu, Jun 21, 2018 at 10:46 AM, Daan Hoogland >>
>>> wrote:
>>>
 Wido, there used to be a page on cwiki with plans for 5.0, I can not
>> find
 it anymore but this should be added to it.

 On Wed, Jun 20, 2018 at 6:42 PM, ilya musayev <
 ilya.mailing.li...@gmail.com>
 wrote:

> I think the simplicity of Basic Zone was - you can get away with 1
>> VLAN
> for everything (great for POC setup) where as Advanced Shared with
>> VLAN
> isolation requires several VLANs to get going.
>
> How would we cover this use case?
>
> On Wed, Jun 20, 2018 at 11:34 AM Tutkowski, Mike <
> mike.tutkow...@netapp.com> wrote:
>
>> Also, yes, I agree with the list you provided, Wido. We might have
>> to
>> break “other fancy stuff” into more detail, though. ;)
>>
>> On 6/20/18, 12:32 PM, "Tutkowski, Mike" 
>> wrote:
>>
>> Sorry, Wido :) I missed that part.
>>
>> On 6/20/18, 5:03 AM, "Wido den Hollander" 
>> wrote:
>>
>>
>>
>> On 06/20/2018 12:31 AM, Tutkowski, Mike wrote:
>> > If this initiative goes through, perhaps that’s a good
>> time
>>> to
>> bump CloudStack’s release number to 5.0.0?
>> >
>>
>> That's what I said in my e-mail :-) But yes, I agree with
>> you,
>> this
>> might be a good time to bump it to 5.0
>>
>> With that we would:
>>
>> - Drop creation of new Basic Networking Zones
>> - Support IPv6 in shared IPv6 networks
>> - Java 9?
>> - Drop support for Ubuntu 12.04
>> - Other fancy stuff?
>> - Support ConfigDrive in all scenarios properly
>>
>> How would that sound?
>>
>> Wido
>>
>> >> On Jun 19, 2018, at 3:17 PM, Wido den Hollander <
>> w...@widodh.nl> wrote:
>> >>
>> >>
>> >>
>> >>> On 06/19/2018 11:07 PM, Daan Hoogland wrote:
>> >>> I like this initiative, and here comes the big but even
>> though I myself
>> >>> might think it is not valid; Basic zones are there to
>>> give a
>> simple start
>> >>> for new users. If we can give a one-knob start/one page
>> wizard for creating
>> >>> a shared network in advanced zone with security groups
>> and
>> userdata, great.
>> >>
>> >> That would be a UI thing, but it would be a matter of
>> using
>> VLAN
>> >> isolation and giving in VLAN 0 or 'untagged', because
>>> that's
>> basically
>> >> what Basic Networking does.
>> >>
>> >> It plugs the VM on top of usually cloudbr0 (KVM).
>> >>
>> >> If you use vlan://untagged