Re: [UPDATE] Debian 9 "stretch" systemvmtemplate for master

[Wido den Hollander]

Awesome work!

More replies below

On 12/08/2017 03:58 PM, Rohit Yadav wrote:

All,


Our effort to move to Debian9 systemvmtemplate seems to be soon coming to 
conclusion, the following high-level goals have been achieved so far:


- Several infra improvements such as faster patching (no reboots on patching), 
smaller setup/patch scripts and even smaller cloud-early-config, old file 
cleanups and directory/filesystem refactorings

- Tested and boots/runs on KVM, VMware, XenServer and HyperV (thanks to Paul 
for hyperv)

- Boots, patches, runs systemvm/VR in about 10s (tested with KVM/XenServer and 
NFS+SSDs) with faster console-proxy (cloud) service launch

- Disk size reduced to 2GB from the previous 3+GB with still bigger /var/log 
partition

- Migration to systemd based cloud-early-config, cloud services etc (thanks 
Wido!)

- Strongswan provided vpn/ipsec improvements (ports based on work from 
Will/Syed)

- Several fixes to redundant virtual routers and scripts for VPC (ports from 
Remi json/gzip PR and additional fixes/improvements to execute update_config 
faster)

- Packages installation improvements (thanks to Rene for review)

- Several integration test fixes -- all smoke tests passing on KVM and most on 
XenServer, work on fixing VMware test failures is on-going

- Several UI/UX improvements and systemvm python codebase linting/unit tests 
added to Travis


Here's the pull request:

https://github.com/apache/cloudstack/pull/2211


I've temporarily hosted the templates here:

http://hydra.yadav.xyz/debian9/


Outstanding tasks/issues:

- Should we skip rVR related tests for VMware noting a reference to a jira 
ticket to renable them once the feature is support for VMware?

- Fix intermittent failures for XenServer and test failures on VMware

- Misc issues and items (full checklist available on the PR)

- Review and additional test effort from community


After your due review, if we're able to show that the test results are on par 
with the previous 4.9.2.0/4.9.3.0 smoke test results (i.e. most are passing) on 
XenServer, KVM, and VMware I would proceed with merging the PR by end of this 
month. Thoughts, comments?



We might want to look/verify that this works:

- Running with VirtIO-SCSI under KVM (allows disk trimming)
- Make sure the Qemu Guest Agent works

If those two things work we can keep the footprint of the SSVM rather small.

Wido



Regards.

rohit.ya...@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
   
  

Re: Call for participation: Issue triaging and PR review/testing

[Wido den Hollander]

On 12/08/2017 03:24 PM, Rohit Yadav wrote:

All,

Given we've about a month left until 4.11/LTS freeze date of 8th Jan 2018
[1], I would like to call our community for active participation.

Given a huge pile of open issues, please share on this thread a 'brief'
list of top bugs/issues that you would want to see fixed and are applicable
to master branch, especially critical/blocker issues and regressions. I
would especially like to engage with the users of the community towards
this effort. I'll start weekly reporting of open issues by end of next week.

Developers - feel free to comment tagging Daan (@DaanHoogland), Paul
(@PaulAngus) and me (@rhtyd) in your pull requests if you're seeking review
and testing (and merging) of your PR. I hope to work with you all with my
committer/contributor hat on.

Finally, I look forward to all of your help and support towards the next
(LTS) release.



Let's make it work!


Thoughts, comments?



With the holiday season coming up we might see things slow down a bit. 
But I think we already have enough PRs open for 4.11


We should be able to get out a proper release again.

Wido


[1] http://markmail.org/message/mszlluye35acvn2j

Regards,
Rohit Yadav
http://rohityadav.cloud | @rhtyd

   __?.o/   Apache CloudStack
  ()# The best of CloudStack is yet to come!
(___(_)   https://cloudstack.apache.org

[UPDATE] Debian 9 "stretch" systemvmtemplate for master

[Rohit Yadav]

All,


Our effort to move to Debian9 systemvmtemplate seems to be soon coming to 
conclusion, the following high-level goals have been achieved so far:


- Several infra improvements such as faster patching (no reboots on patching), 
smaller setup/patch scripts and even smaller cloud-early-config, old file 
cleanups and directory/filesystem refactorings

- Tested and boots/runs on KVM, VMware, XenServer and HyperV (thanks to Paul 
for hyperv)

- Boots, patches, runs systemvm/VR in about 10s (tested with KVM/XenServer and 
NFS+SSDs) with faster console-proxy (cloud) service launch

- Disk size reduced to 2GB from the previous 3+GB with still bigger /var/log 
partition

- Migration to systemd based cloud-early-config, cloud services etc (thanks 
Wido!)

- Strongswan provided vpn/ipsec improvements (ports based on work from 
Will/Syed)

- Several fixes to redundant virtual routers and scripts for VPC (ports from 
Remi json/gzip PR and additional fixes/improvements to execute update_config 
faster)

- Packages installation improvements (thanks to Rene for review)

- Several integration test fixes -- all smoke tests passing on KVM and most on 
XenServer, work on fixing VMware test failures is on-going

- Several UI/UX improvements and systemvm python codebase linting/unit tests 
added to Travis


Here's the pull request:

https://github.com/apache/cloudstack/pull/2211


I've temporarily hosted the templates here:

http://hydra.yadav.xyz/debian9/


Outstanding tasks/issues:

- Should we skip rVR related tests for VMware noting a reference to a jira 
ticket to renable them once the feature is support for VMware?

- Fix intermittent failures for XenServer and test failures on VMware

- Misc issues and items (full checklist available on the PR)

- Review and additional test effort from community


After your due review, if we're able to show that the test results are on par 
with the previous 4.9.2.0/4.9.3.0 smoke test results (i.e. most are passing) on 
XenServer, KVM, and VMware I would proceed with merging the PR by end of this 
month. Thoughts, comments?


Regards.

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Re: CloudStack LTS EOL date?

[Rohit Yadav]

Hi René,


I've update the LTS wiki to reflect that 4.9(.x) will be supported until 1 July 
2018, and 4.11 (next LTS) will be released in Jan 2018 (tentatively) supported 
until 1 July 2019:


https://cwiki.apache.org/confluence/display/CLOUDSTACK/LTS


In our next release, we'll also update the website creating a new section of 
LTS and non-LTS release, with link to above wiki and the supported date(s).


Regards.



From: Rene Moser 
Sent: Monday, November 27, 2017 11:35:06 PM
To: dev@cloudstack.apache.org
Subject: Re: CloudStack LTS EOL date?

Hi Paul

On 11/27/2017 06:27 PM, Paul Angus wrote:
> Hi Rene,
>
> note: I'm only stating what the original intent was when LTS was originally 
> proposed.  I'm not trying to dictate what we must do now or in the future.
>
> ... The LTS scheme was designed when there was a release coming out every one 
> or two months, and these releases were effectively only receiving fixes for a 
> month or two.
>
> To answer your questions (taking into account the note above)- 4.9 was an LTS 
> version, which meant that there would be a 4.9.1, 4.9.2..4.9.6... for a 
> period of 2 years.
> 4.9.x was the latest 'version' at the beginning of 2017.
> Unfortunately, it was also the latest version in the middle of 2017. So in 
> mid-2017 we took the latest version (4.9 again) and said that we would 
> continue backporting fix for that version for 2 years from mid 2017.

This is absolutely fine, we are on the same page.

> Some variant of your proposal "6 months after next LTS release (minimum 18 
> months)." would also work.
> I think something like "supported for a minimum of 6 months after next LTS 
> release or a total period of 24 months, whichever is greater" suits what you 
> are saying?

That would definitely make things more clear to users.

Regards
René

rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

Call for participation: Issue triaging and PR review/testing

[Rohit Yadav]

All,

Given we've about a month left until 4.11/LTS freeze date of 8th Jan 2018
[1], I would like to call our community for active participation.

Given a huge pile of open issues, please share on this thread a 'brief'
list of top bugs/issues that you would want to see fixed and are applicable
to master branch, especially critical/blocker issues and regressions. I
would especially like to engage with the users of the community towards
this effort. I'll start weekly reporting of open issues by end of next week.

Developers - feel free to comment tagging Daan (@DaanHoogland), Paul
(@PaulAngus) and me (@rhtyd) in your pull requests if you're seeking review
and testing (and merging) of your PR. I hope to work with you all with my
committer/contributor hat on.

Finally, I look forward to all of your help and support towards the next
(LTS) release.

Thoughts, comments?

[1] http://markmail.org/message/mszlluye35acvn2j

Regards,
Rohit Yadav
http://rohityadav.cloud | @rhtyd

  __?.o/   Apache CloudStack
 ()# The best of CloudStack is yet to come!
(___(_)   https://cloudstack.apache.org

[DISCUSS] Redundant Virtual Routers on VMware?

[Rohit Yadav]

All,


Is anyone using redundant virtual routers with VMware, either in VPCs or 
isolated networks (with recent or older versions of ACS)?


Due to the current redundant virtual router implementation, it fails to work 
with VMware where public nics (on rVR) have the same MAC address (especially 
when portgroup security settings have promiscuous mode disabled). I'm kicking 
this discussion thread to seek advise from the community and discuss if we can 
skip rVR related tests for VMware (they've been failing for 1-1.5+ years now).


Regards,

Rohit Yadav

Software Architect, ShapeBlue

http://rohityadav.cloud | @rhtyd


  __?.o/  Apache CloudStack
 ()# May the cloud be with you!
(___(_)   https://cloudstack.apache.org


rohit.ya...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue