Re: Roadmap for 4.x and 5.0

[ma...@exoscale.ch]

Hi Ilya,

Regarding the live migration, we are using it in production and did migrate a 
couple of VMs until we reach some corner cases, for which I wrote a few fixes. 
We'll verify them during the following weeks. The code is based on CS 4.4 but I 
started porting it to master. I have to finish that and merge the fixes too. 
For the cold migration, it's already in CS and we are usign it since a while.
What do you mean by secure KVM migration? My code reads configuration values 
for which you can have TLS peer-2-peer connection between the agents to 
transfert over it all the data using the features in libvirt. That the setup we 
have in production.

For the graceful shutdown, we have a HA proxy in front so we just edit the 
configuration to turn off one MS. We are also checking manually if there aren't 
any snapshot ongoing before launching the stop-start. But I don't find this 
very robust. Therefore I read a lot of the code managing the agent and how the 
agents are connected to the MS. There is already a command to rebalance agents 
between MS, so I'm developping a solution around that.

Kind regards,
Marc-Aurèle


> On 02 Jul 2016, at 02:03, ilya  wrote:
> 
> Marco,
> 
> I written a tiny shell script that does following:
> 
> Make's sure there are async_jobs that arent running, also block 8080 via
> iptables - to avoid user connecting to MS thats about to go down.
> 
> It needs a bit of enhancement - and should lookup the MSID of that
> specific server, it looks something like this - consider borrowing
> concepts if applicable..
> 
>> #!/bin/bash
>> DATESTAMP=$(date +%m%d%y-%H%M%S)
>> DBPASS=$(java -classpath /usr/share/cloudstack-common/lib/jasypt-1.9.0.jar 
>> org.jasypt.intf.cli.JasyptPBEStringDecryptionCLI input="$(cat 
>> /etc/cloudstack/management/db.properties | grep db.cloud.password | awk 
>> -F'(' '{print $2}' | sed 's/)//g')" password="$(cat 
>> /etc/cloudstack/management/key)" | grep -A2 OUTPUT | tail -1)
>> DBHOST=$(cat /etc/cloudstack/management/db.properties | grep db.cloud.host | 
>> awk -F'=' '{print $2}' | tail -1 )
>> DBUSER=$(cat /etc/cloudstack/management/db.properties | grep 
>> db.cloud.username | awk -F'=' '{print $2}')
>> DB=$(cat /etc/cloudstack/management/db.properties | grep db.cloud.name | awk 
>> -F'=' '{print $2}')
>> DBPORT=$(cat /etc/cloudstack/management/db.properties | grep db.cloud.port | 
>> awk -F'=' '{print $2}')
>> MYSQLCMD="mysql -h $DBHOST -u $DBUSER -P $DBPORT -p$DBPASS $DB"
>> #echo $DBPASS $DBHOST $DBUSER $DB $DBPORT
>> 
>> 
>> JOBS=$(echo 'SELECT * FROM cloud.async_job where job_status=0 and 
>> job_dispatcher not like "pseudoJobDispatcher"' | $MYSQLCMD | wc -l)
>> 
>> if [ $JOBS -gt 0 ]
>>then
>>echo "WARN: Looks like i have active jobs in flight, please 
>> try again later"
>>echo 'SELECT * FROM cloud.async_job where job_status=0 and 
>> job_dispatcher not like "pseudoJobDispatcher"' | $MYSQLCMD
>>exit
>>else
>>echo "NOTE: No jobs running, good to go!"
>>echo "NOTE: Blocking incoming 8080"
>>/sbin/iptables -A INPUT -p tcp --destination-port 8080 -j DROP
>>service cloudstack-management stop
>>service cloudstack-management stop:wq
>>CSPID=$(cat /var/run/cloudstack-management.pid )
>>ps -p $CSPID >/dev/null 2>&1 && (kill -9 $CSPID)
>>ps -p $CSPID >/dev/null 2>&1 && (echo "ERROR: Count not 
>> terminame cloudstack service on `hostname` with pid $SCPID"; /sbin/iptables 
>> -D INPUT -p tcp --destination-port 8080 -j DROP; exit 1)
>>service cloudstack-management start
>>echo "NOTE: Unblocking incoming 8080"
>>/sbin/iptables -D INPUT -p tcp --destination-port 8080 -j DROP
>> fi
> 
> Regards,
> ilya
> 
> On 7/1/16 3:30 AM, ma...@exoscale.ch wrote:
>> Hi,
>> 
>> I can't edit the page but I'll be glad to put some effort for the V5:
>> - Live migration for KVM
>> - Improve logging using UUIDs (as I already did part of that for us at 
>> exoscale)
>> 
>> I'm in the process to add another feature we need: graceful shutdown of a 
>> management server when running a cluster of MS. The goal is to send a 
>> "prepareForShutdown" command to one or more MS and have them rebalance their 
>> agents to the ones still running so that no command will be lost. Then there 
>> shouldn't be any downtime with any agent during an update.
>> 
>> Kind regards,
>> Marc-Aurèle
>> 
>> PS: Is there any architectural discussion going on on the Slack channel? I 
>> saw that the IRC is not so active...
>> 
>> 
>>> On 01 Jul 2016, at 11:55, Paul Angus  wrote:
>>> 
>>> There's not been much response to this, but I'll start clearing away the 
>>> unclaimed items, people can always add them back.
>>> 
>>> 
>>> Kind regards,
>>> 
>>> Paul Angus
>>> 
>>> 
>>> paul.an...@shapeblue.com 
>>> www.shapeblue.com

[PROPOSAL] 2016-2017 Release Cycle and Calendar

[John Burwell]

All,

Following up on a our discussions about LTS [1], post 4.9 releases [2], and 
5.0.0/6.0.0 [3], I have assembled a release plan for the next 18-20 months in 
the wiki [4].  My original proposal assumed by that 4.9 would be released by 1 
July.  I have adjusted the timelines assuming that we will complete the release 
by 15 July.  My thinking is that the number of defect fixes present in 4.9 and 
4.8.1 would require more than 2 weeks of work to backport to a 4.8-based LTS.  
Therefore, I have shifted the LTS cutoff dates from 1 Jan and 1 July to 15 Jan 
and 15 July.

Once we gain consensus on the release cycle and calendar, I will cleanup the 
wiki to move completed release plans to an archive area and remove obsolete 
release process documentation.

Thanks,
-John

[1]: http://markmail.org/thread/zzrjldiryhy3ygfk
[2]: http://markmail.org/thread/7rv3jwz4hzf3yplf
[3]: http://markmail.org/thread/c24hvshz3z4babjb
[4]: 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/%5BPROPOSAL%5D+2016-2017+Release+Cycle+and+Calendar

john.burw...@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London VA WC2N 4HSUK
@shapeblue
  
 

[GitHub] cloudstack pull request #1598: [CLOUDSTACK-9423] Add ability to get virtual ...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/cloudstack/pull/1598


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Avoid VR downtime when upgrading ACS

[Cloud List]

Dear all,

I have done some extensive tests on upgrading ACS from 4.2 to 4.8, and one
of the steps involves upgrading the virtual routers (VRs) which will cause
downtime to network served by the VRs. Is there a way I can avoid such
downtime?

Will having redundant VRs for every network help to avoid the downtime?

Looking forward to your reply, thank youi.

Cheers.

-ip-

[GitHub] cloudstack issue #1600: Support Backup of Snapshots for Managed Storage

[mike-tutkowski]

Github user mike-tutkowski commented on the issue:

https://github.com/apache/cloudstack/pull/1600
  
Can you return the new locationtype parameter in the listSnapshots API call?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---