Re: [ANNOUNCE] New PMC Member: Ian Duffy
congratulations Ian :) On Wed, Oct 1, 2014 at 11:12 AM, Prasanna Santhanam t...@apache.org wrote: Congratulations Ian! On Tue, Sep 30, 2014 at 7:20 PM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC -- regards, punith s cloudbyte.com
Re: [ANNOUNCE] New PMC Member: Pierre-Luc Dion
Congrats Pierre! On Wed, Oct 1, 2014 at 11:13 AM, Prasanna Santhanam t...@apache.org wrote: Congratulations Pierre-Luc! On Tue, Sep 30, 2014 at 7:20 PM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Pierre-Luc Dion to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Pierre-Luc! -chip On behalf of the Apache CloudStack PMC -- regards, punith s cloudbyte.com
Re: [ANNOUNCE] New PMC Member: Ian Duffy
Congratulations Ian! Regards, Gaurav On Wed, Oct 1, 2014 at 11:36 AM, Abhinandan Prateek agneya2...@gmail.com wrote: Congrats Ian ! -abhi On 30-Sep-2014, at 7:20 pm, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC
Re: [ANNOUNCE] New PMC Member: Ian Duffy
Congrats Ian ! -abhi On 30-Sep-2014, at 7:20 pm, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC
Re: [ANNOUNCE] New PMC Member: Ian Duffy
gratz.. On Oct 1, 2014, at 2:17 AM, Gaurav Aradhye gaurav.arad...@clogeny.com wrote: Congratulations Ian! Regards, Gaurav On Wed, Oct 1, 2014 at 11:36 AM, Abhinandan Prateek agneya2...@gmail.com wrote: Congrats Ian ! -abhi On 30-Sep-2014, at 7:20 pm, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC
Re: [ANNOUNCE] New PMC Member: Pierre-Luc Dion
felicitations ! On Oct 1, 2014, at 2:14 AM, Punith S punit...@cloudbyte.com wrote: Congrats Pierre! On Wed, Oct 1, 2014 at 11:13 AM, Prasanna Santhanam t...@apache.org wrote: Congratulations Pierre-Luc! On Tue, Sep 30, 2014 at 7:20 PM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Pierre-Luc Dion to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Pierre-Luc! -chip On behalf of the Apache CloudStack PMC -- regards, punith s cloudbyte.com
Re: [ANNOUNCE] New PMC Member: Pierre-Luc Dion
Congratulations :-) Sent from my iPhone On 1 okt. 2014, at 09:06, Sebastien Goasguen run...@gmail.com wrote: felicitations ! On Oct 1, 2014, at 2:14 AM, Punith S punit...@cloudbyte.com wrote: Congrats Pierre! On Wed, Oct 1, 2014 at 11:13 AM, Prasanna Santhanam t...@apache.org wrote: Congratulations Pierre-Luc! On Tue, Sep 30, 2014 at 7:20 PM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Pierre-Luc Dion to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Pierre-Luc! -chip On behalf of the Apache CloudStack PMC -- regards, punith s cloudbyte.com
Re: [ANNOUNCE] New PMC Member: Ian Duffy
Congrats Ian :-) Sent from my iPhone On 1 okt. 2014, at 09:05, Sebastien Goasguen run...@gmail.com wrote: gratz.. On Oct 1, 2014, at 2:17 AM, Gaurav Aradhye gaurav.arad...@clogeny.com wrote: Congratulations Ian! Regards, Gaurav On Wed, Oct 1, 2014 at 11:36 AM, Abhinandan Prateek agneya2...@gmail.com wrote: Congrats Ian ! -abhi On 30-Sep-2014, at 7:20 pm, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC
Re: Review Request 26008: CLOUDSTACK-7627: Automated Remote Access VPN on VPC Test Cases
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26008/#review55056 --- Please fix pep8 errors. Otherwise, scripts looks good. - SrikanteswaraRao Talluri On Sept. 29, 2014, 11:16 p.m., Chandan Purushothama wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26008/ --- (Updated Sept. 29, 2014, 11:16 p.m.) Review request for cloudstack, sangeetha hariharan, sanjeev n, Santhosh Edukulla, and SrikanteswaraRao Talluri. Bugs: CLOUDSTACK-7627 https://issues.apache.org/jira/browse/CLOUDSTACK-7627 Repository: cloudstack-git Description --- Test Suite for Testing Remote Access VPN on VPC. I successfully automated the following components: 1.VPN Client Installation on Linux 2.Component that efficiently verifies Remote VPN Access between client and the Server. 3.Developed a component that automates VPN Client Configuration and services. 4.Test Cases of the Feature 5.Tested the Code multiple times on XenServer. 6.Tested the Code multiple times on VMWare (To test Skipping of Test Cases) Diffs - test/integration/component/test_remotevpn_vpc.py PRE-CREATION tools/marvin/marvin/config/test_data.py 00fa52c Diff: https://reviews.apache.org/r/26008/diff/ Testing --- Testing Done on Two Configurations: XenServer and VMWare XenServer Test Results: Test case 01 : Enable VPN for Public IP Address on the VPC ... === TestName: test_01_RemoteAccessVPN_VPC_EnableVPNAndConnecttoVM | Status : SUCCESS === ok Test case 02 : Remote a VPN User ... === TestName: test_02_VPC_RemoveVPNUser | Status : SUCCESS === ok Test case 03 : Add a Different VPN User and Test Access with already existing VPN User ... === TestName: test_03_VPC_AddDifferentVPNUser | Status : SUCCESS === ok Test case 04 : Add a Previously Removed VPN User from the VPC and Test the VPN Connectivity ... === TestName: test_04_VPC_AddPreviouslyRemovedVPNUserTestConnectivity | Status : SUCCESS === ok Test case 05 : Disable the VPN Service on the VPC ... === TestName: test_05_VPC_DisableVPNServiceOnVPC | Status : SUCCESS === ok Test case 06 : Enabled Previously Dsiabled VPN Access to VPC. ... === TestName: test_06_VPC_EnablePreviouslyDisabledVPNAccesstoVPC | Status : SUCCESS === ok Test case 07 : Create Nine VPN Users to test the remote.vpn.user.limit=8 Configuration parameter ... === TestName: test_07_ConfigParam_TestRemoteVPNUserLimit | Status : SUCCESS === ok -- Ran 7 tests in 851.687s OK VMWare Test Results: === TestName: None | Status : EXCEPTION === SKIP: Only XenServer VPNClient Template is ready currently. KVM,VMWare or Hyper-V VPN Client Templates are not ready. Skipping the test suite for those configurations begin captured stdout - === TestName: None | Status : EXCEPTION === - end captured stdout -- begin captured logging CSLog: DEBUG: Obtain the Admin's API Client CSLog: DEBUG: Get the dictionary information that will be used during CCP tests, from test_data.py present on the Client CSLog: DEBUG: Payload: {'apiKey': u'fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQ', 'command': 'listDomains', 'signature': '5BHLOjDELImWRpvI/16LQ/TrLRM=', 'response': 'json'} CSLog: DEBUG: Sending GET Cmd : listDomains=== requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection (1): 10.220.135.90 requests.packages.urllib3.connectionpool: DEBUG: GET /client/api?apiKey=fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQcommand=listDomainsresponse=jsonsignature=5BHLOjDELImWRpvI%2F16LQ%2FTrLRM%3D HTTP/1.1 200 159 CSLog: DEBUG: Response : [{path : u'ROOT', haschild : False, id : u'42ebae70-4375-11e4-86a1-66733ba24ed8', name : u'ROOT', level : 0}] CSLog: DEBUG: Payload: {'apiKey': u'fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQ', 'name': u'XenRT-Zone-0', 'command': 'listZones', 'signature': 'MH3voxNCEMIMA3deggb/EVxAog8=', 'response': 'json'} CSLog: DEBUG: Sending GET Cmd : listZones=== requests.packages.urllib3.connectionpool: INFO: Starting new HTTP connection (1): 10.220.135.90 requests.packages.urllib3.connectionpool: DEBUG: GET /client/api?response=jsonapiKey=fGs23pVVge8K-HxeQCo3WBCria7hJs5JZW_j7cKnX1mMpbBKH8JwNCxcWHxBgA-slwW0d1YJHJKbCX_Doc3-GQcommand=listZonesname=XenRT-Zone-0signature=MH3voxNCEMIMA3deggb%2FEVxAog8%3D
Cloudstack operations and Ceph RBD in degraded state
Dear all, Anyone using CloudStack with Ceph RBD as primary storage? I am using CloudStack 4.2.0 with KVM hypervisors and Ceph latest stable version of dumpling. Based on what I see, when Ceph cluster is in degraded state (not active+clean), for example due to one node is down and in recovering process, it might affect CloudStack operations. For example: - Stopped VM cannot be started, because it says cannot find suitable storage pool. - Disconnected host cannot be reconnected easily, even after restarting agent and libvirt on agent side, and restarting management server on the server side. Need to keep on trying and suddenly it will be connected/up by itself. Once Ceph has recovered and back to active+clean state, then CloudStack operations will be back to normal. Host agents will be up, and VMs can be started. Anyone seeing similar behaviour? Looking forward to your reply, thank you. Cheers.
Doubt - Secondary IP
Hi, I want to confirm the secondary IP behavior. Secondary IP is configured manually on VM. When Vm is destroyed and recovered immediately, the information about secondary IP is lost and only primary IP is retained. Is this behavior correct? Regards, Gaurav
Review Request 26220: CLOUDSTACK-7645: [UI] Fixing incorrect labels, including instances of ???label.*???
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26220/ --- Review request for cloudstack, Brian Federle and Jessica Wang. Bugs: CLOUDSTACK-7596, CLOUDSTACK-7597, CLOUDSTACK-7606, CLOUDSTACK-7607, CLOUDSTACK-7608, and CLOUDSTACK-7645 https://issues.apache.org/jira/browse/CLOUDSTACK-7596 https://issues.apache.org/jira/browse/CLOUDSTACK-7597 https://issues.apache.org/jira/browse/CLOUDSTACK-7606 https://issues.apache.org/jira/browse/CLOUDSTACK-7607 https://issues.apache.org/jira/browse/CLOUDSTACK-7608 https://issues.apache.org/jira/browse/CLOUDSTACK-7645 Repository: cloudstack-git Description --- - removed duplicate entries in dictionary - added dictionary entries that have been missed during the dictionary split - added missing entries in messages.properties - fixed other localization issues Diffs - client/WEB-INF/classes/resources/messages.properties c9eb7ae ui/dictionary.jsp c03ad67 ui/dictionary2.jsp 39299b3 ui/scripts/configuration.js b6c94f8 ui/scripts/storage.js 783633c ui/scripts/templates.js 9665ffd ui/scripts/ui-custom/physicalResources.js 7dd5380 Diff: https://reviews.apache.org/r/26220/diff/ Testing --- I've checked all the issues that have been reported, and they are all fixed. Thanks, Mihaela Stoica
RE: [ANNOUNCE] New PMC Member: Ian Duffy
Congrats Ian! Regards, Paul Angus Cloud Architect S: +44 20 3603 0540 | M: +447711418784 | T: @CloudyAngus paul.an...@shapeblue.com -Original Message- From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: 30 September 2014 17:16 To: dev@cloudstack.apache.org Subject: Re: [ANNOUNCE] New PMC Member: Ian Duffy Congratulations, Ian! On Tue, Sep 30, 2014 at 7:50 AM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play*™* Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: [ANNOUNCE] New PMC Member: Pierre-Luc Dion
Congrats Pierre-Luc. :) Regards, Paul Angus Cloud Architect S: +44 20 3603 0540 | M: +447711418784 | T: @CloudyAngus paul.an...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 30 September 2014 18:19 To: dev@cloudstack.apache.org Subject: Re: [ANNOUNCE] New PMC Member: Pierre-Luc Dion haha, I guest now it's a +1 (binding) On Tue, Sep 30, 2014 at 1:00 PM, Daan Hoogland daan.hoogl...@gmail.com wrote: fortune to you Pierre-Luc (and do you as PMC member still believe the 4.4.1 RC is ok for release?) On Tue, Sep 30, 2014 at 6:16 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Congratulations, Pierre-Luc! On Tue, Sep 30, 2014 at 7:50 AM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Pierre-Luc Dion to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Pierre-Luc! -chip On behalf of the Apache CloudStack PMC -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play*™* -- Daan Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Cloudstack operations and Ceph RBD in degraded state
On 10/01/2014 09:21 AM, Indra Pramana wrote: Dear all, Anyone using CloudStack with Ceph RBD as primary storage? I am using CloudStack 4.2.0 with KVM hypervisors and Ceph latest stable version of dumpling. I am :) Based on what I see, when Ceph cluster is in degraded state (not active+clean), for example due to one node is down and in recovering process, it might affect CloudStack operations. For example: - Stopped VM cannot be started, because it says cannot find suitable storage pool. - Disconnected host cannot be reconnected easily, even after restarting agent and libvirt on agent side, and restarting management server on the server side. Need to keep on trying and suddenly it will be connected/up by itself. It really depends on the size of the cluster. It could be that the Ceph is cluster is so busy with recovery that it can't process the I/O coming from CloudStack and thus stalls. This is not a Ceph or CloudStack problem, but probably the size of your cluster. Wido Once Ceph has recovered and back to active+clean state, then CloudStack operations will be back to normal. Host agents will be up, and VMs can be started. Anyone seeing similar behaviour? Looking forward to your reply, thank you. Cheers.
Review Request 26221: CLOUDSTACK-6282 - Added hyper-v hypervisor check for tests which are not applicable for hyper-v
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26221/ --- Review request for cloudstack, Alex Brett and Santhosh Edukulla. Bugs: cloudstack-6282 https://issues.apache.org/jira/browse/cloudstack-6282 Repository: cloudstack-git Description --- CLOUDSTACK-6282 - Added hyper-v hypervisor check for tests which are not applicable for hyper-v Diffs - test/integration/component/test_escalations_instances.py 73ebf13 test/integration/component/test_escalations_ipaddresses.py b29cd1d test/integration/component/test_escalations_isos.py 925c2fb test/integration/component/test_escalations_networks.py c0ab709 test/integration/component/test_escalations_snapshots.py 8d289e1 test/integration/component/test_escalations_templates.py c497e71 test/integration/component/test_escalations_volumes.py 8d6ba99 Diff: https://reviews.apache.org/r/26221/diff/ Testing --- Executed all the modified tests and attached are the log files File Attachments IPAddressesResults.txt https://reviews.apache.org/media/uploaded/files/2014/10/01/5561459d-faf8-48e5-8b53-9d1738bec7be__IPAddressesResults.txt ISOResults.txt https://reviews.apache.org/media/uploaded/files/2014/10/01/d4fde9a5-b4b8-47c9-958f-0061c4783c7a__ISOResults.txt NetworksResults.txt https://reviews.apache.org/media/uploaded/files/2014/10/01/a072ad53-7832-408d-ad13-31dac3a71d2c__NetworksResults.txt SnapshotsResults.txt https://reviews.apache.org/media/uploaded/files/2014/10/01/76f3ba65-36b7-447e-bbc6-81569ba1f0ec__SnapshotsResults.txt TemplatesResults.txt https://reviews.apache.org/media/uploaded/files/2014/10/01/137febdb-6f2a-4817-96aa-090be2f82ee7__TemplatesResults.txt Thanks, Vinay Varma
Re: CloudStack - cache disk policy
On 09/27/2014 05:51 PM, Wido den Hollander wrote: On 27-09-14 11:00, Thierry Bernard wrote: Dear CloudStack team, First let me introduce myself I am working for EasyVirt company around the cloud and virtualization technologies. Also in order to integrate CloudStack in one of our projects we need to use the write-back cache disk feature. From this link it seems that this feature will be embedded in the next release of CloudStack (4.5.0): https://issues.apache.org/jira/browse/CLOUDSTACK-1302 I tried from the master branch by creating a new disk offering and setting the write cache type to write-back. By generating a new instance with this new disk offerings the vm's xml config file returns that the cache is none. Have you ever commits the code of this new feature? Well, it should work (Shouldn't all code?), but you might run into a bug. If you set the loglevel to DEBUG of the KVM Agent you will see that the Management Server sends a StartCommand. Do you see the cache policy in there? What is it set to? I tested this today with the 4.4.1 RC and it works for me with a RBD device: disk type='network' device='disk' driver name='qemu' type='raw' cache='writeback'/ auth username='cloudstack' secret type='ceph' uuid='822d3be5-3884-3700-8865-f45e7c752250'/ /auth source protocol='rbd' name='cloudstack0/04192cec-715e-4ac6-b72e-3ed5980e5979' host name='monitor' port='6789'/ /source target dev='vda' bus='virtio'/ alias name='virtio-disk0'/ /disk Just be aware that your Compute Offering might be overriding the Disk Offering. So you might want to check if the cache policy is writeback there as well. Wido Wido In advance thank you for your help and your feedback. Best regards, Thierry Bernard.
Re: Cloudstack operations and Ceph RBD in degraded state
Hi Wido, Can you elaborate more on what do you mean by the size of our cluster? Is it because the cluster size is too big, or too small? Thank you. On Wed, Oct 1, 2014 at 4:28 PM, Wido den Hollander w...@widodh.nl wrote: On 10/01/2014 09:21 AM, Indra Pramana wrote: Dear all, Anyone using CloudStack with Ceph RBD as primary storage? I am using CloudStack 4.2.0 with KVM hypervisors and Ceph latest stable version of dumpling. I am :) Based on what I see, when Ceph cluster is in degraded state (not active+clean), for example due to one node is down and in recovering process, it might affect CloudStack operations. For example: - Stopped VM cannot be started, because it says cannot find suitable storage pool. - Disconnected host cannot be reconnected easily, even after restarting agent and libvirt on agent side, and restarting management server on the server side. Need to keep on trying and suddenly it will be connected/up by itself. It really depends on the size of the cluster. It could be that the Ceph is cluster is so busy with recovery that it can't process the I/O coming from CloudStack and thus stalls. This is not a Ceph or CloudStack problem, but probably the size of your cluster. Wido Once Ceph has recovered and back to active+clean state, then CloudStack operations will be back to normal. Host agents will be up, and VMs can be started. Anyone seeing similar behaviour? Looking forward to your reply, thank you. Cheers.
Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
thanks Wido, for anyone that is not taking today to test master in order to get out 4.5 ASAP, I have enough votes to release but saw a couple of remarks passing by on systemvm ugrade and saw no reports on the systemvm shellshock for better or worse. so if any of you has priority on 4.4 today please feel free to focus on those areas. thanks, Daan On Wed, Oct 1, 2014 at 1:31 PM, Wido den Hollander w...@widodh.nl wrote: +1 I tested it on a KVM (Ubuntu) environment and tested mainly the RBD/Ceph functionality: - Instance deployment from template (QCOW2) - Cache mode setting of disk to WriteBack - Creating snapshot of RBD volume - Create a new volume of RBD snapshot - Adding new volume to Instance - Removing volume from Instance - Live Migrate Instance from host to host All this functionality worked for me and the Ubuntu packages also build fine. So that is my +1 for the 4.4.1 release. Wido On 09/29/2014 12:01 AM, Daan Hoogland wrote: Hi All, I've created a 4.4.1 release, with the following artifacts up for a vote: Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.4-RC20140924T2100 Commit: 620ad650bdda23cabdf4c9dc480072c02c59a2d1 List of changes: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/ Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/4.4.1/ PGP release keys (signed using 4096R/AA4736F3): https://dist.apache.org/repos/dist/release/cloudstack/KEYS Vote will be open for 72 hours. For sanity in tallying the vote, can PMC members please be sure to indicate (binding) with their vote? [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why) -- Daan
Re: [ANNOUNCE] New PMC Member: Ian Duffy
Thanks Guys! :) On 1 October 2014 09:26, Paul Angus paul.an...@shapeblue.com wrote: Congrats Ian! Regards, Paul Angus Cloud Architect S: +44 20 3603 0540 | M: +447711418784 | T: @CloudyAngus paul.an...@shapeblue.com -Original Message- From: Mike Tutkowski [mailto:mike.tutkow...@solidfire.com] Sent: 30 September 2014 17:16 To: dev@cloudstack.apache.org Subject: Re: [ANNOUNCE] New PMC Member: Ian Duffy Congratulations, Ian! On Tue, Sep 30, 2014 at 7:50 AM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud http://solidfire.com/solution/overview/?video=play*™* Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Cloudstack operations and Ceph RBD in degraded state
On 10/01/2014 01:43 PM, Indra Pramana wrote: Hi Wido, Can you elaborate more on what do you mean by the size of our cluster? Is it because the cluster size is too big, or too small? I think it's probably because the Ceph cluster is to small. That causes to much stress on the other nodes during recovery. That again leads to libvirt and Qemu not being able to talk to Ceph which leads to slow I/O. I've seen multiple occasions where Ceph clusters are recovering but CloudStack is still working just fine. Wido Thank you. On Wed, Oct 1, 2014 at 4:28 PM, Wido den Hollander w...@widodh.nl wrote: On 10/01/2014 09:21 AM, Indra Pramana wrote: Dear all, Anyone using CloudStack with Ceph RBD as primary storage? I am using CloudStack 4.2.0 with KVM hypervisors and Ceph latest stable version of dumpling. I am :) Based on what I see, when Ceph cluster is in degraded state (not active+clean), for example due to one node is down and in recovering process, it might affect CloudStack operations. For example: - Stopped VM cannot be started, because it says cannot find suitable storage pool. - Disconnected host cannot be reconnected easily, even after restarting agent and libvirt on agent side, and restarting management server on the server side. Need to keep on trying and suddenly it will be connected/up by itself. It really depends on the size of the cluster. It could be that the Ceph is cluster is so busy with recovery that it can't process the I/O coming from CloudStack and thus stalls. This is not a Ceph or CloudStack problem, but probably the size of your cluster. Wido Once Ceph has recovered and back to active+clean state, then CloudStack operations will be back to normal. Host agents will be up, and VMs can be started. Anyone seeing similar behaviour? Looking forward to your reply, thank you. Cheers.
Build failed in Jenkins: build-master #1738
See http://jenkins.buildacloud.org/job/build-master/1738/changes Changes: [sanjay.tripathi] CLOUDSTACK-6650: Reorder Cluster list in deployment planner to protect -- [...truncated 1821 lines...] --- T E S T S --- Running com.cloud.event.EventControlsUnitTest log4j:WARN No appenders could be found for logger (com.cloud.event.EventControlsUnitTest). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.637 sec Running com.cloud.keystore.KeystoreTest org.apache.cloudstack.api.response.UserVmResponse/null/{id:3,securitygroup:[],nic:[],tags:[],affinitygroup:[]} org.apache.cloudstack.api.response.AlertResponse/null/{id:100,description:Hello} Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.137 sec Running com.cloud.alert.AlertControlsUnitTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.041 sec Running com.cloud.capacity.CapacityManagerTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.154 sec Running com.cloud.servlet.StaticResourceServletTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.155 sec Running com.cloud.servlet.ConsoleProxyServletTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec Running com.cloud.resourcelimit.ResourceLimitManagerImplTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec Running com.cloud.network.firewall.FirewallManagerTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.001 sec Running com.cloud.network.ExternalLoadBalancerDeviceManagerImplTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.603 sec Running com.cloud.network.element.VirtualRouterElementTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.478 sec Running com.cloud.network.UpdatePhysicalNetworkTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.127 sec Running com.cloud.network.CreatePrivateNetworkTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec Running com.cloud.network.NetworkModelTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.036 sec Running com.cloud.network.router.VirtualNetworkApplianceManagerImplTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 sec Running com.cloud.network.security.SecurityGroupManagerImplTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.169 sec Running com.cloud.network.security.SecurityGroupQueueTest Total jobs dequeued = 10, num queued=1001 queue current size=991 Num Vms= 50 Queue size = 50 Num Vms= 2 Queue size = 2 time=962 ms Num Vms= 5000 Queue size = 5000 time=1613 ms Num Vms= 1 Queue size = 1 time=1 ms Num Vms= 100 Queue size = 100 time=236 ms Total jobs dequeued = 10, num queued=1009 queue current size=1000 Tests run: 4, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 3.265 sec FAILURE! Running com.cloud.network.vpc.VpcManagerImplTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec Running com.cloud.network.DedicateGuestVlanRangesTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 sec Running com.cloud.network.lb.AssignLoadBalancerTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.092 sec Running com.cloud.network.dao.NetworkDaoTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec Running com.cloud.vm.FirstFitPlannerTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.652 sec Running com.cloud.vm.DeploymentPlanningManagerImplTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.505 sec Running com.cloud.vm.snapshot.VMSnapshotManagerTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.177 sec Running com.cloud.vm.UserVmManagerTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.181 sec Running com.cloud.configuration.ValidateIpRangeTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec Running com.cloud.configuration.ConfigurationManagerTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.041 sec Running com.cloud.server.ConfigurationServerImplTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec Running com.cloud.template.TemplateManagerImplTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec Running com.cloud.vpc.Site2SiteVpnTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.781 sec Running com.cloud.vpc.NetworkACLServiceTest Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.168 sec Running com.cloud.vpc.NetworkACLManagerTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0,
Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
Erik, I've tests upgrade from 4.3 and 4.2.1 using system vm from jenkins. Some copy them on apt-get.eu and Upgrade instructions point to them , refer to: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.4.1/upgrade/upgrade-4.3.html *Pierre-Luc DION* Architecte de Solution Cloud | Cloud Solutions Architect t 855.652.5683 *CloudOps* Votre partenaire infonuagique* | *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Tue, Sep 30, 2014 at 3:33 PM, Erik Weber terbol...@gmail.com wrote: Which systemvm did you use for the 4.3 install, and did it successfully upgrade it? Haven't had the time to test it yet, so just wanted to make sure that the systemvm issues with 4.3 templates running on 4.4 is fixed. -- Erik On Mon, Sep 29, 2014 at 2:45 PM, Wei ZHOU ustcweiz...@gmail.com wrote: +1 KVM + Advanzed zone Upgrade from 4.3.0 to 4.4.1-RC Everything looks fine. -Wei 2014-09-29 12:57 GMT+02:00 Rohit Yadav rohit.ya...@shapeblue.com: +1 Testing using KVM on Ubuntu, was able to successfully deploy a basic zone, launch VMs. On 29-Sep-2014, at 12:01 am, Daan Hoogland daan.hoogl...@gmail.com wrote: Hi All, I've created a 4.4.1 release, with the following artifacts up for a vote: Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=refs/heads/4.4-RC20140924T2100 Commit: 620ad650bdda23cabdf4c9dc480072c02c59a2d1 List of changes: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/ Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/4.4.1/ PGP release keys (signed using 4096R/AA4736F3): https://dist.apache.org/repos/dist/release/cloudstack/KEYS Vote will be open for 72 hours. For sanity in tallying the vote, can PMC members please be sure to indicate (binding) with their vote? [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why) -- Daan Regards, Rohit Yadav Software Architect, ShapeBlue M. +41 779015219 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Build http://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment framework http://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Support http://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courses http://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: [ANNOUNCE] New PMC Member: Ian Duffy
Well done Ian On 30 September 2014 14:50, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC
Build failed in Jenkins: simulator-singlerun #484
See http://jenkins.buildacloud.org/job/simulator-singlerun/484/changes Changes: [sanjay.tripathi] CLOUDSTACK-6650: Reorder Cluster list in deployment planner to protect -- [...truncated 8934 lines...] [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ cloud-developer --- [INFO] Installing http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml to /var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 2:07.270s [INFO] Finished at: Wed Oct 01 08:22:17 EDT 2014 [INFO] Final Memory: 42M/177M [INFO] [WARNING] The requested profile simulator could not be activated because it does not exist. [simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator [INFO] Scanning for projects... [INFO] [INFO] [INFO] Building Apache CloudStack Developer Mode 4.5.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties (default) @ cloud-developer --- [WARNING] Ignoring missing properties file: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override [INFO] [INFO] --- maven-remote-resources-plugin:1.3:process (default) @ cloud-developer --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer --- log4j:WARN No appenders could be found for logger (org.springframework.core.env.StandardEnvironment). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. WARNING: Provided file does not exist: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override Initializing database=simulator with host=localhost port=3306 username=cloud password=cloud Running query: drop database if exists `simulator` Running query: create database `simulator` Running query: GRANT ALL ON simulator.* to 'cloud'@`localhost` identified by 'cloud' Running query: GRANT ALL ON simulator.* to 'cloud'@`%` identified by 'cloud' Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/create-schema-simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/templates.simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/hypervisor_capabilities.simulator.sql Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ cloud-developer --- [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ cloud-developer --- [INFO] Installing http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml to /var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 21.322s [INFO] Finished at: Wed Oct 01 08:22:42 EDT 2014 [INFO] Final Memory: 42M/192M [INFO] [simulator-singlerun] $ /bin/bash -x /tmp/hudson8689880627783724933.sh + grep -q Launcher + jps -l + echo '' + rm -rf /tmp/MarvinLogs + echo Check for initialization of the management server Check for initialization of the management server + COUNTER=0 + SERVER_PID=24659 + mvn -P systemvm,simulator -pl :cloud-client-ui jetty:run + '[' 0 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 +
Re: test day reminder
On 09/30/2014 09:26 AM, Daan Hoogland wrote: H all, As you might remember, we agreed on a test day for the master branch on Wednesday the 1st October, during our last meeting in Schihol-Rijk with some folks. Please feel invited to test master so that we can report to our RM for 4.5 for the current state and he can have a short and quick journey to releasing. I didn't forget! Just tested by upgrading from 4.4.1 (RC) to 4.5.0 and that worked, but my KVM agent couldn't connect anymore afterwards: 2014-10-01 14:59:08,789 INFO [utils.nio.NioClient] (Agent-Selector:null) Connecting to cloudstack.:8250 2014-10-01 14:59:08,809 ERROR [utils.nio.NioConnection] (Agent-Selector:null) Unable to initialize the threads. java.io.IOException: Connection closed with -1 on reading size. at com.cloud.utils.nio.Link.doHandshake(Link.java:509) at com.cloud.utils.nio.NioClient.init(NioClient.java:78) at com.cloud.utils.nio.NioConnection.run(NioConnection.java:111) at java.lang.Thread.run(Thread.java:744) Any ideas? When I try to telnet to 8250 the connection is closed immediately by the mgmt server. Nothing in the logs. So this is currently preventing me from testing the KVM agents. Wido optimistically yours,
RE: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
+0 only because of the issues in the release notes, a clean install and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm64/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-4.4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI - cloudstack service crashed! (Install is running inside VirtualBox and Management VM is also NFS Server so added more RAM and tried again) - repeated test after a manual clean up and it was successful Live Migrated (VM running) Root Volume between Pri Storage via UI Disabled / Re-enabled Host Adding / removing NICs and changing default etc via UI Deployed new VPC, with two tiers, added VM to each tier, setup ACLs etc via API Then I did an upgrade test of a 4.3.1 system using the latest system VM template from Jenkins (this system was originally built on 4.3.0 and upgraded to 4.3.1, before being upgraded to 4.4.1) New System VM template installed OK The steps in the release notes about downloading vhd-utils for XenServer are misleading. If you blindly follow the steps the simply end up with a 2nd copy 'vhd-utils.1' as this is an upgrade and you will already have vhd-utils on the management server, at least if upgrading from a recent release such as 4.3.x. If vhd-utils needs replacing we need to be specific about removing the old one. I don’t think it actually needs replacing, it's just in a different location to older installs, but the 4.3 upgrade guide still has this step in it. (I can't remember which release changed the location) The MySQL Statements for the manual upgrade of the template are also incorrect as they do not include the DB name so fail e.g. select id,name from vm_template where name = 'systemvm-xenserver-4.4'; should be select id,name from cloud.vm_template where name = 'systemvm-xenserver-4.4'; The same with the following commands update vm_template set type='SYSTEM' where id='ID FROM COMMAND #1'; update vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='ConsoleProxy' and hypervisor_type = 'xenserver'; update vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='SecondaryStorageVm' and hypervisor_type = 'xenserver'; update configuration set value = 'systemvm-xenserver-4.4' where name = 'router.template.xen'; should be update cloud.vm_template set type='SYSTEM' where id='ID FROM COMMAND #1'; update cloud.vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='ConsoleProxy' and hypervisor_type = 'xenserver'; update cloud.vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='SecondaryStorageVm' and hypervisor_type = 'xenserver'; update cloud.configuration set value = 'systemvm-xenserver-4.4' where name = 'router.template.xen'; However I did not need to do this as the cloud.vm_instance table and cloud.configuration table had automatically been updated to the correct values, so are these steps actually necessary? 4.3 introduced the ability to manage the restart of VRs via the UI, but after upgrading to 4.4.1 the UI lists all VRs as NOT requiring upgrade, even though they have not been upgraded yet and are clearly shown as still be at version 4.3 I could fix the release notes issues, but there may be good reasons why they are how they are that I am not aware of, so just wanted to highlight them for now. I have only tested the XenServer upgrade steps and only from 4.3 so there may be similar errors in other sections. Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 30 September 2014 03:31 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 +1 basic deployment, did tests upgrade from 4.3.0 and 4.2.1 to 4.4.1 , it went smoothly in both cases. I've tests using XenServer 6.2.0 with system vm from : http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm64/131/ Please let me know what should be the URLs for system vm that will goes in the RN if this vote pass.
Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean install and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm64/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-4.4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI - cloudstack service crashed! (Install is running inside VirtualBox and Management VM is also NFS Server so added more RAM and tried again) - repeated test after a manual clean up and it was successful Live Migrated (VM running) Root Volume between Pri Storage via UI Disabled / Re-enabled Host Adding / removing NICs and changing default etc via UI Deployed new VPC, with two tiers, added VM to each tier, setup ACLs etc via API Then I did an upgrade test of a 4.3.1 system using the latest system VM template from Jenkins (this system was originally built on 4.3.0 and upgraded to 4.3.1, before being upgraded to 4.4.1) New System VM template installed OK The steps in the release notes about downloading vhd-utils for XenServer are misleading. If you blindly follow the steps the simply end up with a 2nd copy 'vhd-utils.1' as this is an upgrade and you will already have vhd-utils on the management server, at least if upgrading from a recent release such as 4.3.x. If vhd-utils needs replacing we need to be specific about removing the old one. I don’t think it actually needs replacing, it's just in a different location to older installs, but the 4.3 upgrade guide still has this step in it. (I can't remember which release changed the location) The MySQL Statements for the manual upgrade of the template are also incorrect as they do not include the DB name so fail e.g. select id,name from vm_template where name = 'systemvm-xenserver-4.4'; should be select id,name from cloud.vm_template where name = 'systemvm-xenserver-4.4'; The same with the following commands update vm_template set type='SYSTEM' where id='ID FROM COMMAND #1'; update vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='ConsoleProxy' and hypervisor_type = 'xenserver'; update vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='SecondaryStorageVm' and hypervisor_type = 'xenserver'; update configuration set value = 'systemvm-xenserver-4.4' where name = 'router.template.xen'; should be update cloud.vm_template set type='SYSTEM' where id='ID FROM COMMAND #1'; update cloud.vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='ConsoleProxy' and hypervisor_type = 'xenserver'; update cloud.vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='SecondaryStorageVm' and hypervisor_type = 'xenserver'; update cloud.configuration set value = 'systemvm-xenserver-4.4' where name = 'router.template.xen'; However I did not need to do this as the cloud.vm_instance table and cloud.configuration table had automatically been updated to the correct values, so are these steps actually necessary? 4.3 introduced the ability to manage the restart of VRs via the UI, but after upgrading to 4.4.1 the UI lists all VRs as NOT requiring upgrade, even though they have not been upgraded yet and are clearly shown as still be at version 4.3 I could fix the release notes issues, but there may be good reasons why they are how they are that I am not aware of, so just wanted to highlight them for now. I have only tested the XenServer upgrade steps and only from 4.3 so there may be similar errors in other sections. Regards Geoff
RE: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
Hi Pierre-Luc, Nope, I was deffinately looking at 4.4.1 release notes, complete with sections titled 'Issues fixed in 4.4.1' etc http://cloudstack-release-notes.readthedocs.org/en/latest/upgrade/upgrade-4.3.html I would include a screen shot of the page but it will get stripped from the e-mail Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 14:49 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean install +and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm64/ lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-4 .4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI - cloudstack service crashed! (Install is running inside VirtualBox and Management VM is also NFS Server so added more RAM and tried again) - repeated test after a manual clean up and it was successful Live Migrated (VM running) Root Volume between Pri Storage via UI Disabled / Re-enabled Host Adding / removing NICs and changing default etc via UI Deployed new VPC, with two tiers, added VM to each tier, setup ACLs etc via API Then I did an upgrade test of a 4.3.1 system using the latest system VM template from Jenkins (this system was originally built on 4.3.0 and upgraded to 4.3.1, before being upgraded to 4.4.1) New System VM template installed OK The steps in the release notes about downloading vhd-utils for XenServer are misleading. If you blindly follow the steps the simply end up with a 2nd copy 'vhd-utils.1' as this is an upgrade and you will already have vhd-utils on the management server, at least if upgrading from a recent release such as 4.3.x. If vhd-utils needs replacing we need to be specific about removing the old one. I don’t think it actually needs replacing, it's just in a different location to older installs, but the 4.3 upgrade guide still has this step in it. (I can't remember which release changed the location) The MySQL Statements for the manual upgrade of the template are also incorrect as they do not include the DB name so fail e.g. select id,name from vm_template where name = 'systemvm-xenserver-4.4'; should be select id,name from cloud.vm_template where name = 'systemvm-xenserver-4.4'; The same with the following commands update vm_template set type='SYSTEM' where id='ID FROM COMMAND #1'; update vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='ConsoleProxy' and hypervisor_type = 'xenserver'; update vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='SecondaryStorageVm' and hypervisor_type = 'xenserver'; update configuration set value = 'systemvm-xenserver-4.4' where name = 'router.template.xen'; should be update cloud.vm_template set type='SYSTEM' where id='ID FROM COMMAND #1'; update cloud.vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='ConsoleProxy' and hypervisor_type = 'xenserver'; update cloud.vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='SecondaryStorageVm' and hypervisor_type = 'xenserver'; update cloud.configuration set value = 'systemvm-xenserver-4.4' where name = 'router.template.xen'; However I did not need to do this as the cloud.vm_instance table and
Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
ok, fixed it , /latest is pointing on the master branch for the RN git repo. so it's not reflecting the latest version of our product. I've disable the /latest version so URL will default to 4.4.0 RN for the moment, and the 4.4.1 RN is the correct one. Seb, do you see a problem disabling master and latest build in RTD ? make more sense? PL On Wed, Oct 1, 2014 at 10:00 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Hi Pierre-Luc, Nope, I was deffinately looking at 4.4.1 release notes, complete with sections titled 'Issues fixed in 4.4.1' etc http://cloudstack-release-notes.readthedocs.org/en/latest/upgrade/upgrade-4.3.html I would include a screen shot of the page but it will get stripped from the e-mail Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 14:49 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean install +and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm64/ lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template-4 .4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI - cloudstack service crashed! (Install is running inside VirtualBox and Management VM is also NFS Server so added more RAM and tried again) - repeated test after a manual clean up and it was successful Live Migrated (VM running) Root Volume between Pri Storage via UI Disabled / Re-enabled Host Adding / removing NICs and changing default etc via UI Deployed new VPC, with two tiers, added VM to each tier, setup ACLs etc via API Then I did an upgrade test of a 4.3.1 system using the latest system VM template from Jenkins (this system was originally built on 4.3.0 and upgraded to 4.3.1, before being upgraded to 4.4.1) New System VM template installed OK The steps in the release notes about downloading vhd-utils for XenServer are misleading. If you blindly follow the steps the simply end up with a 2nd copy 'vhd-utils.1' as this is an upgrade and you will already have vhd-utils on the management server, at least if upgrading from a recent release such as 4.3.x. If vhd-utils needs replacing we need to be specific about removing the old one. I don’t think it actually needs replacing, it's just in a different location to older installs, but the 4.3 upgrade guide still has this step in it. (I can't remember which release changed the location) The MySQL Statements for the manual upgrade of the template are also incorrect as they do not include the DB name so fail e.g. select id,name from vm_template where name = 'systemvm-xenserver-4.4'; should be select id,name from cloud.vm_template where name = 'systemvm-xenserver-4.4'; The same with the following commands update vm_template set type='SYSTEM' where id='ID FROM COMMAND #1'; update vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='ConsoleProxy' and hypervisor_type = 'xenserver'; update vm_instance set vm_template_id = 'ID FROM COMMAND #1' where type='SecondaryStorageVm' and hypervisor_type = 'xenserver'; update configuration set value = 'systemvm-xenserver-4.4' where name = 'router.template.xen';
Re: Unable to upload SSL certificate for realhostip replacement
Hi, I’ve fixed cloudmonkey to url encode parameters so now you can use cloudmonkey to upload custom certificate but only in non-interactive mode on shell (bash/zsh). You’ll have to install cloudmonkey from source for now since the fix is only on master. Something like: $ cloudmonkey upload customcertificate id=xx domainsuffix=yy name=zzz certificate=‘asdf asdfasdf asdfasdf asdf---' I’ve some issues to report while replacing certificates to get rid of realhostip, this is specific for Xen could apply for other hypervisors as well: - In case of 4.2, I see in the database that seq is 0 for the root certificate for the realhostip.com domain. I uploaded certificates in order (root, then intermediate and finally SSL cert from UI), and I see the old certificate is still there. after CPVM/SSVM restarts and are in UP state I still get SSL errors and I see that systemvm.iso is not getting patched. How to fix this? Or force systemvm.iso patching? - In case of 4.3.0 and above, I see the same issue. I’m confused whether to use *. wildcard in global setting or not. On 27-Sep-2014, at 9:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For the encoding, in your case it was the space character causing the issue - it should be replaced by %20. The correct encoding would be (hoping mail clients don't screw up the blob): -BEGIN%20CERTIFICATE-%0AMIIDfTCCAuagAwIBAgIDErvmMA0GCSqGSIb3DQEBBQU AME4xCzAJBgNVBAYTAlVT%0AMRAwDgYDVQQKEwdFcXVpZmF4MS0wKwYDVQQLEyRFcXVpZmF4IFN lY3VyZSBDZXJ0%0AaWZpY2F0ZSBBdXRob3JpdHkwHhcNMDIwNTIxMDQwMDAwWhcNMTgwODIxMDQ wMDAw%0AWjBCMQswCQYDVQQGEwJVUzEWMBQGA1UEChMNR2VvVHJ1c3QgSW5jLjEbMBkGA1UE%0A AxMSR2VvVHJ1c3QgR2xvYmFsIENBMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB%0ACgKCAQEA 2swYYzD99BcjGlZ%2BW988bDjkcbd4kdS8odhM%2BKhDtgPpTSEHCIjaWC9m%0AOSm9BXiLnTjo BbdqfnGk5sRgprDvgOSJKA%2BeJdbtg%2FOtppHHmMlCGDUUna2YRpIu%0AT8rxh0PBFpVXLVDv iS2Aelet8u5fa9IAjbkU%2BBQVNdnARqN7csiRv8lVK83Qlz6c%0AJmTM386DGXHKTubU1XupGc 1V3sjs0l44U%2BVcT4wt%2FlAjNvxm5suOpDkZALeVAjmR%0ACw7%2BOC7RHQWa9k0%2Bbw8HHa 8sHo9gOeL6NlMTOdReJivbPagUvTLrGAMoUgRx5asz%0APeE4uwc2hGKceeoWMPRfwCvocWvk%2 BQIDAQABo4HwMIHtMB8GA1UdIwQYMBaAFEjm%0AaPkr0rKV10fYIyAQTzOYkJ%2FUMB0GA1UdDg QWBBTAephojYn7qwVkDBF9qn1luMrM%0ATjAPBgNVHRMBAf8EBTADAQH%2FMA4GA1UdDwEB%2Fw QEAwIBBjA6BgNVHR8EMzAxMC%2Bg%0ALaArhilodHRwOi8vY3JsLmdlb3RydXN0LmNvbS9jcmxz L3NlY3VyZWNhLmNybDBO%0ABgNVHSAERzBFMEMGBFUdIAAwOzA5BggrBgEFBQcCARYtaHR0cHM6 Ly93d3cuZ2Vv%0AdHJ1c3QuY29tL3Jlc291cmNlcy9yZXBvc2l0b3J5MA0GCSqGSIb3DQEBBQUA A4GB%0AAHbhEm5OSxYShjAGsoEIz%2FAIx8dxfmbuwu3UOx%2F%2F8PDITtZDOLC5MH0Y0FWDom rL%0ANhGc6Ehmo21%2FuBPUR%2F6LWlxz%2FK7ZGzIZOKuXNBSqltLroxwUCEm2u%2BWR74M26x 1W%0Ab8ravHNjkOR%2Fez4iyz0H7V84dJzjA1BOoa%2BY7mHyhD8S%0A-END%20CERTIFIC ATE- As for the global parameter, you can set it to something like a few seconds and reset to original value when the URLs have been expired. Thanks Amogh On 9/27/14 10:53 AM, Indra Pramana in...@sg.or.id wrote: Hi Wido, I have changed the value of secstorage.ssl.cert.domain and restart management server, before I start uploading all the certificates. I found this article, which might be related to the problem: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Troubleshooting+-+u ploading+custom+domain+certificate+instead+of+using+realhostip.com *Specific Issues seen* 1. Download urls point to the old domain. 1. Reduce the expiration duration of the urls by changing global config extract.url.expiration.interval 2. And change the frequency for cleanup thread through extract.url.cleanup.interval restart MS. 3. Wait for the cleanup thread duration and try downloading again. See whether the url is deleted. 4. DB tables to check (don¹t recommend but worst case) Version 4.2 upload table persists url. Entry is hard deleted on expiration of url. Version = 4.2 template_store_ref, download_url is made null on expiration of url. volume_store_ref, entry hard deleted on expiration of url. But I'm not too sure what is the recommended values I need to set for extract.url.expiration.interval and extract.url.cleanup.interval. Any advise? Thank you. On Sun, Sep 28, 2014 at 1:39 AM, Wido den Hollander w...@widodh.nl wrote: Op 27 sep. 2014 om 19:25 heeft Indra Pramana in...@sg.or.id het volgende geschreven: Dear all, FYI, I managed to complete the tasks and install the certificates. As a workaround to the unable to upload the root/intermediate cert via API issue, I uploaded a certificate with just BEGIN as text via API, and then proceed to update the keystore table on the MySQL database directly to input the whole cert. It seems to be working, after I uploaded the cert and private key via GUI, I can see that both CPVM and SSVM are being restarted. When I test: - Console is working, using my own domain now. Yay! :) - However, when I try to test downloading a template, it's still showing
RE: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
Great, glad to hear it was an easy fix. Now however I have found another problem. In the UI if I go to Infrastructure/Clusters/cluster1/and then choose the settings tab, I get an error and no information is displayed. Can others please check this to see if it is a unique problem to me or a common issue. This is on my upgraded install, I'll the check the clean install in a few minutes once its power up. Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 15:29 To: dev@cloudstack.apache.org; Sebastien Goasguen Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 ok, fixed it , /latest is pointing on the master branch for the RN git repo. so it's not reflecting the latest version of our product. I've disable the /latest version so URL will default to 4.4.0 RN for the moment, and the 4.4.1 RN is the correct one. Seb, do you see a problem disabling master and latest build in RTD ? make more sense? PL On Wed, Oct 1, 2014 at 10:00 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Hi Pierre-Luc, Nope, I was deffinately looking at 4.4.1 release notes, complete with sections titled 'Issues fixed in 4.4.1' etc http://cloudstack-release-notes.readthedocs.org/en/latest/upgrade/upgr ade-4.3.html I would include a screen shot of the page but it will get stripped from the e-mail Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 14:49 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en /4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean install +and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm6 4/ lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template -4 .4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI - cloudstack service crashed! (Install is running inside VirtualBox and Management VM is also NFS Server so added more RAM and tried again) - repeated test after a manual clean up and it was successful Live Migrated (VM running) Root Volume between Pri Storage via UI Disabled / Re-enabled Host Adding / removing NICs and changing default etc via UI Deployed new VPC, with two tiers, added VM to each tier, setup ACLs etc via API Then I did an upgrade test of a 4.3.1 system using the latest system VM template from Jenkins (this system was originally built on 4.3.0 and upgraded to 4.3.1, before being upgraded to 4.4.1) New System VM template installed OK The steps in the release notes about downloading vhd-utils for XenServer are misleading. If you blindly follow the steps the simply end up with a 2nd copy 'vhd-utils.1' as this is an upgrade and you will already have vhd-utils on the management server, at least if upgrading from a recent release such as 4.3.x. If vhd-utils needs replacing we need to be specific about removing the old one. I don’t think it actually needs replacing, it's just in a different location to older installs, but the 4.3 upgrade guide still has this step in it. (I can't remember which release changed
Re: Unable to upload SSL certificate for realhostip replacement
Just to update on the certificate upload issue with 4.2: I’m able to download and add new volumes/templates/isos and the link provided has a valid https url with the same certificate that I uploaded though when I try to access the console I get SSL cert error and I see that it’s still returning the old *.realhostip.com certificate. I’ve tried to delete old CPVMs and I see the same issue coming up again. On 01-Oct-2014, at 4:55 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, I’ve fixed cloudmonkey to url encode parameters so now you can use cloudmonkey to upload custom certificate but only in non-interactive mode on shell (bash/zsh). You’ll have to install cloudmonkey from source for now since the fix is only on master. Something like: $ cloudmonkey upload customcertificate id=xx domainsuffix=yy name=zzz certificate=‘asdf asdfasdf asdfasdf asdf---' I’ve some issues to report while replacing certificates to get rid of realhostip, this is specific for Xen could apply for other hypervisors as well: - In case of 4.2, I see in the database that seq is 0 for the root certificate for the realhostip.com domain. I uploaded certificates in order (root, then intermediate and finally SSL cert from UI), and I see the old certificate is still there. after CPVM/SSVM restarts and are in UP state I still get SSL errors and I see that systemvm.iso is not getting patched. How to fix this? Or force systemvm.iso patching? - In case of 4.3.0 and above, I see the same issue. I’m confused whether to use *. wildcard in global setting or not. On 27-Sep-2014, at 9:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For the encoding, in your case it was the space character causing the issue - it should be replaced by %20. The correct encoding would be (hoping mail clients don't screw up the blob): -BEGIN%20CERTIFICATE-%0AMIIDfTCCAuagAwIBAgIDErvmMA0GCSqGSIb3DQEBBQU AME4xCzAJBgNVBAYTAlVT%0AMRAwDgYDVQQKEwdFcXVpZmF4MS0wKwYDVQQLEyRFcXVpZmF4IFN lY3VyZSBDZXJ0%0AaWZpY2F0ZSBBdXRob3JpdHkwHhcNMDIwNTIxMDQwMDAwWhcNMTgwODIxMDQ wMDAw%0AWjBCMQswCQYDVQQGEwJVUzEWMBQGA1UEChMNR2VvVHJ1c3QgSW5jLjEbMBkGA1UE%0A AxMSR2VvVHJ1c3QgR2xvYmFsIENBMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB%0ACgKCAQEA 2swYYzD99BcjGlZ%2BW988bDjkcbd4kdS8odhM%2BKhDtgPpTSEHCIjaWC9m%0AOSm9BXiLnTjo BbdqfnGk5sRgprDvgOSJKA%2BeJdbtg%2FOtppHHmMlCGDUUna2YRpIu%0AT8rxh0PBFpVXLVDv iS2Aelet8u5fa9IAjbkU%2BBQVNdnARqN7csiRv8lVK83Qlz6c%0AJmTM386DGXHKTubU1XupGc 1V3sjs0l44U%2BVcT4wt%2FlAjNvxm5suOpDkZALeVAjmR%0ACw7%2BOC7RHQWa9k0%2Bbw8HHa 8sHo9gOeL6NlMTOdReJivbPagUvTLrGAMoUgRx5asz%0APeE4uwc2hGKceeoWMPRfwCvocWvk%2 BQIDAQABo4HwMIHtMB8GA1UdIwQYMBaAFEjm%0AaPkr0rKV10fYIyAQTzOYkJ%2FUMB0GA1UdDg QWBBTAephojYn7qwVkDBF9qn1luMrM%0ATjAPBgNVHRMBAf8EBTADAQH%2FMA4GA1UdDwEB%2Fw QEAwIBBjA6BgNVHR8EMzAxMC%2Bg%0ALaArhilodHRwOi8vY3JsLmdlb3RydXN0LmNvbS9jcmxz L3NlY3VyZWNhLmNybDBO%0ABgNVHSAERzBFMEMGBFUdIAAwOzA5BggrBgEFBQcCARYtaHR0cHM6 Ly93d3cuZ2Vv%0AdHJ1c3QuY29tL3Jlc291cmNlcy9yZXBvc2l0b3J5MA0GCSqGSIb3DQEBBQUA A4GB%0AAHbhEm5OSxYShjAGsoEIz%2FAIx8dxfmbuwu3UOx%2F%2F8PDITtZDOLC5MH0Y0FWDom rL%0ANhGc6Ehmo21%2FuBPUR%2F6LWlxz%2FK7ZGzIZOKuXNBSqltLroxwUCEm2u%2BWR74M26x 1W%0Ab8ravHNjkOR%2Fez4iyz0H7V84dJzjA1BOoa%2BY7mHyhD8S%0A-END%20CERTIFIC ATE- As for the global parameter, you can set it to something like a few seconds and reset to original value when the URLs have been expired. Thanks Amogh On 9/27/14 10:53 AM, Indra Pramana in...@sg.or.id wrote: Hi Wido, I have changed the value of secstorage.ssl.cert.domain and restart management server, before I start uploading all the certificates. I found this article, which might be related to the problem: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Troubleshooting+-+u ploading+custom+domain+certificate+instead+of+using+realhostip.com *Specific Issues seen* 1. Download urls point to the old domain. 1. Reduce the expiration duration of the urls by changing global config extract.url.expiration.interval 2. And change the frequency for cleanup thread through extract.url.cleanup.interval restart MS. 3. Wait for the cleanup thread duration and try downloading again. See whether the url is deleted. 4. DB tables to check (don¹t recommend but worst case) Version 4.2 upload table persists url. Entry is hard deleted on expiration of url. Version = 4.2 template_store_ref, download_url is made null on expiration of url. volume_store_ref, entry hard deleted on expiration of url. But I'm not too sure what is the recommended values I need to set for extract.url.expiration.interval and extract.url.cleanup.interval. Any advise? Thank you. On Sun, Sep 28, 2014 at 1:39 AM, Wido den Hollander w...@widodh.nl wrote: Op 27 sep. 2014 om 19:25 heeft Indra Pramana in...@sg.or.id het volgende geschreven: Dear all, FYI, I managed to complete the tasks and install the certificates. As a workaround to the unable to
RE: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
The Cluster Details UI issue is only present on my upgraded system, a clean install of 4.4.1 correctly shows the value. Need someone else who upgraded to also check Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com] Sent: 01 October 2014 16:16 To: dev@cloudstack.apache.org; Sebastien Goasguen Subject: RE: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Great, glad to hear it was an easy fix. Now however I have found another problem. In the UI if I go to Infrastructure/Clusters/cluster1/and then choose the settings tab, I get an error and no information is displayed. Can others please check this to see if it is a unique problem to me or a common issue. This is on my upgraded install, I'll the check the clean install in a few minutes once its power up. Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 15:29 To: dev@cloudstack.apache.org; Sebastien Goasguen Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 ok, fixed it , /latest is pointing on the master branch for the RN git repo. so it's not reflecting the latest version of our product. I've disable the /latest version so URL will default to 4.4.0 RN for the moment, and the 4.4.1 RN is the correct one. Seb, do you see a problem disabling master and latest build in RTD ? make more sense? PL On Wed, Oct 1, 2014 at 10:00 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Hi Pierre-Luc, Nope, I was deffinately looking at 4.4.1 release notes, complete with sections titled 'Issues fixed in 4.4.1' etc http://cloudstack-release-notes.readthedocs.org/en/latest/upgrade/upgr ade-4.3.html I would include a screen shot of the page but it will get stripped from the e-mail Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 14:49 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en /4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean install +and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm6 4/ lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template -4 .4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI - cloudstack service crashed! (Install is running inside VirtualBox and Management VM is also NFS Server so added more RAM and tried again) - repeated test after a manual clean up and it was successful Live Migrated (VM running) Root Volume between Pri Storage via UI Disabled / Re-enabled Host Adding / removing NICs and changing default etc via UI Deployed new VPC, with two tiers, added VM to each tier, setup ACLs etc via API Then I did an upgrade test of a 4.3.1 system using the latest system VM template from Jenkins (this system was originally built on 4.3.0 and upgraded to 4.3.1, before being upgraded to 4.4.1) New System VM template installed OK The steps in the release notes about downloading
Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
yep, this is the JIRA: https://issues.apache.org/jira/browse/CLOUDSTACK-7219 unfortunately it hasn't been fixed in 4.4.1 :-( PL On Wed, Oct 1, 2014 at 11:16 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Great, glad to hear it was an easy fix. Now however I have found another problem. In the UI if I go to Infrastructure/Clusters/cluster1/and then choose the settings tab, I get an error and no information is displayed. Can others please check this to see if it is a unique problem to me or a common issue. This is on my upgraded install, I'll the check the clean install in a few minutes once its power up. Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 15:29 To: dev@cloudstack.apache.org; Sebastien Goasguen Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 ok, fixed it , /latest is pointing on the master branch for the RN git repo. so it's not reflecting the latest version of our product. I've disable the /latest version so URL will default to 4.4.0 RN for the moment, and the 4.4.1 RN is the correct one. Seb, do you see a problem disabling master and latest build in RTD ? make more sense? PL On Wed, Oct 1, 2014 at 10:00 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Hi Pierre-Luc, Nope, I was deffinately looking at 4.4.1 release notes, complete with sections titled 'Issues fixed in 4.4.1' etc http://cloudstack-release-notes.readthedocs.org/en/latest/upgrade/upgr ade-4.3.html I would include a screen shot of the page but it will get stripped from the e-mail Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 14:49 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en /4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean install +and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm6 4/ lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template -4 .4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI - cloudstack service crashed! (Install is running inside VirtualBox and Management VM is also NFS Server so added more RAM and tried again) - repeated test after a manual clean up and it was successful Live Migrated (VM running) Root Volume between Pri Storage via UI Disabled / Re-enabled Host Adding / removing NICs and changing default etc via UI Deployed new VPC, with two tiers, added VM to each tier, setup ACLs etc via API Then I did an upgrade test of a 4.3.1 system using the latest system VM template from Jenkins (this system was originally built on 4.3.0 and upgraded to 4.3.1, before being upgraded to 4.4.1) New System VM template installed OK The steps in the release notes about downloading vhd-utils for XenServer are misleading. If you blindly follow the steps the simply end up with a 2nd copy 'vhd-utils.1' as this is an upgrade and you will already have vhd-utils on the management server, at
Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
Had the same issue when upgraded from 4.3.0 but did not when upgraded from 4.2.1. *Pierre-Luc DION* Architecte de Solution Cloud | Cloud Solutions Architect t 855.652.5683 *CloudOps* Votre partenaire infonuagique* | *Cloud Solutions Experts 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6 w cloudops.com *|* tw @CloudOps_ On Wed, Oct 1, 2014 at 11:21 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: The Cluster Details UI issue is only present on my upgraded system, a clean install of 4.4.1 correctly shows the value. Need someone else who upgraded to also check Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Geoff Higginbottom [mailto:geoff.higginbot...@shapeblue.com] Sent: 01 October 2014 16:16 To: dev@cloudstack.apache.org; Sebastien Goasguen Subject: RE: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Great, glad to hear it was an easy fix. Now however I have found another problem. In the UI if I go to Infrastructure/Clusters/cluster1/and then choose the settings tab, I get an error and no information is displayed. Can others please check this to see if it is a unique problem to me or a common issue. This is on my upgraded install, I'll the check the clean install in a few minutes once its power up. Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 15:29 To: dev@cloudstack.apache.org; Sebastien Goasguen Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 ok, fixed it , /latest is pointing on the master branch for the RN git repo. so it's not reflecting the latest version of our product. I've disable the /latest version so URL will default to 4.4.0 RN for the moment, and the 4.4.1 RN is the correct one. Seb, do you see a problem disabling master and latest build in RTD ? make more sense? PL On Wed, Oct 1, 2014 at 10:00 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Hi Pierre-Luc, Nope, I was deffinately looking at 4.4.1 release notes, complete with sections titled 'Issues fixed in 4.4.1' etc http://cloudstack-release-notes.readthedocs.org/en/latest/upgrade/upgr ade-4.3.html I would include a screen shot of the page but it will get stripped from the e-mail Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 14:49 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en /4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean install +and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemvm6 4/ lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64template -4 .4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI - cloudstack service crashed! (Install is running inside VirtualBox and Management VM is also NFS Server so added more RAM and tried again) - repeated test after a manual clean up and it was
RE: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
This has to be a blocker then as a system which is upgraded from 4.2 or earlier will lose its Overprovisioning settings as they get reset to 1, and you have to go the Cluster Settings to reset them back to the value they were pre-upgrade, if you can't you could end up with the situation where Customer VMs will not restart. The only alternative is to force users to upgrade to 4.3.1, reset the overprovisioning on the Cluster, then upgrade to 4.4.1, but even then they cannot make any changes via the UI (assume API will work) Changing my vote -1 until this is resolved Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 16:20 To: dev@cloudstack.apache.org Cc: Sebastien Goasguen Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 yep, this is the JIRA: https://issues.apache.org/jira/browse/CLOUDSTACK-7219 unfortunately it hasn't been fixed in 4.4.1 :-( PL On Wed, Oct 1, 2014 at 11:16 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Great, glad to hear it was an easy fix. Now however I have found another problem. In the UI if I go to Infrastructure/Clusters/cluster1/and then choose the settings tab, I get an error and no information is displayed. Can others please check this to see if it is a unique problem to me or a common issue. This is on my upgraded install, I'll the check the clean install in a few minutes once its power up. Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 15:29 To: dev@cloudstack.apache.org; Sebastien Goasguen Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 ok, fixed it , /latest is pointing on the master branch for the RN git repo. so it's not reflecting the latest version of our product. I've disable the /latest version so URL will default to 4.4.0 RN for the moment, and the 4.4.1 RN is the correct one. Seb, do you see a problem disabling master and latest build in RTD ? make more sense? PL On Wed, Oct 1, 2014 at 10:00 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Hi Pierre-Luc, Nope, I was deffinately looking at 4.4.1 release notes, complete with sections titled 'Issues fixed in 4.4.1' etc http://cloudstack-release-notes.readthedocs.org/en/latest/upgrade/up gr ade-4.3.html I would include a screen shot of the page but it will get stripped from the e-mail Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 14:49 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/ en /4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean +install and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-systemv m6 4/ lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64templa te -4 .4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root Volume between Pri Storage via UI -
Re: test day reminder
I'd be curious to know if it works by re-adding the host. I remember running into situations like this in the past, where the mgmt server was either not fully up or rejecting agents for some reason. On Wed, Oct 1, 2014 at 7:01 AM, Wido den Hollander w...@widodh.nl wrote: On 09/30/2014 09:26 AM, Daan Hoogland wrote: H all, As you might remember, we agreed on a test day for the master branch on Wednesday the 1st October, during our last meeting in Schihol-Rijk with some folks. Please feel invited to test master so that we can report to our RM for 4.5 for the current state and he can have a short and quick journey to releasing. I didn't forget! Just tested by upgrading from 4.4.1 (RC) to 4.5.0 and that worked, but my KVM agent couldn't connect anymore afterwards: 2014-10-01 14:59:08,789 INFO [utils.nio.NioClient] (Agent-Selector:null) Connecting to cloudstack.:8250 2014-10-01 14:59:08,809 ERROR [utils.nio.NioConnection] (Agent-Selector:null) Unable to initialize the threads. java.io.IOException: Connection closed with -1 on reading size. at com.cloud.utils.nio.Link.doHandshake(Link.java:509) at com.cloud.utils.nio.NioClient.init(NioClient.java:78) at com.cloud.utils.nio.NioConnection.run(NioConnection.java:111) at java.lang.Thread.run(Thread.java:744) Any ideas? When I try to telnet to 8250 the connection is closed immediately by the mgmt server. Nothing in the logs. So this is currently preventing me from testing the KVM agents. Wido optimistically yours,
RE: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100
Can someone who's seeing this confirm whether it's a UI issue, or whether it's the same through the API? The ticket CLOUDSTACK-7219 has Component=Management Server, not UI, and (without having seen it myself) it feels more like a server-side issue to me. -- Stephen Turner -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 16:47 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 From what I understand from this issue is UI only, which is why it wasn't a blocker before. anyway, you have a valid point :-( now the question would be: who could fix this ? Cluster settings change you are refering are theses [1] , right ? [1] http://cloudstack-release-notes.readthedocs.org/en/4.4.1/upgrade/upgrade_notes.html#settings-changes On Wed, Oct 1, 2014 at 11:33 AM, Erik Weber terbol...@gmail.com wrote: Has been like that since 4.4.0 Erik 1. okt. 2014 17:16 skrev Geoff Higginbottom geoff.higginbot...@shapeblue.com følgende: Great, glad to hear it was an easy fix. Now however I have found another problem. In the UI if I go to Infrastructure/Clusters/cluster1/and then choose the settings tab, I get an error and no information is displayed. Can others please check this to see if it is a unique problem to me or a common issue. This is on my upgraded install, I'll the check the clean install in a few minutes once its power up. Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 15:29 To: dev@cloudstack.apache.org; Sebastien Goasguen Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 ok, fixed it , /latest is pointing on the master branch for the RN git repo. so it's not reflecting the latest version of our product. I've disable the /latest version so URL will default to 4.4.0 RN for the moment, and the 4.4.1 RN is the correct one. Seb, do you see a problem disabling master and latest build in RTD ? make more sense? PL On Wed, Oct 1, 2014 at 10:00 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: Hi Pierre-Luc, Nope, I was deffinately looking at 4.4.1 release notes, complete with sections titled 'Issues fixed in 4.4.1' etc http://cloudstack-release-notes.readthedocs.org/en/latest/upgrade/ upgr ade-4.3.html I would include a screen shot of the page but it will get stripped from the e-mail Regards Geoff Higginbottom D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 geoff.higginbot...@shapeblue.com -Original Message- From: Pierre-Luc Dion [mailto:pd...@cloudops.com] Sent: 01 October 2014 14:49 To: dev@cloudstack.apache.org Subject: Re: [VOTE][ACS44]Apache CloudStack 4.4.1 RC 1 in branch 4.4-RC20140924T2100 Geoff, Could it be possible you've followed 4.4.0 upgrade path ? because we don't have to perform any MySQL query when upgrading to 4.4.1, otherwise the RN is not correct. the current RN for 4.4.1 is: http://docs.cloudstack.apache.org/projects/cloudstack-release-note s/en /4.4.1/ (not /latest yet as it's not release yet) for the vhd-utils, I wasn't sure if it was making sense to keep it on all upgrade path, thanks for the comment, make sense to remove if from upgrade 4.3.x and probably 4.2.x as it should already be in place. PL On Wed, Oct 1, 2014 at 9:35 AM, Geoff Higginbottom geoff.higginbot...@shapeblue.com wrote: +0 only because of the issues in the release notes, a clean +install and an upgrade from 4.3.1 went OK, but only because I know how to do it, it would not work if I followed the release notes. The Router Upgrade notification elements in the UI, introduced in 4.3 are also broken (this should possibly be a -1 as it could result in installs running with the wrong version of the VRs without realising) Notes: 2x XenServer 6.2 in a single Cluster NFS Primary Storage x2 System VM Template from http://jenkins.buildacloud.org/view/4.4/job/cloudstack-4.4-syste mvm6 4/ lastSuccessfulBuild/artifact/tools/appliance/dist/systemvm64temp late -4 .4-2014-09-30-xen.vhd.bz2 Clean install of 4.4.1 to single management server on CentOS 6.5 with MySQL installed locally Created new Zone, POD, Cluster, Sec Storage, Hosts, Pri Storage all via API Updated Various Global Settings via API Created Domains and Accounts via API Deployed VMs for user account as Root and configured network Egress rules via API Deployed VM as root via UI Live Migrated VMs between Hosts Offline Migrated (VM stopped) Root
Re: test day reminder
I have been looking at using my collegues integration work for the master branch. So far the packaging part is holding my back as it uses 'SNAPSHOT' in the build and does not allow for patch levels (in package.sh) I am looking at a solution. what I am thinking of is making rpms like cloudstack-package-version-including-SNAPSHOT-version-buildnumber-from-jenkins.el6_64.rpm this seems quite verbose but it gives us space to do continuous integration on the artifact. I am sure a scheme like this can be deviced for .deb packages as well. thoughts? The actual testing, for as little far as I got to do, did not yield issues yet. Daan On Wed, Oct 1, 2014 at 5:28 PM, Marcus shadow...@gmail.com wrote: I'd be curious to know if it works by re-adding the host. I remember running into situations like this in the past, where the mgmt server was either not fully up or rejecting agents for some reason. On Wed, Oct 1, 2014 at 7:01 AM, Wido den Hollander w...@widodh.nl wrote: On 09/30/2014 09:26 AM, Daan Hoogland wrote: H all, As you might remember, we agreed on a test day for the master branch on Wednesday the 1st October, during our last meeting in Schihol-Rijk with some folks. Please feel invited to test master so that we can report to our RM for 4.5 for the current state and he can have a short and quick journey to releasing. I didn't forget! Just tested by upgrading from 4.4.1 (RC) to 4.5.0 and that worked, but my KVM agent couldn't connect anymore afterwards: 2014-10-01 14:59:08,789 INFO [utils.nio.NioClient] (Agent-Selector:null) Connecting to cloudstack.:8250 2014-10-01 14:59:08,809 ERROR [utils.nio.NioConnection] (Agent-Selector:null) Unable to initialize the threads. java.io.IOException: Connection closed with -1 on reading size. at com.cloud.utils.nio.Link.doHandshake(Link.java:509) at com.cloud.utils.nio.NioClient.init(NioClient.java:78) at com.cloud.utils.nio.NioConnection.run(NioConnection.java:111) at java.lang.Thread.run(Thread.java:744) Any ideas? When I try to telnet to 8250 the connection is closed immediately by the mgmt server. Nothing in the logs. So this is currently preventing me from testing the KVM agents. Wido optimistically yours, -- Daan
Re: Unable to upload SSL certificate for realhostip replacement
Hi, For 4.2 you may want to refer here : http://www.chipchilders.com/blog/2013/1/2/undocumented-feature-using-certif icate-chains-in-cloudstack.html 4.3 had a missing commit, due to which the global config consoleproxy.url.domain had to be set to mydomain.com, instead of *.mydomain.com. This has been fixed in 4.3.1 Apologies for the inconvenience. Amogh On 10/1/14 8:16 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Just to update on the certificate upload issue with 4.2: I’m able to download and add new volumes/templates/isos and the link provided has a valid https url with the same certificate that I uploaded though when I try to access the console I get SSL cert error and I see that it’s still returning the old *.realhostip.com certificate. I’ve tried to delete old CPVMs and I see the same issue coming up again. On 01-Oct-2014, at 4:55 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, I’ve fixed cloudmonkey to url encode parameters so now you can use cloudmonkey to upload custom certificate but only in non-interactive mode on shell (bash/zsh). You’ll have to install cloudmonkey from source for now since the fix is only on master. Something like: $ cloudmonkey upload customcertificate id=xx domainsuffix=yy name=zzz certificate=‘asdf asdfasdf asdfasdf asdf---' I’ve some issues to report while replacing certificates to get rid of realhostip, this is specific for Xen could apply for other hypervisors as well: - In case of 4.2, I see in the database that seq is 0 for the root certificate for the realhostip.com domain. I uploaded certificates in order (root, then intermediate and finally SSL cert from UI), and I see the old certificate is still there. after CPVM/SSVM restarts and are in UP state I still get SSL errors and I see that systemvm.iso is not getting patched. How to fix this? Or force systemvm.iso patching? - In case of 4.3.0 and above, I see the same issue. I’m confused whether to use *. wildcard in global setting or not. On 27-Sep-2014, at 9:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For the encoding, in your case it was the space character causing the issue - it should be replaced by %20. The correct encoding would be (hoping mail clients don't screw up the blob): -BEGIN%20CERTIFICATE-%0AMIIDfTCCAuagAwIBAgIDErvmMA0GCSqGSIb3DQEB BQU AME4xCzAJBgNVBAYTAlVT%0AMRAwDgYDVQQKEwdFcXVpZmF4MS0wKwYDVQQLEyRFcXVpZmF4 IFN lY3VyZSBDZXJ0%0AaWZpY2F0ZSBBdXRob3JpdHkwHhcNMDIwNTIxMDQwMDAwWhcNMTgwODIx MDQ wMDAw%0AWjBCMQswCQYDVQQGEwJVUzEWMBQGA1UEChMNR2VvVHJ1c3QgSW5jLjEbMBkGA1UE %0A AxMSR2VvVHJ1c3QgR2xvYmFsIENBMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB%0ACgKCA QEA 2swYYzD99BcjGlZ%2BW988bDjkcbd4kdS8odhM%2BKhDtgPpTSEHCIjaWC9m%0AOSm9BXiLn Tjo BbdqfnGk5sRgprDvgOSJKA%2BeJdbtg%2FOtppHHmMlCGDUUna2YRpIu%0AT8rxh0PBFpVXL VDv iS2Aelet8u5fa9IAjbkU%2BBQVNdnARqN7csiRv8lVK83Qlz6c%0AJmTM386DGXHKTubU1Xu pGc 1V3sjs0l44U%2BVcT4wt%2FlAjNvxm5suOpDkZALeVAjmR%0ACw7%2BOC7RHQWa9k0%2Bbw8 HHa 8sHo9gOeL6NlMTOdReJivbPagUvTLrGAMoUgRx5asz%0APeE4uwc2hGKceeoWMPRfwCvocWv k%2 BQIDAQABo4HwMIHtMB8GA1UdIwQYMBaAFEjm%0AaPkr0rKV10fYIyAQTzOYkJ%2FUMB0GA1U dDg QWBBTAephojYn7qwVkDBF9qn1luMrM%0ATjAPBgNVHRMBAf8EBTADAQH%2FMA4GA1UdDwEB% 2Fw QEAwIBBjA6BgNVHR8EMzAxMC%2Bg%0ALaArhilodHRwOi8vY3JsLmdlb3RydXN0LmNvbS9jc mxz L3NlY3VyZWNhLmNybDBO%0ABgNVHSAERzBFMEMGBFUdIAAwOzA5BggrBgEFBQcCARYtaHR0c HM6 Ly93d3cuZ2Vv%0AdHJ1c3QuY29tL3Jlc291cmNlcy9yZXBvc2l0b3J5MA0GCSqGSIb3DQEBB QUA A4GB%0AAHbhEm5OSxYShjAGsoEIz%2FAIx8dxfmbuwu3UOx%2F%2F8PDITtZDOLC5MH0Y0FW Dom rL%0ANhGc6Ehmo21%2FuBPUR%2F6LWlxz%2FK7ZGzIZOKuXNBSqltLroxwUCEm2u%2BWR74M 26x 1W%0Ab8ravHNjkOR%2Fez4iyz0H7V84dJzjA1BOoa%2BY7mHyhD8S%0A-END%20CERTI FIC ATE- As for the global parameter, you can set it to something like a few seconds and reset to original value when the URLs have been expired. Thanks Amogh On 9/27/14 10:53 AM, Indra Pramana in...@sg.or.id wrote: Hi Wido, I have changed the value of secstorage.ssl.cert.domain and restart management server, before I start uploading all the certificates. I found this article, which might be related to the problem: https://cwiki.apache.org/confluence/display/CLOUDSTACK/Troubleshooting+ -+u ploading+custom+domain+certificate+instead+of+using+realhostip.com *Specific Issues seen* 1. Download urls point to the old domain. 1. Reduce the expiration duration of the urls by changing global config extract.url.expiration.interval 2. And change the frequency for cleanup thread through extract.url.cleanup.interval restart MS. 3. Wait for the cleanup thread duration and try downloading again. See whether the url is deleted. 4. DB tables to check (don¹t recommend but worst case) Version 4.2 upload table persists url. Entry is hard deleted on expiration of url. Version = 4.2 template_store_ref, download_url is made null on expiration of url. volume_store_ref, entry hard deleted on expiration of url. But I'm not too
Re: Unable to upload SSL certificate for realhostip replacement
Hi Amogh, I’ve a different issue, CPVM is opening the console but the HTTP service is returning old *.realhostip.com certificate. I debugged CPVM agent to find that it’s not picking up the keystore sent from Management server. This issue is like: https://issues.apache.org/jira/browse/CLOUDSTACK-3438 In the logs (from CPVM), I’m only seeing Initializing SSL from built-in default certificate”. Reading source from ConsoleProxySecureServerFactoryImpl, this means the agent is starting but is not getting any StartConsoleProxyAgentHttpHandlerCommand with new KeyStore data. I’ve tested this only for 4.2, Paul suggests something similar for 4.3 as well. I’ve one root certificate (id=1), two intermediate certificate (id=2, id=3) and a wildcard domain cert+key. I uploaded them one by one as per the docs and also following Chip’s blog. By doing so, the SSVM keys got updated and by downloading an ISO I see the https url it gave returned correct SSL certificate which means the chain of certificates etc. worked. In case of CPVM, accessing console in browser led to SSL error. Do you may any suggestions on how to get this fixed? If I remove CPVMs, I see it’s still using old systemvm.iso and though docs/wiki recommend systemvm.iso will get patched, it does not actually. On 01-Oct-2014, at 6:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For 4.2 you may want to refer here : http://www.chipchilders.com/blog/2013/1/2/undocumented-feature-using-certif icate-chains-in-cloudstack.html 4.3 had a missing commit, due to which the global config consoleproxy.url.domain had to be set to mydomain.com, instead of *.mydomain.com. This has been fixed in 4.3.1 Apologies for the inconvenience. Amogh On 10/1/14 8:16 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Just to update on the certificate upload issue with 4.2: I’m able to download and add new volumes/templates/isos and the link provided has a valid https url with the same certificate that I uploaded though when I try to access the console I get SSL cert error and I see that it’s still returning the old *.realhostip.com certificate. I’ve tried to delete old CPVMs and I see the same issue coming up again. On 01-Oct-2014, at 4:55 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, I’ve fixed cloudmonkey to url encode parameters so now you can use cloudmonkey to upload custom certificate but only in non-interactive mode on shell (bash/zsh). You’ll have to install cloudmonkey from source for now since the fix is only on master. Something like: $ cloudmonkey upload customcertificate id=xx domainsuffix=yy name=zzz certificate=‘asdf asdfasdf asdfasdf asdf---' I’ve some issues to report while replacing certificates to get rid of realhostip, this is specific for Xen could apply for other hypervisors as well: - In case of 4.2, I see in the database that seq is 0 for the root certificate for the realhostip.com domain. I uploaded certificates in order (root, then intermediate and finally SSL cert from UI), and I see the old certificate is still there. after CPVM/SSVM restarts and are in UP state I still get SSL errors and I see that systemvm.iso is not getting patched. How to fix this? Or force systemvm.iso patching? - In case of 4.3.0 and above, I see the same issue. I’m confused whether to use *. wildcard in global setting or not. On 27-Sep-2014, at 9:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For the encoding, in your case it was the space character causing the issue - it should be replaced by %20. The correct encoding would be (hoping mail clients don't screw up the blob): -BEGIN%20CERTIFICATE-%0AMIIDfTCCAuagAwIBAgIDErvmMA0GCSqGSIb3DQEB BQU AME4xCzAJBgNVBAYTAlVT%0AMRAwDgYDVQQKEwdFcXVpZmF4MS0wKwYDVQQLEyRFcXVpZmF4 IFN lY3VyZSBDZXJ0%0AaWZpY2F0ZSBBdXRob3JpdHkwHhcNMDIwNTIxMDQwMDAwWhcNMTgwODIx MDQ wMDAw%0AWjBCMQswCQYDVQQGEwJVUzEWMBQGA1UEChMNR2VvVHJ1c3QgSW5jLjEbMBkGA1UE %0A AxMSR2VvVHJ1c3QgR2xvYmFsIENBMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB%0ACgKCA QEA 2swYYzD99BcjGlZ%2BW988bDjkcbd4kdS8odhM%2BKhDtgPpTSEHCIjaWC9m%0AOSm9BXiLn Tjo BbdqfnGk5sRgprDvgOSJKA%2BeJdbtg%2FOtppHHmMlCGDUUna2YRpIu%0AT8rxh0PBFpVXL VDv iS2Aelet8u5fa9IAjbkU%2BBQVNdnARqN7csiRv8lVK83Qlz6c%0AJmTM386DGXHKTubU1Xu pGc 1V3sjs0l44U%2BVcT4wt%2FlAjNvxm5suOpDkZALeVAjmR%0ACw7%2BOC7RHQWa9k0%2Bbw8 HHa 8sHo9gOeL6NlMTOdReJivbPagUvTLrGAMoUgRx5asz%0APeE4uwc2hGKceeoWMPRfwCvocWv k%2 BQIDAQABo4HwMIHtMB8GA1UdIwQYMBaAFEjm%0AaPkr0rKV10fYIyAQTzOYkJ%2FUMB0GA1U dDg QWBBTAephojYn7qwVkDBF9qn1luMrM%0ATjAPBgNVHRMBAf8EBTADAQH%2FMA4GA1UdDwEB% 2Fw QEAwIBBjA6BgNVHR8EMzAxMC%2Bg%0ALaArhilodHRwOi8vY3JsLmdlb3RydXN0LmNvbS9jc mxz L3NlY3VyZWNhLmNybDBO%0ABgNVHSAERzBFMEMGBFUdIAAwOzA5BggrBgEFBQcCARYtaHR0c HM6 Ly93d3cuZ2Vv%0AdHJ1c3QuY29tL3Jlc291cmNlcy9yZXBvc2l0b3J5MA0GCSqGSIb3DQEBB QUA A4GB%0AAHbhEm5OSxYShjAGsoEIz%2FAIx8dxfmbuwu3UOx%2F%2F8PDITtZDOLC5MH0Y0FW Dom
Re: [ANNOUNCE] New PMC Member: Ian Duffy
Congratulations, Ian. -min On 9/30/14 10:42 PM, Prasanna Santhanam t...@apache.org wrote: Congratulations Ian! On Tue, Sep 30, 2014 at 7:20 PM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC
Re: [ANNOUNCE] New PMC Member: Pierre-Luc Dion
Congrats, Pierre-Luc! -min On 9/30/14 10:43 PM, Prasanna Santhanam t...@apache.org wrote: Congratulations Pierre-Luc! On Tue, Sep 30, 2014 at 7:20 PM, Chip Childers chipchild...@apache.org wrote: The Project Management Committee (PMC) for Apache CloudStack has asked Pierre-Luc Dion to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Pierre-Luc! -chip On behalf of the Apache CloudStack PMC
Re: Unable to upload SSL certificate for realhostip replacement
Hi, Can you please paste the contents of the keystore table (minus the private key of course)? For SSVM, in 4.2, the certificate chain was not configured correctly and it would only use the server certificate when configuring Apache. It did not impact functionality though. This is not true for CPVM, which would try to use the full chain. It was fixed in 4.3, along with removing a double decoding of certificate when uploaded through API. The double decoding issue would manifest as non-server certificates to be saved incorrectly in the DB, and hence wanted to take a look at the table's contents. Since CPVM uses the full chain but not SSVM, I suspect this might be your issue. For the systemvm.iso - did you rebuild the ISO from source? It gets patched automatically in 4.3 for XS, but 4.2 had a versioning issue due to which it didn't change automatically. For KVM, the ISO gets patched when you reinstall the agent package. For Vmware, one needs to remove the old ISO from secondary storage folder (under path_to_secstorage/systemvm/ I think) so that the new one gets applied. HTH Amogh On 10/1/14 9:51 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Amogh, I’ve a different issue, CPVM is opening the console but the HTTP service is returning old *.realhostip.com certificate. I debugged CPVM agent to find that it’s not picking up the keystore sent from Management server. This issue is like: https://issues.apache.org/jira/browse/CLOUDSTACK-3438 In the logs (from CPVM), I’m only seeing Initializing SSL from built-in default certificate”. Reading source from ConsoleProxySecureServerFactoryImpl, this means the agent is starting but is not getting any StartConsoleProxyAgentHttpHandlerCommand with new KeyStore data. I’ve tested this only for 4.2, Paul suggests something similar for 4.3 as well. I’ve one root certificate (id=1), two intermediate certificate (id=2, id=3) and a wildcard domain cert+key. I uploaded them one by one as per the docs and also following Chip’s blog. By doing so, the SSVM keys got updated and by downloading an ISO I see the https url it gave returned correct SSL certificate which means the chain of certificates etc. worked. In case of CPVM, accessing console in browser led to SSL error. Do you may any suggestions on how to get this fixed? If I remove CPVMs, I see it’s still using old systemvm.iso and though docs/wiki recommend systemvm.iso will get patched, it does not actually. On 01-Oct-2014, at 6:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For 4.2 you may want to refer here : http://www.chipchilders.com/blog/2013/1/2/undocumented-feature-using-cert if icate-chains-in-cloudstack.html 4.3 had a missing commit, due to which the global config consoleproxy.url.domain had to be set to mydomain.com, instead of *.mydomain.com. This has been fixed in 4.3.1 Apologies for the inconvenience. Amogh On 10/1/14 8:16 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Just to update on the certificate upload issue with 4.2: I’m able to download and add new volumes/templates/isos and the link provided has a valid https url with the same certificate that I uploaded though when I try to access the console I get SSL cert error and I see that it’s still returning the old *.realhostip.com certificate. I’ve tried to delete old CPVMs and I see the same issue coming up again. On 01-Oct-2014, at 4:55 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, I’ve fixed cloudmonkey to url encode parameters so now you can use cloudmonkey to upload custom certificate but only in non-interactive mode on shell (bash/zsh). You’ll have to install cloudmonkey from source for now since the fix is only on master. Something like: $ cloudmonkey upload customcertificate id=xx domainsuffix=yy name=zzz certificate=‘asdf asdfasdf asdfasdf asdf---' I’ve some issues to report while replacing certificates to get rid of realhostip, this is specific for Xen could apply for other hypervisors as well: - In case of 4.2, I see in the database that seq is 0 for the root certificate for the realhostip.com domain. I uploaded certificates in order (root, then intermediate and finally SSL cert from UI), and I see the old certificate is still there. after CPVM/SSVM restarts and are in UP state I still get SSL errors and I see that systemvm.iso is not getting patched. How to fix this? Or force systemvm.iso patching? - In case of 4.3.0 and above, I see the same issue. I’m confused whether to use *. wildcard in global setting or not. On 27-Sep-2014, at 9:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For the encoding, in your case it was the space character causing the issue - it should be replaced by %20. The correct encoding would be (hoping mail clients don't screw up the blob): -BEGIN%20CERTIFICATE-%0AMIIDfTCCAuagAwIBAgIDErvmMA0GCSqGSIb3DQ EB BQU AME4xCzAJBgNVBAYTAlVT%0AMRAwDgYDVQQKEwdFcXVpZmF4MS0wKwYDVQQLEyRFcXVpZm F4 IFN
Re: [ANNOUNCE] New PMC Member: Ian Duffy
Congrats, Ian, good job! :) Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Chip Childers chipchild...@apache.org To: dev@cloudstack.apache.org Sent: Tuesday, 30 September, 2014 14:50:42 Subject: [ANNOUNCE] New PMC Member: Ian Duffy The Project Management Committee (PMC) for Apache CloudStack has asked Ian Duffy to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Ian! -chip On behalf of the Apache CloudStack PMC
Re: [ANNOUNCE] New PMC Member: Pierre-Luc Dion
Congrats, Pierre-Luc! :) -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Chip Childers chipchild...@apache.org To: dev@cloudstack.apache.org Sent: Tuesday, 30 September, 2014 14:50:40 Subject: [ANNOUNCE] New PMC Member: Pierre-Luc Dion The Project Management Committee (PMC) for Apache CloudStack has asked Pierre-Luc Dion to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Pierre-Luc! -chip On behalf of the Apache CloudStack PMC
RE: Shellshock
Interestingly this video shows attack against a perl script... https://www.youtube.com/watch?v=ArEOVHQu9nk -Original Message- From: Demetrius Tsitrelis [mailto:demetrius.tsitre...@citrix.com] Sent: Monday, September 29, 2014 6:13 PM To: dev@cloudstack.apache.org Subject: RE: Shellshock http://systemvm-public-ip/cgi-bin/ipcalc is a perl script. -Original Message- From: Sheng Yang [mailto:sh...@yasker.org] Sent: Monday, September 29, 2014 5:21 PM To: dev@cloudstack.apache.org Subject: Re: Shellshock http://systemvm-public-ip/cgi-bin/ipcalc is NOT a bash script, so it's normal that it cannot be exploited. --Sheng On Fri, Sep 26, 2014 at 1:57 PM, Demetrius Tsitrelis demetrius.tsitre...@citrix.com wrote: Do you mean you tried setting the USER_AGENT like in https://community.qualys.com/blogs/securitylabs/2014/09/25/qualysguard -remote-detection-for-bash-shellshock ? -Original Message- From: Ian Duffy [mailto:i...@ianduffy.ie] Sent: Friday, September 26, 2014 6:56 AM To: CloudStack Dev Subject: Re: Shellshock Tried this against the latest system vms built on Jenkins. Didn't get a successful exploited response. Tested against http://systemvm - public-ip/cgi-bin/ipcalc On 25 Sep 2014 16:56, Abhinandan Prateek agneya2...@gmail.com wrote: After heart bleed we are Shell shocked http://www.bbc.com/news/technology-29361794 ! It may not affect cloudstack directly as it is a vulnerability that affects bash, and allows the attacker to take control of the system running bash shell. -abhi
Re: [ANNOUNCE] New PMC Member: Pierre-Luc Dion
Thanks guys! PL On Wed, Oct 1, 2014 at 1:36 PM, Nux! n...@li.nux.ro wrote: Congrats, Pierre-Luc! :) -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - From: Chip Childers chipchild...@apache.org To: dev@cloudstack.apache.org Sent: Tuesday, 30 September, 2014 14:50:40 Subject: [ANNOUNCE] New PMC Member: Pierre-Luc Dion The Project Management Committee (PMC) for Apache CloudStack has asked Pierre-Luc Dion to join the PMC and we are pleased to announce that he has accepted. Join me in congratulating Pierre-Luc! -chip On behalf of the Apache CloudStack PMC
RE: Shellshock
Actually, I am not sure. Only the env.cgi script is loaded and, while the other scripts are in perl, there is nothing in the video which shows the source for the env.cgi script so it may not be perl. -Original Message- From: Demetrius Tsitrelis [mailto:demetrius.tsitre...@citrix.com] Sent: Wednesday, October 01, 2014 10:52 AM To: dev@cloudstack.apache.org Subject: RE: Shellshock Interestingly this video shows attack against a perl script... https://www.youtube.com/watch?v=ArEOVHQu9nk -Original Message- From: Demetrius Tsitrelis [mailto:demetrius.tsitre...@citrix.com] Sent: Monday, September 29, 2014 6:13 PM To: dev@cloudstack.apache.org Subject: RE: Shellshock http://systemvm-public-ip/cgi-bin/ipcalc is a perl script. -Original Message- From: Sheng Yang [mailto:sh...@yasker.org] Sent: Monday, September 29, 2014 5:21 PM To: dev@cloudstack.apache.org Subject: Re: Shellshock http://systemvm-public-ip/cgi-bin/ipcalc is NOT a bash script, so it's normal that it cannot be exploited. --Sheng On Fri, Sep 26, 2014 at 1:57 PM, Demetrius Tsitrelis demetrius.tsitre...@citrix.com wrote: Do you mean you tried setting the USER_AGENT like in https://community.qualys.com/blogs/securitylabs/2014/09/25/qualysguard -remote-detection-for-bash-shellshock ? -Original Message- From: Ian Duffy [mailto:i...@ianduffy.ie] Sent: Friday, September 26, 2014 6:56 AM To: CloudStack Dev Subject: Re: Shellshock Tried this against the latest system vms built on Jenkins. Didn't get a successful exploited response. Tested against http://systemvm - public-ip/cgi-bin/ipcalc On 25 Sep 2014 16:56, Abhinandan Prateek agneya2...@gmail.com wrote: After heart bleed we are Shell shocked http://www.bbc.com/news/technology-29361794 ! It may not affect cloudstack directly as it is a vulnerability that affects bash, and allows the attacker to take control of the system running bash shell. -abhi
Re: Unable to upload SSL certificate for realhostip replacement
Hi Amogh, Thanks for replying. Here the contents from the keystore table (minus sensitive information): id, name, domain_suffix, seq 1 | CPVMCertificate | custom.domain.com | null 2 | root | realhostip.com | 0 4 | newroot | custom.domain.com | 1 5 | inter1 | custom.domain.com | 2 6 | inter2 | custom.domain.com | 3 The Apache CloudStack version is 4.2.1, the systemvm.iso was built by jenkins.buildacloud.org and it was installed by the built rpms. In my case, the hosts were all XenServer 6.2. I checked the CPVM logs, and I see that it’s not getting keystore bytes[] from Management server at all, so falling back to the default realhostip.keystore file when the AgentShell starts and bootstraps ConsoleProxy. The only issue is when console proxy for a VM is viewed, I’m getting SSL cert error so instead of *.custom.domain.com I get the *.realhostip.com SSL cert. Please suggest how may I debug it further or fix it? On 01-Oct-2014, at 7:15 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, Can you please paste the contents of the keystore table (minus the private key of course)? For SSVM, in 4.2, the certificate chain was not configured correctly and it would only use the server certificate when configuring Apache. It did not impact functionality though. This is not true for CPVM, which would try to use the full chain. It was fixed in 4.3, along with removing a double decoding of certificate when uploaded through API. The double decoding issue would manifest as non-server certificates to be saved incorrectly in the DB, and hence wanted to take a look at the table's contents. Since CPVM uses the full chain but not SSVM, I suspect this might be your issue. For the systemvm.iso - did you rebuild the ISO from source? It gets patched automatically in 4.3 for XS, but 4.2 had a versioning issue due to which it didn't change automatically. For KVM, the ISO gets patched when you reinstall the agent package. For Vmware, one needs to remove the old ISO from secondary storage folder (under path_to_secstorage/systemvm/ I think) so that the new one gets applied. HTH Amogh On 10/1/14 9:51 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Amogh, I’ve a different issue, CPVM is opening the console but the HTTP service is returning old *.realhostip.com certificate. I debugged CPVM agent to find that it’s not picking up the keystore sent from Management server. This issue is like: https://issues.apache.org/jira/browse/CLOUDSTACK-3438 In the logs (from CPVM), I’m only seeing Initializing SSL from built-in default certificate”. Reading source from ConsoleProxySecureServerFactoryImpl, this means the agent is starting but is not getting any StartConsoleProxyAgentHttpHandlerCommand with new KeyStore data. I’ve tested this only for 4.2, Paul suggests something similar for 4.3 as well. I’ve one root certificate (id=1), two intermediate certificate (id=2, id=3) and a wildcard domain cert+key. I uploaded them one by one as per the docs and also following Chip’s blog. By doing so, the SSVM keys got updated and by downloading an ISO I see the https url it gave returned correct SSL certificate which means the chain of certificates etc. worked. In case of CPVM, accessing console in browser led to SSL error. Do you may any suggestions on how to get this fixed? If I remove CPVMs, I see it’s still using old systemvm.iso and though docs/wiki recommend systemvm.iso will get patched, it does not actually. On 01-Oct-2014, at 6:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For 4.2 you may want to refer here : http://www.chipchilders.com/blog/2013/1/2/undocumented-feature-using-cert if icate-chains-in-cloudstack.html 4.3 had a missing commit, due to which the global config consoleproxy.url.domain had to be set to mydomain.com, instead of *.mydomain.com. This has been fixed in 4.3.1 Apologies for the inconvenience. Amogh On 10/1/14 8:16 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Just to update on the certificate upload issue with 4.2: I’m able to download and add new volumes/templates/isos and the link provided has a valid https url with the same certificate that I uploaded though when I try to access the console I get SSL cert error and I see that it’s still returning the old *.realhostip.com certificate. I’ve tried to delete old CPVMs and I see the same issue coming up again. On 01-Oct-2014, at 4:55 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, I’ve fixed cloudmonkey to url encode parameters so now you can use cloudmonkey to upload custom certificate but only in non-interactive mode on shell (bash/zsh). You’ll have to install cloudmonkey from source for now since the fix is only on master. Something like: $ cloudmonkey upload customcertificate id=xx domainsuffix=yy name=zzz certificate=‘asdf asdfasdf asdfasdf asdf---' I’ve some issues to report while replacing certificates to get rid of realhostip, this is
Re: Unable to upload SSL certificate for realhostip replacement
Hi Amogh, Thanks for pointing in the direction of checking the keystore table. I found a certificate entry the content of which was in bad PEM format (newline errors, url encode error I think), the other certs were uploaded using a patched CloudMonkey (fix went today into master) which would url encoded args before sending them to CloudStack. On 01-Oct-2014, at 8:56 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Amogh, Thanks for replying. Here the contents from the keystore table (minus sensitive information): id, name, domain_suffix, seq 1 | CPVMCertificate | custom.domain.com | null 2 | root | realhostip.com | 0 4 | newroot | custom.domain.com | 1 5 | inter1 | custom.domain.com | 2 6 | inter2 | custom.domain.com | 3 The Apache CloudStack version is 4.2.1, the systemvm.iso was built by jenkins.buildacloud.org and it was installed by the built rpms. In my case, the hosts were all XenServer 6.2. I checked the CPVM logs, and I see that it’s not getting keystore bytes[] from Management server at all, so falling back to the default realhostip.keystore file when the AgentShell starts and bootstraps ConsoleProxy. The only issue is when console proxy for a VM is viewed, I’m getting SSL cert error so instead of *.custom.domain.com I get the *.realhostip.com SSL cert. Please suggest how may I debug it further or fix it? On 01-Oct-2014, at 7:15 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, Can you please paste the contents of the keystore table (minus the private key of course)? For SSVM, in 4.2, the certificate chain was not configured correctly and it would only use the server certificate when configuring Apache. It did not impact functionality though. This is not true for CPVM, which would try to use the full chain. It was fixed in 4.3, along with removing a double decoding of certificate when uploaded through API. The double decoding issue would manifest as non-server certificates to be saved incorrectly in the DB, and hence wanted to take a look at the table's contents. Since CPVM uses the full chain but not SSVM, I suspect this might be your issue. For the systemvm.iso - did you rebuild the ISO from source? It gets patched automatically in 4.3 for XS, but 4.2 had a versioning issue due to which it didn't change automatically. For KVM, the ISO gets patched when you reinstall the agent package. For Vmware, one needs to remove the old ISO from secondary storage folder (under path_to_secstorage/systemvm/ I think) so that the new one gets applied. HTH Amogh On 10/1/14 9:51 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Amogh, I’ve a different issue, CPVM is opening the console but the HTTP service is returning old *.realhostip.com certificate. I debugged CPVM agent to find that it’s not picking up the keystore sent from Management server. This issue is like: https://issues.apache.org/jira/browse/CLOUDSTACK-3438 In the logs (from CPVM), I’m only seeing Initializing SSL from built-in default certificate”. Reading source from ConsoleProxySecureServerFactoryImpl, this means the agent is starting but is not getting any StartConsoleProxyAgentHttpHandlerCommand with new KeyStore data. I’ve tested this only for 4.2, Paul suggests something similar for 4.3 as well. I’ve one root certificate (id=1), two intermediate certificate (id=2, id=3) and a wildcard domain cert+key. I uploaded them one by one as per the docs and also following Chip’s blog. By doing so, the SSVM keys got updated and by downloading an ISO I see the https url it gave returned correct SSL certificate which means the chain of certificates etc. worked. In case of CPVM, accessing console in browser led to SSL error. Do you may any suggestions on how to get this fixed? If I remove CPVMs, I see it’s still using old systemvm.iso and though docs/wiki recommend systemvm.iso will get patched, it does not actually. On 01-Oct-2014, at 6:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For 4.2 you may want to refer here : http://www.chipchilders.com/blog/2013/1/2/undocumented-feature-using-cert if icate-chains-in-cloudstack.html 4.3 had a missing commit, due to which the global config consoleproxy.url.domain had to be set to mydomain.com, instead of *.mydomain.com. This has been fixed in 4.3.1 Apologies for the inconvenience. Amogh On 10/1/14 8:16 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Just to update on the certificate upload issue with 4.2: I’m able to download and add new volumes/templates/isos and the link provided has a valid https url with the same certificate that I uploaded though when I try to access the console I get SSL cert error and I see that it’s still returning the old *.realhostip.com certificate. I’ve tried to delete old CPVMs and I see the same issue coming up again. On 01-Oct-2014, at 4:55 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi, I’ve fixed cloudmonkey to url encode
Re: Review Request 26220: CLOUDSTACK-7645: [UI] Fixing incorrect labels, including instances of ???label.*???
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26220/#review55120 --- client/WEB-INF/classes/resources/messages.properties https://reviews.apache.org/r/26220/#comment95491 Titlecase? Detached? ui/dictionary.jsp https://reviews.apache.org/r/26220/#comment95492 Why remove this? Thanks for the patch, I'm one of the folks who don't really understand UI much but do like to keep interest and really appreciated fixing these strings that have been bugging us for past few weeks now :) - Rohit Yadav On Oct. 1, 2014, 8:08 a.m., Mihaela Stoica wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26220/ --- (Updated Oct. 1, 2014, 8:08 a.m.) Review request for cloudstack, Brian Federle and Jessica Wang. Bugs: CLOUDSTACK-7596, CLOUDSTACK-7597, CLOUDSTACK-7606, CLOUDSTACK-7607, CLOUDSTACK-7608, and CLOUDSTACK-7645 https://issues.apache.org/jira/browse/CLOUDSTACK-7596 https://issues.apache.org/jira/browse/CLOUDSTACK-7597 https://issues.apache.org/jira/browse/CLOUDSTACK-7606 https://issues.apache.org/jira/browse/CLOUDSTACK-7607 https://issues.apache.org/jira/browse/CLOUDSTACK-7608 https://issues.apache.org/jira/browse/CLOUDSTACK-7645 Repository: cloudstack-git Description --- - removed duplicate entries in dictionary - added dictionary entries that have been missed during the dictionary split - added missing entries in messages.properties - fixed other localization issues Diffs - client/WEB-INF/classes/resources/messages.properties c9eb7ae ui/dictionary.jsp c03ad67 ui/dictionary2.jsp 39299b3 ui/scripts/configuration.js b6c94f8 ui/scripts/storage.js 783633c ui/scripts/templates.js 9665ffd ui/scripts/ui-custom/physicalResources.js 7dd5380 Diff: https://reviews.apache.org/r/26220/diff/ Testing --- I've checked all the issues that have been reported, and they are all fixed. Thanks, Mihaela Stoica
Re: Review Request 26225: CLOUDSTACK-7664: [UI] Handle change in API response for listloadbalancer
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26225/#review55121 --- Ship it! Ship It! - Rohit Yadav On Oct. 1, 2014, 12:55 p.m., Mihaela Stoica wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26225/ --- (Updated Oct. 1, 2014, 12:55 p.m.) Review request for cloudstack. Bugs: CLOUDSTACK-7664 https://issues.apache.org/jira/browse/CLOUDSTACK-7664 Repository: cloudstack-git Description --- - replaced all occurrences of listloadbalancerssresponse with listloadbalancersresponse in ui\scripts\vpc.js, following the change in the listLoadBalancers API response string. Diffs - ui/scripts/vpc.js 3e57631 Diff: https://reviews.apache.org/r/26225/diff/ Testing --- Thanks, Mihaela Stoica
Build failed in Jenkins: build-master #1739
See http://jenkins.buildacloud.org/job/build-master/1739/changes Changes: [Rohit Yadav] CLOUDSTACK-7664: [UI] Handle change in API response for listloadbalancer -- [...truncated 5970 lines...] [INFO] Tests are skipped. [INFO] [INFO] [INFO] Building Apache CloudStack Plugin - Storage Image default provider 4.5.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ cloud-plugin-storage-image-default --- [INFO] Deleting http://jenkins.buildacloud.org/job/build-master/ws/plugins/storage/image/default/target (includes = [**/*], excludes = []) [INFO] Deleting http://jenkins.buildacloud.org/job/build-master/ws/plugins/storage/image/default (includes = [target, dist], excludes = []) [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-plugin-storage-image-default --- [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-plugin-hypervisor-xenserver --- [INFO] Surefire report directory: http://jenkins.buildacloud.org/job/build-master/ws/plugins/hypervisors/xenserver/target/surefire-reports --- T E S T S --- [INFO] Starting audit... Audit done. [INFO] [INFO] --- maven-remote-resources-plugin:1.3:process (default) @ cloud-plugin-storage-image-default --- [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ cloud-plugin-storage-image-default --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ cloud-plugin-storage-image-default --- [INFO] Compiling 3 source files to http://jenkins.buildacloud.org/job/build-master/ws/plugins/storage/image/default/target/classes [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-plugin-network-midonet --- [INFO] Surefire report directory: http://jenkins.buildacloud.org/job/build-master/ws/plugins/network-elements/midonet/target/surefire-reports --- T E S T S --- Running com.cloud.hypervisor.xenserver.resource.CitrixResourceBaseTest Running com.cloud.network.element.MidoNetElementTest [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ cloud-plugin-storage-image-swift --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory http://jenkins.buildacloud.org/job/build-master/ws/plugins/storage/image/swift/test/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ cloud-plugin-storage-image-swift --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-plugin-storage-image-swift --- [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ cloud-plugin-storage-image-s3 --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory http://jenkins.buildacloud.org/job/build-master/ws/plugins/storage/image/s3/test/resources [INFO] Copying 3 resources [INFO] Tests are skipped. [INFO] [INFO] [INFO] Building Apache CloudStack Plugin - Storage Image sample provider 4.5.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ cloud-plugin-storage-image-s3 --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ cloud-plugin-storage-image-s3 --- [INFO] Surefire report directory: http://jenkins.buildacloud.org/job/build-master/ws/plugins/storage/image/s3/target/surefire-reports --- T E S T S --- [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ cloud-plugin-storage-image-sample --- [INFO] Deleting http://jenkins.buildacloud.org/job/build-master/ws/plugins/storage/image/sample/target (includes = [**/*], excludes = []) [INFO] Deleting http://jenkins.buildacloud.org/job/build-master/ws/plugins/storage/image/sample (includes = [target, dist], excludes = []) [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-plugin-storage-image-sample ---
Re: Unable to upload SSL certificate for realhostip replacement
Just an FYI - For troubleshooting in this area do refer to https://cwiki.apache.org/confluence/display/CLOUDSTACK/Troubleshooting+-+up loading+custom+domain+certificate+instead+of+using+realhostip.com Thanks, -Nitin On 01/10/14 12:17 PM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Amogh, Thanks for pointing in the direction of checking the keystore table. I found a certificate entry the content of which was in bad PEM format (newline errors, url encode error I think), the other certs were uploaded using a patched CloudMonkey (fix went today into master) which would url encoded args before sending them to CloudStack. On 01-Oct-2014, at 8:56 pm, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Amogh, Thanks for replying. Here the contents from the keystore table (minus sensitive information): id, name, domain_suffix, seq 1 | CPVMCertificate | custom.domain.com | null 2 | root | realhostip.com | 0 4 | newroot | custom.domain.com | 1 5 | inter1 | custom.domain.com | 2 6 | inter2 | custom.domain.com | 3 The Apache CloudStack version is 4.2.1, the systemvm.iso was built by jenkins.buildacloud.org and it was installed by the built rpms. In my case, the hosts were all XenServer 6.2. I checked the CPVM logs, and I see that it’s not getting keystore bytes[] from Management server at all, so falling back to the default realhostip.keystore file when the AgentShell starts and bootstraps ConsoleProxy. The only issue is when console proxy for a VM is viewed, I’m getting SSL cert error so instead of *.custom.domain.com I get the *.realhostip.com SSL cert. Please suggest how may I debug it further or fix it? On 01-Oct-2014, at 7:15 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, Can you please paste the contents of the keystore table (minus the private key of course)? For SSVM, in 4.2, the certificate chain was not configured correctly and it would only use the server certificate when configuring Apache. It did not impact functionality though. This is not true for CPVM, which would try to use the full chain. It was fixed in 4.3, along with removing a double decoding of certificate when uploaded through API. The double decoding issue would manifest as non-server certificates to be saved incorrectly in the DB, and hence wanted to take a look at the table's contents. Since CPVM uses the full chain but not SSVM, I suspect this might be your issue. For the systemvm.iso - did you rebuild the ISO from source? It gets patched automatically in 4.3 for XS, but 4.2 had a versioning issue due to which it didn't change automatically. For KVM, the ISO gets patched when you reinstall the agent package. For Vmware, one needs to remove the old ISO from secondary storage folder (under path_to_secstorage/systemvm/ I think) so that the new one gets applied. HTH Amogh On 10/1/14 9:51 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Hi Amogh, I’ve a different issue, CPVM is opening the console but the HTTP service is returning old *.realhostip.com certificate. I debugged CPVM agent to find that it’s not picking up the keystore sent from Management server. This issue is like: https://issues.apache.org/jira/browse/CLOUDSTACK-3438 In the logs (from CPVM), I’m only seeing Initializing SSL from built-in default certificate”. Reading source from ConsoleProxySecureServerFactoryImpl, this means the agent is starting but is not getting any StartConsoleProxyAgentHttpHandlerCommand with new KeyStore data. I’ve tested this only for 4.2, Paul suggests something similar for 4.3 as well. I’ve one root certificate (id=1), two intermediate certificate (id=2, id=3) and a wildcard domain cert+key. I uploaded them one by one as per the docs and also following Chip’s blog. By doing so, the SSVM keys got updated and by downloading an ISO I see the https url it gave returned correct SSL certificate which means the chain of certificates etc. worked. In case of CPVM, accessing console in browser led to SSL error. Do you may any suggestions on how to get this fixed? If I remove CPVMs, I see it’s still using old systemvm.iso and though docs/wiki recommend systemvm.iso will get patched, it does not actually. On 01-Oct-2014, at 6:32 pm, Amogh Vasekar amogh.vase...@citrix.com wrote: Hi, For 4.2 you may want to refer here : http://www.chipchilders.com/blog/2013/1/2/undocumented-feature-using-c ert if icate-chains-in-cloudstack.html 4.3 had a missing commit, due to which the global config consoleproxy.url.domain had to be set to mydomain.com, instead of *.mydomain.com. This has been fixed in 4.3.1 Apologies for the inconvenience. Amogh On 10/1/14 8:16 AM, Rohit Yadav rohit.ya...@shapeblue.com wrote: Just to update on the certificate upload issue with 4.2: I’m able to download and add new volumes/templates/isos and the link provided has a valid https url with the same certificate that I uploaded though when I try to access the console I get SSL cert error and I see
Re: Unable to upload SSL certificate for realhostip replacement
Thanks Nitin, On 01-Oct-2014, at 10:06 pm, Nitin Mehta nitin.me...@citrix.com wrote: Just an FYI - For troubleshooting in this area do refer to https://cwiki.apache.org/confluence/display/CLOUDSTACK/Troubleshooting+-+up loading+custom+domain+certificate+instead+of+using+realhostip.com I actually read this wiki a couple of times before emailing. The issue was that I used the Chrome Advanced REST client extension as recommended in the docs/wiki and somehow it did not work for me, and it was difficult to use as well. So, I just fixed cloudmonkey to do url encoding of args and used it for all certificates except for one intermediate certificate which was the issue. Thanks. Regards, Rohit Yadav Software Architect, ShapeBlue M. +41 779015219 | rohit.ya...@shapeblue.com Blog: bhaisaab.org | Twitter: @_bhaisaab Find out more about ShapeBlue and our range of CloudStack related services IaaS Cloud Design Buildhttp://shapeblue.com/iaas-cloud-design-and-build// CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/ CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/ CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-infrastructure-support/ CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/ This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Build failed in Jenkins: simulator-singlerun #485
See http://jenkins.buildacloud.org/job/simulator-singlerun/485/changes Changes: [Rohit Yadav] CLOUDSTACK-7664: [UI] Handle change in API response for listloadbalancer -- [...truncated 8938 lines...] [INFO] Final Memory: 44M/192M [INFO] [WARNING] The requested profile simulator could not be activated because it does not exist. [simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator [INFO] Scanning for projects... [INFO] [INFO] [INFO] Building Apache CloudStack Developer Mode 4.5.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties (default) @ cloud-developer --- [WARNING] Ignoring missing properties file: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override [INFO] [INFO] --- maven-remote-resources-plugin:1.3:process (default) @ cloud-developer --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer --- log4j:WARN No appenders could be found for logger (org.springframework.core.env.StandardEnvironment). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. WARNING: Provided file does not exist: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override Initializing database=simulator with host=localhost port=3306 username=cloud password=cloud Running query: drop database if exists `simulator` Running query: create database `simulator` Running query: GRANT ALL ON simulator.* to 'cloud'@`localhost` identified by 'cloud' Running query: GRANT ALL ON simulator.* to 'cloud'@`%` identified by 'cloud' Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/create-schema-simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/templates.simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/hypervisor_capabilities.simulator.sql Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ cloud-developer --- [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ cloud-developer --- [INFO] Installing http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml to /var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 39.554s [INFO] Finished at: Wed Oct 01 15:58:32 EDT 2014 [INFO] Final Memory: 43M/171M [INFO] [simulator-singlerun] $ /bin/bash -x /tmp/hudson2342136899674022504.sh + jps -l + grep -q Launcher + echo '' + rm -rf /tmp/MarvinLogs + echo Check for initialization of the management server Check for initialization of the management server + COUNTER=0 + SERVER_PID=308 + '[' 0 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + mvn -P systemvm,simulator -pl :cloud-client-ui jetty:run + sleep 5 + COUNTER=1 + '[' 1 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=2 + '[' 2 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=3 + '[' 3 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=4 + '[' 4 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=5 + '[' 5 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=6 + '[' 6 -lt 44 ']' + grep
Re: Review Request 26220: CLOUDSTACK-7645: [UI] Fixing incorrect labels, including instances of ???label.*???
On Oct. 1, 2014, 8:28 p.m., Rohit Yadav wrote: ui/dictionary.jsp, line 967 https://reviews.apache.org/r/26220/diff/1/?file=710035#file710035line967 Why remove this? Duplicated on line 969 On Oct. 1, 2014, 8:28 p.m., Rohit Yadav wrote: client/WEB-INF/classes/resources/messages.properties, line 2039 https://reviews.apache.org/r/26220/diff/1/?file=710034#file710034line2039 Titlecase? Detached? This is what we originally had in storage.js (See commit e3b5b213faf7fd89dfae024e129e2e7e55db898d). However, it makes sense to change it to Detached. I will update the diff. - Mihaela --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26220/#review55120 --- On Oct. 1, 2014, 9:08 a.m., Mihaela Stoica wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26220/ --- (Updated Oct. 1, 2014, 9:08 a.m.) Review request for cloudstack, Brian Federle and Jessica Wang. Bugs: CLOUDSTACK-7596, CLOUDSTACK-7597, CLOUDSTACK-7606, CLOUDSTACK-7607, CLOUDSTACK-7608, and CLOUDSTACK-7645 https://issues.apache.org/jira/browse/CLOUDSTACK-7596 https://issues.apache.org/jira/browse/CLOUDSTACK-7597 https://issues.apache.org/jira/browse/CLOUDSTACK-7606 https://issues.apache.org/jira/browse/CLOUDSTACK-7607 https://issues.apache.org/jira/browse/CLOUDSTACK-7608 https://issues.apache.org/jira/browse/CLOUDSTACK-7645 Repository: cloudstack-git Description --- - removed duplicate entries in dictionary - added dictionary entries that have been missed during the dictionary split - added missing entries in messages.properties - fixed other localization issues Diffs - client/WEB-INF/classes/resources/messages.properties c9eb7ae ui/dictionary.jsp c03ad67 ui/dictionary2.jsp 39299b3 ui/scripts/configuration.js b6c94f8 ui/scripts/storage.js 783633c ui/scripts/templates.js 9665ffd ui/scripts/ui-custom/physicalResources.js 7dd5380 Diff: https://reviews.apache.org/r/26220/diff/ Testing --- I've checked all the issues that have been reported, and they are all fixed. Thanks, Mihaela Stoica
Re: Review Request 26220: CLOUDSTACK-7645: [UI] Fixing incorrect labels, including instances of ???label.*???
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26220/ --- (Updated Oct. 1, 2014, 10:25 p.m.) Review request for cloudstack, Brian Federle and Jessica Wang. Changes --- Changed detached to Detached Bugs: CLOUDSTACK-7596, CLOUDSTACK-7597, CLOUDSTACK-7606, CLOUDSTACK-7607, CLOUDSTACK-7608, and CLOUDSTACK-7645 https://issues.apache.org/jira/browse/CLOUDSTACK-7596 https://issues.apache.org/jira/browse/CLOUDSTACK-7597 https://issues.apache.org/jira/browse/CLOUDSTACK-7606 https://issues.apache.org/jira/browse/CLOUDSTACK-7607 https://issues.apache.org/jira/browse/CLOUDSTACK-7608 https://issues.apache.org/jira/browse/CLOUDSTACK-7645 Repository: cloudstack-git Description --- - removed duplicate entries in dictionary - added dictionary entries that have been missed during the dictionary split - added missing entries in messages.properties - fixed other localization issues Diffs (updated) - client/WEB-INF/classes/resources/messages.properties c9eb7ae ui/dictionary.jsp c03ad67 ui/dictionary2.jsp 39299b3 ui/scripts/configuration.js b6c94f8 ui/scripts/storage.js 783633c ui/scripts/templates.js 9665ffd ui/scripts/ui-custom/physicalResources.js 7dd5380 Diff: https://reviews.apache.org/r/26220/diff/ Testing --- I've checked all the issues that have been reported, and they are all fixed. Thanks, Mihaela Stoica
Re: Build failed in Jenkins: simulator-singlerun #485
Talluri/Hugo/Others with knowledge of Jenkins - Can you please look into this and check why we keep getting false alarms because of issues on Jenkins side ? Thanks, -Nitin On 01/10/14 1:15 PM, jenk...@cloudstack.org jenk...@cloudstack.org wrote: See http://jenkins.buildacloud.org/job/simulator-singlerun/485/changes Changes: [Rohit Yadav] CLOUDSTACK-7664: [UI] Handle change in API response for listloadbalancer -- [...truncated 8938 lines...] [INFO] Final Memory: 44M/192M [INFO] [WARNING] The requested profile simulator could not be activated because it does not exist. [simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator [INFO] Scanning for projects... [INFO] [INFO] [INFO] Building Apache CloudStack Developer Mode 4.5.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties (default) @ cloud-developer --- [WARNING] Ignoring missing properties file: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../ut ils/conf/db.properties.override [INFO] [INFO] --- maven-remote-resources-plugin:1.3:process (default) @ cloud-developer --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer --- log4j:WARN No appenders could be found for logger (org.springframework.core.env.StandardEnvironment). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. WARNING: Provided file does not exist: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../ut ils/conf/db.properties.override Initializing database=simulator with host=localhost port=3306 username=cloud password=cloud Running query: drop database if exists `simulator` Running query: create database `simulator` Running query: GRANT ALL ON simulator.* to 'cloud'@`localhost` identified by 'cloud' Running query: GRANT ALL ON simulator.* to 'cloud'@`%` identified by 'cloud' Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/targe t/db/create-schema-simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/targe t/db/templates.simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/targe t/db/hypervisor_capabilities.simulator.sql Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ cloud-developer --- [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ cloud-developer --- [INFO] Installing http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.x ml to /var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5. 0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 39.554s [INFO] Finished at: Wed Oct 01 15:58:32 EDT 2014 [INFO] Final Memory: 43M/171M [INFO] [simulator-singlerun] $ /bin/bash -x /tmp/hudson2342136899674022504.sh + jps -l + grep -q Launcher + echo '' + rm -rf /tmp/MarvinLogs + echo Check for initialization of the management server Check for initialization of the management server + COUNTER=0 + SERVER_PID=308 + '[' 0 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + mvn -P systemvm,simulator -pl :cloud-client-ui jetty:run + sleep 5 + COUNTER=1 + '[' 1 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=2 + '[' 2 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=3 + '[' 3 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=4 + '[' 4 -lt 44 ']' + grep -q 'Management server node
[MEETUP] CloudStack Silicon Valley User Group Meetup - October 9th, 2014
Hi all, If you’ll be in the Silicon Valley next week - then join us! The next CloudStack Silicon Valley Meetup has been scheduled for Thursday, October 9 th at CA Technologies. The CloudStack Silicon Valley User Group has kicked off the Beginner's Guide to Apache CloudStack Series starting with Part 1 - An Introduction to Apache CloudStack in September. Now, it’s time for Part 2 – CloudStack Networking. This session will be presented by Chiradeep Vittal, Distinguished Engineer at Citrix and Apache CloudStack PMC member. Date: Thursday, October 9th, 2014 Time: 6:00pm – 9:00pm Address: CA Technologies Inc., 3965 Freedom Circle, Santa Clara, CA Event link: http://www.meetup.com/CloudStack-Silicon-Valley-User-Group/events/210800362/ Help Promote: Click-to-tweet: http://ctt.ec/U1w9I - Learn the ins-and-outs of #CloudStack Networking w/ @chiradeep @CloudStack Silicon Valley Meetup on 10/9 clds.co/1oBux1f #opensource Thanks, Karen
Jenkins build is back to normal : build-master #1740
See http://jenkins.buildacloud.org/job/build-master/1740/changes
Build failed in Jenkins: simulator-singlerun #486
See http://jenkins.buildacloud.org/job/simulator-singlerun/486/changes Changes: [anthony.xu] added more log for create vm snapshot -- [...truncated 8942 lines...] [INFO] Scanning for projects... [INFO] [INFO] [INFO] Building Apache CloudStack Developer Mode 4.5.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties (default) @ cloud-developer --- [WARNING] Ignoring missing properties file: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override [INFO] [INFO] --- maven-remote-resources-plugin:1.3:process (default) @ cloud-developer --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer --- log4j:WARN No appenders could be found for logger (org.springframework.core.env.StandardEnvironment). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. WARNING: Provided file does not exist: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override Initializing database=simulator with host=localhost port=3306 username=cloud password=cloud Running query: drop database if exists `simulator` Running query: create database `simulator` Running query: GRANT ALL ON simulator.* to 'cloud'@`localhost` identified by 'cloud' Running query: GRANT ALL ON simulator.* to 'cloud'@`%` identified by 'cloud' Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/create-schema-simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/templates.simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/hypervisor_capabilities.simulator.sql Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ cloud-developer --- [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ cloud-developer --- [INFO] Installing http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml to /var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 31.388s [INFO] Finished at: Wed Oct 01 19:48:12 EDT 2014 [INFO] Final Memory: 42M/190M [INFO] [simulator-singlerun] $ /bin/bash -x /tmp/hudson1226411314090527542.sh + grep -q Launcher + jps -l + echo '' + rm -rf /tmp/MarvinLogs + echo Check for initialization of the management server Check for initialization of the management server + COUNTER=0 + SERVER_PID=7885 + '[' 0 -lt 44 ']' + mvn -P systemvm,simulator -pl :cloud-client-ui jetty:run + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=1 + '[' 1 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=2 + '[' 2 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=3 + '[' 3 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=4 + '[' 4 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=5 + '[' 5 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=6 + '[' 6 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=7 + '[' 7 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=8 + '[' 8 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=9 + '[' 9 -lt 44
Build failed in Jenkins: simulator-singlerun #487
See http://jenkins.buildacloud.org/job/simulator-singlerun/487/ -- [...truncated 8932 lines...] [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ cloud-developer --- [INFO] Installing http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml to /var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 2:00.849s [INFO] Finished at: Wed Oct 01 20:20:35 EDT 2014 [INFO] Final Memory: 42M/206M [INFO] [WARNING] The requested profile simulator could not be activated because it does not exist. [simulator-singlerun] $ mvn -P developer -pl developer -Ddeploydb-simulator [INFO] Scanning for projects... [INFO] [INFO] [INFO] Building Apache CloudStack Developer Mode 4.5.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties (default) @ cloud-developer --- [WARNING] Ignoring missing properties file: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override [INFO] [INFO] --- maven-remote-resources-plugin:1.3:process (default) @ cloud-developer --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (default) @ cloud-developer --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- maven-checkstyle-plugin:2.11:check (cloudstack-checkstyle) @ cloud-developer --- [INFO] Starting audit... Audit done. [INFO] [INFO] exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer [INFO] [INFO] --- exec-maven-plugin:1.2.1:java (create-schema-simulator) @ cloud-developer --- log4j:WARN No appenders could be found for logger (org.springframework.core.env.StandardEnvironment). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. WARNING: Provided file does not exist: http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/../utils/conf/db.properties.override Initializing database=simulator with host=localhost port=3306 username=cloud password=cloud Running query: drop database if exists `simulator` Running query: create database `simulator` Running query: GRANT ALL ON simulator.* to 'cloud'@`localhost` identified by 'cloud' Running query: GRANT ALL ON simulator.* to 'cloud'@`%` identified by 'cloud' Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/create-schema-simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/templates.simulator.sql Processing SQL file at http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/target/db/hypervisor_capabilities.simulator.sql Processing upgrade: com.cloud.upgrade.DatabaseUpgradeChecker [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ cloud-developer --- [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ cloud-developer --- [INFO] Installing http://jenkins.buildacloud.org/job/simulator-singlerun/ws/developer/pom.xml to /var/lib/jenkins/.m2/repository/org/apache/cloudstack/cloud-developer/4.5.0-SNAPSHOT/cloud-developer-4.5.0-SNAPSHOT.pom [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 21.569s [INFO] Finished at: Wed Oct 01 20:21:01 EDT 2014 [INFO] Final Memory: 44M/209M [INFO] [simulator-singlerun] $ /bin/bash -x /tmp/hudson6466251777204795605.sh + grep -q Launcher + jps -l + echo '' + rm -rf /tmp/MarvinLogs + echo Check for initialization of the management server Check for initialization of the management server + COUNTER=0 + SERVER_PID=14858 + '[' 0 -lt 44 ']' + mvn -P systemvm,simulator -pl :cloud-client-ui jetty:run + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 + COUNTER=1 + '[' 1 -lt 44 ']' + grep -q 'Management server node 127.0.0.1 is up' jetty-output.out + sleep 5 +
Re: test day reminder
Hi All, Using the following environment: - XenServer 6.2 - The RPM build that was created on October 1st 2015 4:51am http://jenkins.buildacloud.org/job/package-rhel63-master/3361/ - The system vm that was build on September 29th 2015 7:07am http://jenkins.buildacloud.org/job/build-systemvm64-master/425/ I brought up a basic zone using marvin to do all the configuration. If anybody wants re-create the exact same environment there is code over at https://github.com/imduffy15/cookbook_cloudstack_wrapper adjust chef_configuration.json as necessary to change the repo and systemvm and then do a vagrant up (if your on windows expect issues). Configuration was successful, my systemvms were successfully created: http://ianduffy.ie/cloudstack/testing45/version%2bsystemvms-up.png There was an issue with a table header on the system vms page: http://ianduffy.ie/cloudstack/testing45/strange-labeling-on-ui.png Another labelling issue was noted on the alerts section on the initial screen: http://ianduffy.ie/cloudstack/testing45/Screen%20Shot%202014-10-02%20at%2001.40.18.png The cluster configuration table under infrastructure had a white block as its header, on hovering text would appear: http://ianduffy.ie/cloudstack/testing45/cluster-table-renders-oddly.png The system vms complained about a file not being found: http://ianduffy.ie/cloudstack/testing45/system-vm-reports-script-not-found.png Rapidly clicking the search button resulted in duplicate entries: http://ianduffy.ie/cloudstack/testing45/clicking-the-search-button-multiple-times-results-in-duplicates.png Add instance UI had a random scroll bar for no reason: http://ianduffy.ie/cloudstack/testing45/add-instance-scroll-bar-for-no-reason.png I attempted to create an instance, it failed. I believe this is due to an issue with the version field populated for the virtual router logs available at https://gist.github.com/imduffy15/5879718ce38f8a67bebd After this error was created I got random prompt boxes on the UI: http://ianduffy.ie/cloudstack/testing45/Screen%20Shot%202014-10-02%20at%2001.40.18.png I stopped my testing at this stage. Thanks, Ian On 1 October 2014 17:26, Daan Hoogland daan.hoogl...@gmail.com wrote: I have been looking at using my collegues integration work for the master branch. So far the packaging part is holding my back as it uses 'SNAPSHOT' in the build and does not allow for patch levels (in package.sh) I am looking at a solution. what I am thinking of is making rpms like cloudstack-package-version-including-SNAPSHOT-version-buildnumber-from-jenkins.el6_64.rpm this seems quite verbose but it gives us space to do continuous integration on the artifact. I am sure a scheme like this can be deviced for .deb packages as well. thoughts? The actual testing, for as little far as I got to do, did not yield issues yet. Daan On Wed, Oct 1, 2014 at 5:28 PM, Marcus shadow...@gmail.com wrote: I'd be curious to know if it works by re-adding the host. I remember running into situations like this in the past, where the mgmt server was either not fully up or rejecting agents for some reason. On Wed, Oct 1, 2014 at 7:01 AM, Wido den Hollander w...@widodh.nl wrote: On 09/30/2014 09:26 AM, Daan Hoogland wrote: H all, As you might remember, we agreed on a test day for the master branch on Wednesday the 1st October, during our last meeting in Schihol-Rijk with some folks. Please feel invited to test master so that we can report to our RM for 4.5 for the current state and he can have a short and quick journey to releasing. I didn't forget! Just tested by upgrading from 4.4.1 (RC) to 4.5.0 and that worked, but my KVM agent couldn't connect anymore afterwards: 2014-10-01 14:59:08,789 INFO [utils.nio.NioClient] (Agent-Selector:null) Connecting to cloudstack.:8250 2014-10-01 14:59:08,809 ERROR [utils.nio.NioConnection] (Agent-Selector:null) Unable to initialize the threads. java.io.IOException: Connection closed with -1 on reading size. at com.cloud.utils.nio.Link.doHandshake(Link.java:509) at com.cloud.utils.nio.NioClient.init(NioClient.java:78) at com.cloud.utils.nio.NioConnection.run(NioConnection.java:111) at java.lang.Thread.run(Thread.java:744) Any ideas? When I try to telnet to 8250 the connection is closed immediately by the mgmt server. Nothing in the logs. So this is currently preventing me from testing the KVM agents. Wido optimistically yours, -- Daan
[GitHub] cloudstack pull request: VPC and Virtual Network Managers refactor...
Github user wilderrodrigues closed the pull request at: https://github.com/apache/cloudstack/pull/19 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---