Re: High CPU utilization on KVM hosts while doing RBD snapshot - was Re: snapshot caused host disconnected

2013-10-10 Thread Indra Pramana
Dear all, I and my colleague tried to scrutinize the source code and found the script which is performing the copying of the snapshot from primary storage to secondary storage on this file: ./plugins/hypervisors/kvm/src/com/cloud/hypervisor/kvm/storage/KVMStorageProcessor.java Specifically

Re: [DOC] 4.2.0 Templates

2013-10-10 Thread Marty Sweet
Where will the docs commited to the master become available? This probably isn't the only case where commits have been lost? https://reviews.apache.org/r/13745/ On Thu, Oct 10, 2013 at 1:17 AM, Radhika Puthiyetath radhika.puthiyet...@citrix.com wrote: 4.2 docs are from 4.2 branch.

Re: Review Request 14076: New test added for template copy feature

2013-10-10 Thread SrikanteswaraRao Talluri
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14076/#review26858 --- test/integration/component/test_templates.py

Re: Review Request 14076: New test added for template copy feature

2013-10-10 Thread SrikanteswaraRao Talluri
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14076/#review26860 --- This test is a duplicate of test_06_copy_template test in the

Re: Review Request 14227: CLOUDSTACK-4707: sourcetemplateid field is not getting set for derived templates

2013-10-10 Thread ASF Subversion and Git Services
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14227/#review26862 --- Commit bb7493775c202f9a0345482b7a9cb478ed48ba11 in branch

Re: Review Request 14227: CLOUDSTACK-4707: sourcetemplateid field is not getting set for derived templates

2013-10-10 Thread ASF Subversion and Git Services
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14227/#review26861 --- Commit 4392a47d1dfac656e645ac7620ac95a839745a29 in branch

Re: Review Request 14227: CLOUDSTACK-4707: sourcetemplateid field is not getting set for derived templates

2013-10-10 Thread Kishan Kavala
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14227/#review26863 --- Ship it! 4.2 commit 4392a47d1dfac656e645ac7620ac95a839745a29

[ACS4.2.1] Release dashboard

2013-10-10 Thread Abhinandan Prateek
Put together some basic reports here for 4.2.1 https://issues.apache.org/jira/secure/Dashboard.jspa Please, try to work on your tickets if you have one, if not see if you can pick up some unassigned. -abhi

Re: [DOC] 4.2.0 Templates

2013-10-10 Thread Daan Hoogland
Marty, As I understand the master branch for docs will be filled as work on it starts. the ones in the 4.2 branch are the current ones. btw commits get hidden, rarely lost :p regards, On Thu, Oct 10, 2013 at 8:29 AM, Marty Sweet msweet@gmail.com wrote: Where will the docs commited to the

Re: why are RvR routers not HA

2013-10-10 Thread Daan Hoogland
Hey Darren, you daredevil you I agree that it should be possible and I want it. My focus is with the VPC routers. They should be redundant and highly available. I like your take of creating a new provider/element though I think it is necessary for the whole system to provide this at any time.

Re: Review Request 14459: CLOUDSTACK-2243: Add automation tests for VMs base image update faclity

2013-10-10 Thread Ashutosh Kelkar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14459/ --- (Updated Oct. 10, 2013, 10:23 a.m.) Review request for cloudstack and Girish

Schedule for CCC Amsterdam

2013-10-10 Thread Sebastien Goasguen
Hi folks, The organizing committee of CCC Amsterdam put up a tentative schedule for the conference: http://cloudstackcollab.org/schedule We will be contacting speakers individually to get confirmation, explain a few details and settle the schedule. In the meantime you can look it up and see

Re: High CPU utilization on KVM hosts while doing RBD snapshot - was Re: snapshot caused host disconnected

2013-10-10 Thread Wido den Hollander
On 10/10/2013 08:06 AM, Indra Pramana wrote: Dear all, I and my colleague tried to scrutinize the source code and found the script which is performing the copying of the snapshot from primary storage to secondary storage on this file:

[INFRA] Sorely missing documentation

2013-10-10 Thread Prasanna Santhanam
Hi, I've added some missing documentation on how our build systems (jenkins) are setup. I think I've addressed most questions that came up in threads on this mailing list. If you would like to understand how all this is setup please go through the following wiki pages: I've put in pictures and

Re: Review Request 14531: CLOUDSTACK-702: Verify Userdata and Password service on alias ip on VR

2013-10-10 Thread ASF Subversion and Git Services
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14531/#review26864 --- Commit d5eda578cd1dafe24d6ab3b633113468acbecd4f in branch

Re: [INFRA] Sorely missing documentation

2013-10-10 Thread Daan Hoogland
Thanks Prasanna, should we publish some 'latest' docs or is this not desirable? We could do with links to the artifacts, i imagine. Daan On Thu, Oct 10, 2013 at 2:00 PM, Prasanna Santhanam t...@apache.org wrote: Hi, I've added some missing documentation on how our build systems (jenkins)

Re: [INFRA] Sorely missing documentation

2013-10-10 Thread Prasanna Santhanam
By latest you mean something in those pages is outdated? I haven't documented all the jobs yet. I think it would be nice to add links to our community repositories etc. Is this what you mean by artifacts? On Thu, Oct 10, 2013 at 02:17:13PM +0200, Daan Hoogland wrote: Thanks Prasanna, should

Re: [INFRA] Sorely missing documentation

2013-10-10 Thread Daan Hoogland
by latest i mean the results of jenkins doc build jobs. and yes I mean either copy the build results to the site or the wiki on the one hand and just set links to the artifacts in jenkins on the other hand. On Thu, Oct 10, 2013 at 2:21 PM, Prasanna Santhanam t...@apache.org wrote: By latest you

Re: Docs have moved

2013-10-10 Thread Prasanna Santhanam
On Wed, Oct 02, 2013 at 03:15:23PM -0400, David Nalley wrote: Per our earlier discussion, now that 4.2 has released, I moved the docs for 4.2 to their own repo, and will be doing the same for master in the next day or so as I clean things up. The new repo is:

Re: [DISCUSS] Pluggable VM snapshot related operations?

2013-10-10 Thread SuichII, Christopher
Multivendor snapshotting: The case with two storage providers is a bit trickier and is one that we are still working on. I believe there are a couple options on the table: -Give both storage providers the option to take the snapshot and fail if either one fails or cannot take the snapshot -Give

Re: [INFRA] Sorely missing documentation

2013-10-10 Thread Prasanna Santhanam
Should be okay for the moment. Except we forget updating links on the wiki with jenkins changing. But I wouldn't point these to the users as 'working' documentation. We should get the corrected docs on the site. On Thu, Oct 10, 2013 at 02:26:22PM +0200, Daan Hoogland wrote: by latest i mean the

Re: Docs have moved

2013-10-10 Thread Prasanna Santhanam
On Thu, Oct 10, 2013 at 05:57:58PM +0530, Prasanna Santhanam wrote: On Wed, Oct 02, 2013 at 03:15:23PM -0400, David Nalley wrote: Per our earlier discussion, now that 4.2 has released, I moved the docs for 4.2 to their own repo, and will be doing the same for master in the next day or so as

Re: Review Request 14320: add boolean option httpModeEnabled to the service offering for use in haproxy conf

2013-10-10 Thread daan Hoogland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14320/ --- (Updated Oct. 10, 2013, 12:57 p.m.) Review request for cloudstack, Chiradeep

Re: [DISCUSS] Pluggable VM snapshot related operations?

2013-10-10 Thread Mike Tutkowski
I wonder if this technique is only going to work for NFS? In the block world, the VDI we take a snapshot of on the SR will lead to the creation of another VDI and a block system cannot just snapshot the hypervisor snapshot - it needs to snapshot the entire volume (which is analogous to the SR).

Re: [PROPOSAL] Remove Setters from *JoinVO

2013-10-10 Thread SuichII, Christopher
I went ahead and removed all setters from *JoinVOs this morning and played around in my environment. There were no compile errors since nobody called those setters, everything seems to be working just fine and there aren't any errors in any of the logs. Does anyone have any suggestions on how

Re: [DISCUSS] Pluggable VM snapshot related operations?

2013-10-10 Thread SuichII, Christopher
Hm, that is tricky. I haven't looked into block stuff too much, but maybe we can… -Create another temporary lun , register it as a SR/DS -Move the active VM to that SR -Ask the storage driver to snapshot. -Move the active VM back to the original SR -Delete the temporary lun and SR -Delete the

Re: Docs have moved

2013-10-10 Thread Ian Duffy
Actually I think the jobs are broken now. I'm not too clear on the publican changes. Can someone take a look and fix the publican arguments? Current looking at this. midonet, niciranvp and release notes are back building. Should be able to get the quick install guide back up too, I had to

Re: VM Backup plug-in framework

2013-10-10 Thread SuichII, Christopher
Sorry it has taken me a bit to reply, Simon. Right now, it sounds like you have a couple options. 1) There is an interface called 'SnapshotStrategy', which would allow you to write a plugin becoming the authority on how to take, backup and revert snapshots. This should give you the appropriate

Re: Docs have moved

2013-10-10 Thread Travis Graham
Have the 4.2 branch changes been merged into master now? Which branch should we be submitting patches off of? Travis On Oct 10, 2013, at 11:10 AM, Ian Duffy i...@ianduffy.ie wrote: Actually I think the jobs are broken now. I'm not too clear on the publican changes. Can someone take a look

bvt failure since on master

2013-10-10 Thread Prasanna Santhanam
Hi All - Looks like the server won't come up on master (CLOUDSTACK-4848). It started happening since last night. Is this something anyone else is seeing? I'm hitting it regularly on the test environment. The DatabaseUpgradeChecker is complaining about a duplicate column `size` in an upgrade

Re: bvt failure since on master

2013-10-10 Thread Laszlo Hornyak
Hi, I am receiving tons of emails from jenkins about broken builds, but my local build is ok and no tests failing, Is this some environment issue? On Thu, Oct 10, 2013 at 5:51 PM, Prasanna Santhanam t...@apache.org wrote: Hi All - Looks like the server won't come up on master

Review Request 14577: Remove Setters from *JoinVO Classes

2013-10-10 Thread Chris Suich
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/14577/ --- Review request for cloudstack. Repository: cloudstack-git Description

Re: why are RvR routers not HA

2013-10-10 Thread Sheng Yang
Yes it's mostly an implementation issue. We evaluated the situation and think it's too complex and too much effort to enable HA plus VRRP, so we decide to drop HA to simply and make things more stable. Here are some reference of how RvR works, hope it would help.

Re: Docs have moved

2013-10-10 Thread David Nalley
4.2 and all of those changes should hit master as well. 4.2 should == master at the moment. --David On Thu, Oct 10, 2013 at 11:19 AM, Travis Graham tgra...@tgraham.us wrote: Have the 4.2 branch changes been merged into master now? Which branch should we be submitting patches off of? Travis

Re: Docs have moved

2013-10-10 Thread David Nalley
On Thu, Oct 10, 2013 at 11:10 AM, Ian Duffy i...@ianduffy.ie wrote: Actually I think the jobs are broken now. I'm not too clear on the publican changes. Can someone take a look and fix the publican arguments? Current looking at this. midonet, niciranvp and release notes are back building.

Re: Schedule for CCC Amsterdam

2013-10-10 Thread John Mark Walker
Having missed the deadline, are there any openings? -JM - Original Message - Hi folks, The organizing committee of CCC Amsterdam put up a tentative schedule for the conference: http://cloudstackcollab.org/schedule We will be contacting speakers individually to get

Re: [DISCUSS] Pluggable VM snapshot related operations?

2013-10-10 Thread Mike Tutkowski
My initial tendency here is to stick with standard hypervisor snapshots for 4.3 for block storage. I am curious how this work pans out, though, so I plan to keep up to date with it. Thanks! On Thu, Oct 10, 2013 at 9:06 AM, SuichII, Christopher chris.su...@netapp.com wrote: Hm, that is

Re: Docs have moved

2013-10-10 Thread Ian Duffy
Response inline... On 10 Oct 2013 18:27, David Nalley da...@gnsa.us wrote: On Thu, Oct 10, 2013 at 11:10 AM, Ian Duffy i...@ianduffy.ie wrote: Actually I think the jobs are broken now. I'm not too clear on the publican changes. Can someone take a look and fix the publican arguments?

Re: System VM template caching

2013-10-10 Thread Kelcey Jamison Damage
I just went back through the release guide an nowhere could I find any mention of the template upgrade and workaround process for KVM host based CloudStack upgrading from 4.1 to 4.2. I also took a look through the troubleshooting section. I might just be missing it, but using the steps in the

RE: [DISCUSS] Pluggable VM snapshot related operations?

2013-10-10 Thread Edison Su
Personally, I am +1 on the coarse grain interface, and totally agree with your points. As long as we separate vmsnasphotmanager and vmsnapshotstrategy, and provide enough helper functions(such as quiesce / un-quiesce vm) for vendors, then write a new vmsnapshotStrategy should be easy.

Re: [DISCUSS] Pluggable VM snapshot related operations?

2013-10-10 Thread Mike Tutkowski
I'm still curious how multiple VM snapshot strategies are resolved? What happens if two vendors write a VM strategy and the VM you're taking a snapshot of has disks provided by multiple vendors. Chris had some ideas on this. I'll be interested to see where this goes. On Thu, Oct 10, 2013 at

UI accounts wizard broken

2013-10-10 Thread Brian Federle
After reviewing the UI on the latest master, I noticed that the 'add account' dialog was changed substantially, and converted to a custom UI widget. Additionally, the password confirm field validation is broken, so I am unable to add a new account. Can I know the reason this was converted to a

Re: Docs have moved

2013-10-10 Thread David Nalley
On Thu, Oct 10, 2013 at 2:09 PM, Ian Duffy i...@ianduffy.ie wrote: Response inline... On 10 Oct 2013 18:27, David Nalley da...@gnsa.us wrote: On Thu, Oct 10, 2013 at 11:10 AM, Ian Duffy i...@ianduffy.ie wrote: Actually I think the jobs are broken now. I'm not too clear on the publican

RE: UI accounts wizard broken

2013-10-10 Thread Jessica Wang
+1 -Original Message- From: Brian Federle Sent: Thursday, October 10, 2013 12:55 PM To: dev@cloudstack.apache.org Cc: Animesh Chaturvedi; Jessica Wang; Sonny Chhen Subject: RE: UI accounts wizard broken Also, I am referring to this commit. I do not remember any active UI comitters

Re: Docs have moved

2013-10-10 Thread Chip Childers
I just opened a request with infra for that (and for cloudmonkey): https://issues.apache.org/jira/browse/INFRA-6857 On Thu, Oct 10, 2013 at 4:25 PM, Yoshikazu Nojima m...@ynojima.net wrote: Hi, I want to submit CloudStack Plugin guide for VXLAN Plugin, but there isn't cloudstack-doc repo in

Re: Docs have moved

2013-10-10 Thread Yoshikazu Nojima
Thank you! Noji 2013/10/10 Chip Childers chip.child...@sungard.com: I just opened a request with infra for that (and for cloudmonkey): https://issues.apache.org/jira/browse/INFRA-6857 On Thu, Oct 10, 2013 at 4:25 PM, Yoshikazu Nojima m...@ynojima.net wrote: Hi, I want to submit

Global setting host is not set to MS IP anymore on master

2013-10-10 Thread Min Chen
Hi there, Not sure if others experience the same issue. In 4.2, when MS starts, it will discover the IP address of MS and automatically set global setting host to that IP address. Now it seems broken on master, MS started but host is still set to localhost, which caused my system vm cannot

Re: Global setting host is not set to MS IP anymore on master

2013-10-10 Thread Nitin Mehta
If my memory serves me right this was fixed in 4.2. Maybe the fixer forgot to port it to master ? On 10/10/13 2:46 PM, Min Chen min.c...@citrix.com wrote: Hi there, Not sure if others experience the same issue. In 4.2, when MS starts, it will discover the IP address of MS and automatically set

Re: Global setting host is not set to MS IP anymore on master

2013-10-10 Thread Min Chen
HmmŠ I think that it may be related to new ConfigDepot framework to support dynamic config value without restarting MS. -min On 10/10/13 3:00 PM, Nitin Mehta nitin.me...@citrix.com wrote: If my memory serves me right this was fixed in 4.2. Maybe the fixer forgot to port it to master ? On

Re: Review Request 14381: KVM: add connect/disconnect capabilities to StorageAdaptors so that external storage services can attach/detach devices on-demand

2013-10-10 Thread Mike Tutkowski
Hey Marcus, I haven't had a chance to test this yet, but I thought you might be interested in the merge of your work with mine. I've also replaced the direct CHAP parameters with a MapString, String (which currently only stores the CHAP credentials, but could be used for more in the future). I

RE: Global setting host is not set to MS IP anymore on master

2013-10-10 Thread Prachi Damle
I see it on Windows too. -Original Message- From: Alena Prokharchyk [mailto:alena.prokharc...@citrix.com] Sent: Thursday, October 10, 2013 4:20 PM To: dev@cloudstack.apache.org; Min Chen Subject: Re: Global setting host is not set to MS IP anymore on master Importance: High I'm facing

Re: System VM template caching

2013-10-10 Thread Sebastien Goasguen
On Oct 10, 2013, at 2:19 PM, Kelcey Jamison Damage kel...@backbonetechnology.com wrote: I just went back through the release guide an nowhere could I find any mention of the template upgrade and workaround process for KVM host based CloudStack upgrading from 4.1 to 4.2. I also took a look

Re: System VM template caching

2013-10-10 Thread Kelcey Jamison Damage
I can patch in what I have been told, but I don't understand what I have been told so I know most of the people I help on irc won't get it either. Once I find what appears to be a digestible solution I will happily look into patching the docs. - Original Message - From: Sebastien

Master - BVT automation result on KVM

2013-10-10 Thread Rayees Namathponnan
Hi All, Here the BVT automation result on KVM, You can see the result @ http://jenkins.buildacloud.org/view/cloudstack-qa/job/test-smoke-matrix/898/ Delete template test case failed this runs, we need to look that (I didn't tested manually this failure) Issues reported with last run still

RE: Latest Master DB issue

2013-10-10 Thread Rayees Namathponnan
Any idea when we can get fix for https://issues.apache.org/jira/browse/CLOUDSTACK-4825 ? Regards, Rayees -Original Message- From: Darren Shepherd [mailto:darren.s.sheph...@gmail.com] Sent: Wednesday, October 09, 2013 7:42 AM To: dev@cloudstack.apache.org Subject: Re: Latest Master DB

Re: Review Request 14381: KVM: add connect/disconnect capabilities to StorageAdaptors so that external storage services can attach/detach devices on-demand

2013-10-10 Thread Mike Tutkowski
I made a bunch of updates, Marcus: https://github.com/mike-tutkowski/incubator-cloudstack/commit/c13442eaa228a5ae37d3b13f6c98636de158a908 On Thu, Oct 10, 2013 at 4:40 PM, Mike Tutkowski mike.tutkow...@solidfire.com wrote: Hey Marcus, I haven't had a chance to test this yet, but I thought

Steps in building DEB packages for 4.2.0

2013-10-10 Thread Indra Pramana
Dear all, I am reading the documentation on the steps in building DEB packages for CloudStack 4.2.0: http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Installation_Guide/sect-source-builddebs.html and compare it with the steps on the earlier version (e.g. 4.1.1):

Re: High CPU utilization on KVM hosts while doing RBD snapshot - was Re: snapshot caused host disconnected

2013-10-10 Thread Indra Pramana
Hi Wido, Good day to you, and thank you for your e-mail reply. Thank you for your advice. We will try to tweak the code to throttle the copying process to the secondary storage server. Cheers. On Thu, Oct 10, 2013 at 7:56 PM, Wido den Hollander w...@widodh.nl wrote: On 10/10/2013 08:06

Re: bvt failure since on master

2013-10-10 Thread Prasanna Santhanam
Can you tell me what job is doing that? I'm not sure which one is emailing people. We shouldn't be emailing anything from jenkins.buildacloud to individuals unless they ask to be. On Thu, Oct 10, 2013 at 07:00:27PM +0200, Laszlo Hornyak wrote: Hi, I am receiving tons of emails from jenkins

Re: Global setting host is not set to MS IP anymore on master

2013-10-10 Thread Prasanna Santhanam
So, why does setting the 'host' to your IP not work? I do that for the test environment on master as part of deployment via marvin. It's only a small change in the marvin-config. On https://github.com/vogxn/cloud-autodeploy.git commit 8fe580e82fe4ab6dd8e124bf226c5941e72a4204 Author: Prasanna

Re: Master - BVT automation result on KVM

2013-10-10 Thread Prasanna Santhanam
Hi Rayees, Thanks for stepping up to send this report. Can we use the jenkins2email [1] script I wrote for this email? The format gets messed up when you copy paste from jenkins. Also the result here is not that of KVM. KVM is actually broken on master, the addHost seems to be failing to bring