[KVM] Helper for agent during HA operations

2013-08-07 Thread Wido den Hollander
Hi, In our production setups we have seen some crashes of the KVM agent. This could happen for all kinds of reasons, but that's not what I wanted to discuss. Also see this issue: https://issues.apache.org/jira/browse/CLOUDSTACK-3954 What I've been writing for a PoC in our company is a small

Re: [DISCUSS] KVM io throttling

2013-08-09 Thread Wido den Hollander
On 08/09/2013 02:05 AM, Edison Su wrote: Hi All, For basic network, the io limit for guest network(nic 2) is 200MB/s, we set the io limit on kvm host as: I think you mean 200Mbit/s? /interface interface type='bridge' source bridge='cloudbr0'/ mac address='06:45:c4:00:00:0c'/ model

Re: [DISCUSS] KVM io throttling

2013-08-10 Thread Wido den Hollander
, August 09, 2013 11:27 AM To: dev@cloudstack.apache.org Subject: RE: [DISCUSS] KVM io throttling -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: Friday, August 09, 2013 2:41 AM To: dev@cloudstack.apache.org Subject: Re: [DISCUSS] KVM io throttling On 08/09/2013 02

Re: Template Folder Path (KVM/Libvirt)

2013-08-13 Thread Wido den Hollander
On 08/12/2013 11:16 PM, Marty Sweet wrote: Hi all, I've hit a problem that I have been chewing on for the past few hours. A few months ago I changed the local storage path naming convention (examples below) and updated the corresponding records in the cloudstack database manually. This works

Re: regarding issues related ceph integration with cloudstack

2013-08-13 Thread Wido den Hollander
/browse/CLOUDSTACK-4217 CLOUDSTACK-4217 https://issues.apache.org/jira/browse/CLOUDSTACK-4217 ceph:addprimary storage is failed with exception(documentation is not clear) https://issues.apache.org/jira/browse/CLOUDSTACK-4217 Wido den Hollander https://issues.apache.org

Re: Linux Template Documentation

2013-08-14 Thread Wido den Hollander
On 08/14/2013 02:02 PM, Marty Sweet wrote: Hi guys, I was planning on making some documentation which explains how to prepare a Linux VM for template creation (there is a good doc about Windows), what do you think? My only current issue is how to pick up a hostname from DHCP, while I have

Re: [ACS42] Issues that need to bre resolved for RC on Monday 8/19

2013-08-19 Thread Wido den Hollander
On 08/19/2013 07:49 AM, Animesh Chaturvedi wrote: Here is the latest list of issues that need to be resolved for RC tomorrow. Wido can you pick up 4249 related to Ceph? Yes, I'll do that! I'll pick up 4249 | Assignee | Issues Id: Summary

Re: master build fails in LibvirtComputingResourceTest

2013-08-20 Thread Wido den Hollander
On 08/20/2013 04:34 PM, Daan Hoogland wrote: H, Is someone working on LibvirtComputingResource.createVMFromSpec()? It is tested in two of the failing tests. Not actively. I created a test a while ago due to a compat issue between 4.0 and 4.1, but that test seems to break now. When I

Re: [4.2] [KVM]

2013-08-20 Thread Wido den Hollander
Hi, On 08/20/2013 06:43 PM, Paul Angus wrote: Hi Guys, I’m unable to deploy system VMs on KVM using 4.2 anymore libvirtd.log contains: 2013-08-20 15:17:03.996+: 3299: warning : qemuSetupCgroup:395 : Could not autoset a RSS limit for domain s-13-VM 2013-08-20 15:17:04.092+: 3299:

Re: [VOTE] Apache Cloudstack 4.2.0

2013-08-26 Thread Wido den Hollander
-1 (binding) I am aware of Ceph bugs which are still open for 4.2, like migrating from primary to primary storage. I didn't get around fixing those yet since they were reported just last week. The issue: https://issues.apache.org/jira/browse/CLOUDSTACK-4423 Wido On 08/23/2013 08:55 PM,

Re: [VOTE] Apache Cloudstack 4.2.0

2013-08-26 Thread Wido den Hollander
On 08/26/2013 10:25 PM, Animesh Chaturvedi wrote: -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: Monday, August 26, 2013 12:24 AM To: dev@cloudstack.apache.org Subject: Re: [VOTE] Apache Cloudstack 4.2.0 -1 (binding) I am aware of Ceph bugs which

Re: [VOTE] Apache Cloudstack 4.2.0

2013-08-26 Thread Wido den Hollander
On 08/26/2013 10:50 PM, Animesh Chaturvedi wrote: [Animesh] Wido I am going to cut another RC to pick up licensing fixes from Chip. Do you have a fix for the issue reported? IMO looking through that issue it can be covered in 4.2.1. I also sent a cherry-pick request last week for a

Re: [ACS4.2] Don;t use libvirt 0.10.2+ if you are using NFS as primary storage on KVM

2013-08-27 Thread Wido den Hollander
On 08/25/2013 07:20 AM, Edison Su wrote: There is a bug in libvirt 0.10.2+: /* Short-circuit if already mounted */ 385http://libvirt.org/git/?p=libvirt.git;a=blob;f=src/storage/storage_backend_fs.c;h=d305b063ffd9dd01683e9105cfc6902948537ca4;hb=HEAD#l385 if ((rc =

[ACS42] Please cherry-pick 3315159de62620166c119dbf72dad9cf661cc0cb

2013-08-27 Thread Wido den Hollander
Hi, In a commit in May I enabled the deployment of SystemVMs on RBD, but this was unintentionally reverted by a different commit (merge). I didn't notice this up until now and fixed it in both master and 4.2-forward. Can 3315159de62620166c119dbf72dad9cf661cc0cb be cherry-picked to 4.2?

Re: [VOTE] Apache CloudStack 4.2.0 (second round)

2013-08-27 Thread Wido den Hollander
On 08/27/2013 05:20 PM, Chip Childers wrote: On Tue, Aug 27, 2013 at 02:29:51PM +, Animesh Chaturvedi wrote: Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h= refs/heads/4.2 Commit: 9103984d349927a87b0683048dda2d8004e6854f I notice

[ACS42] Cherry-pick for CLOUDSTACK-4423 (93b40b0ca6a796ffbacd80c40897f6ada6284bc4)

2013-08-27 Thread Wido den Hollander
Hi, Can you cherry-pick 93b40b0ca6a796ffbacd80c40897f6ada6284bc4 into 4.2? It fixes CLOUDSTACK-4423 and enables RBD volumes to be migrated to other primary storages. Thank you! Wido

Re: regarding https://issues.apache.org/jira/browse/CLOUDSTACK-3542

2013-08-30 Thread Wido den Hollander
On 08/30/2013 10:37 AM, Suresh Sadhu wrote: HI , You have resolved template size showing wrong values issue without changing libvirt version. is it necessary to document libvirt version changes as mentioned in the issue or no need. Can you please confirm. I have never encountered

Re: Release Criteria

2013-09-11 Thread Wido den Hollander
On 09/11/2013 07:43 AM, Darren Shepherd wrote: On Tue, Sep 10, 2013 at 9:52 PM, Prasanna Santhanam t...@apache.org wrote: I think we messed up with the users again this time. Partly a fault that we can't get beta-quality builds for users to test. Seeing everyone run 4.2 packages after

Re: Release Criteria

2013-09-11 Thread Wido den Hollander
On 09/11/2013 10:06 AM, Sebastien Goasguen wrote: On Sep 11, 2013, at 2:57 AM, Wido den Hollander w...@widodh.nl wrote: On 09/11/2013 07:43 AM, Darren Shepherd wrote: On Tue, Sep 10, 2013 at 9:52 PM, Prasanna Santhanam t...@apache.org wrote: I think we messed up with the users again

Re: 4.1 new feature post release?

2013-09-16 Thread Wido den Hollander
On 09/15/2013 07:32 AM, Marcus Sorensen wrote: Hi guys, I was just pulling in updates from the 4.1 branch and noticed commit 706e23623c3227d92ae498529166ca73d2a2bf4e, This looks like a new feature. There's not a bug attached to it. It seems to allow admins to set the CPU mode for KVM guests,

Re: Apache CloudStack 4.2.0 (fifth round)

2013-09-16 Thread Wido den Hollander
+1 (binding) I verified what I could: - Build DEB packages - Installed DEB packages - Tested RBD/Ceph functionality CloudStack is a big project, so I only tested the portion of CloudStack I'm most familiar with and my vote is based on that. Wido On 09/16/2013 10:41 AM, sebgoa wrote: +1

Libvirt-java 0.5.0 has been released

2013-09-16 Thread Wido den Hollander
Hi, I worked with the RedHat guys last week to get libvirt-java 0.5.0 released which has some nice new features for us: - Supports different XML on destination host during migration - Supports resizing volumes - Supports more snapshot functionalities I took the liberty to depend on 0.5.0 in

Re: Libvirt-java 0.5.0 has been released

2013-09-16 Thread Wido den Hollander
time, but the bindings was just missing them. Wido 2013/9/16 Wido den Hollander w...@widodh.nl Hi, I worked with the RedHat guys last week to get libvirt-java 0.5.0 released which has some nice new features for us: - Supports different XML on destination host during migration - Supports

Re: Primary store (PS) failure/outage

2013-09-16 Thread Wido den Hollander
On 09/16/2013 01:21 PM, Koushik Das wrote: Currently the way Cloudstack deals with PS failure is to reboot all hosts associated with the cluster. Selectively cleaning up the affected VMs would have been the best option, but since issues were seen with stopping VMs on the hypervisors (at least

Re: [jira] [Commented] (CLOUDSTACK-3565) Restarting libvirtd service leading to destroy storage pool

2013-09-16 Thread Wido den Hollander
On 09/16/2013 07:16 PM, Marcus Sorensen wrote: I agree, it makes things more complicated. However, updating libvirt should be a maintenance mode thing; I've seen it lose track of VMs between major libvirt upgrades and have to kill/restart all vms to reregister them with libvirt, best to be in

Re: Libvirt-java 0.5.0 has been released

2013-09-16 Thread Wido den Hollander
to this libvirt change? I think so. I'll test this tomorrow, but I think the RedHat guys build the bindings with Java 7 since they all work on a recent Fedora version. Wido Thanks -min On 9/16/13 4:28 AM, Wido den Hollander w...@widodh.nl wrote: On 09/16/2013 12:51 PM, Wei ZHOU wrote: Thanks Wido

Re: [DISCUSS] Java 7, tomcat 7 and further upgrades

2013-09-18 Thread Wido den Hollander
On 09/18/2013 06:51 PM, Darren Shepherd wrote: I'd be relatively opposed to switching everything to jdk7. Java 6 is the current lowest common denominator and using java 7 at the moment will just alienate somebody I don't know the back story. Is libvirt compiled for jdk7? I'd be perfectly

Re: workshops at CCC Europe

2013-09-18 Thread Wido den Hollander
On 09/18/2013 04:40 PM, Daan Hoogland wrote: H, In november in Amterdam there are going to be hackathons and other workshops held. Last time David (N.) started a page on this so I think it would be a good idea to do this again.

Re: Libvirt-java 0.5.0 has been released

2013-09-21 Thread Wido den Hollander
will be updated. They didn't publish a new JAR yet. They want some feedback on 0.5.0 first if it technically works, if so, they will release 0.5.1 which is Java 6 compatible. Wido Cheers, HUgo On Sep 21, 2013, at 3:03 PM, Wido den Hollander w...@widodh.nl wrote: On 09/17/2013 08:35 PM

Re: Libvirt-java 0.5.0 has been released

2013-09-22 Thread Wido den Hollander
On Sep 21, 2013, at 3:28 PM, Wido den Hollander w...@widodh.nl wrote: On 09/21/2013 09:15 AM, Hugo Trippaers wrote: Hey Wido, Did they publish the updated jar with the same version number? If that is the case maven will not take care of it as by definition release artefacts will be cached

Re: [RESULTS] [VOTE] Release Apache CloudStack 4.2.0 (sixth round)

2013-09-24 Thread Wido den Hollander
On 09/24/2013 06:21 AM, Animesh Chaturvedi wrote: This vote has passed with no -1 votes. +1 votes were from (with * binding): Chiradeep*, Hugo*, Chip*, Milamber, Amogh +0: Marcus* Marcus agreed to change his VOTE to +1 with a Release Note change that he will make. Wido can

Re: Libvirt-java 0.5.0 has been released

2013-09-25 Thread Wido den Hollander
) at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:357) at com.cloud.agent.AgentShell.start(AgentShell.java:454) ... 5 more 2013/9/22 Wido den Hollander w...@widodh.nl: On 09/21/2013 09:38 AM, Hugo Trippaers wrote: Ahh ok. Any idea how long that is going to take

Re: Libvirt-java 0.5.0 has been released

2013-09-25 Thread Wido den Hollander
major version 50 Java 7 uses major version 51 Wido On 09/25/2013 08:45 AM, Wido den Hollander wrote: On 09/24/2013 11:39 PM, Yoshikazu Nojima wrote: Hi, libvirt-java 0.5.1 is released, and I tried to upgrade it to 0.5.1, diff --git a/pom.xml b/pom.xml index a8778f1..1c85bc4 100644

Re: Failed to deserialize json object

2013-09-25 Thread Wido den Hollander
On 09/25/2013 01:12 PM, Indra Pramana wrote: Dear all, During my upgrade attempt from CloudStack 4.1.1 to 4.2.0 earlier this week, I failed on the step when I need to run the cloudstack-sysvmadm script to restart the system VMs. nohup cloudstack-sysvmadm -d IP address -u cloud -p -a

Re: ubuntu LTS for system vm? and 64bit?

2013-09-26 Thread Wido den Hollander
On 09/26/2013 01:38 AM, Darren Shepherd wrote: Is there any technical reason why we couldn't use ubuntu LTS (12.04 and soon to be 14.04) for the system VM. Additionally is there any technical reason we couldn't switch to 64bit. I don't necesarily want to get into fight for you favorite

Re: Libvirt-java 0.5.0 has been released

2013-09-29 Thread Wido den Hollander
On 09/29/2013 08:01 AM, Wei ZHOU wrote: try backup and remove the jna.jar in /usr/share/java I fixed the init scripts, it was still including the old JNA in the classpath: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=e6fd794ca0b10a00f3fc93e5f3e81ab342f5b860 That

Re: High CPU utilization on KVM hosts while doing RBD snapshot - was Re: snapshot caused host disconnected

2013-10-08 Thread Wido den Hollander
On 10/08/2013 04:59 AM, Indra Pramana wrote: Dear Wido and all, I performed some further tests last night: (1) CPU utilization of the KVM host while RBD snapshot running is still shooting up high even after I set global setting: concurrent.snapshots.threshold.perhost to 2. (2) Most of the

Re: High CPU utilization on KVM hosts while doing RBD snapshot - was Re: snapshot caused host disconnected

2013-10-10 Thread Wido den Hollander
on the KVM hosts. Due to the above bug on point (3), is there a workaround on how we can prevent the snapshots to be copied over to the secondary storage after it's being created on the primary storage? Looking forward to your reply, thank you. Cheers. On Tue, Oct 8, 2013 at 2:41 PM, Wido den

Re: [MERGE] disk_io_throttling to MASTER

2013-06-01 Thread Wido den Hollander
that we never release a version with only total IOps. You laid the groundwork for the I/O throttling and that's great! We should however prevent that we create legacy from day #1. Wido -Wei 2013/5/31 Wido den Hollander w...@widodh.nl On 05/31/2013 03:59 PM, John Burwell wrote: Wido

Re: Instructions for pushing DEB's to cloudstack.apt-get.eu

2013-06-04 Thread Wido den Hollander
Hi Chip, On 06/03/2013 07:22 PM, Chip Childers wrote: Wido, I have the access, and I have the results of building from the release source, but I don't have the knowledge to specifically know what to put where and what to run to get the non-OSS DEB's I just built into the repo. Can you share

Re: [ANNOUNCE] New CloudStack PMC Member: John Burwell

2013-06-04 Thread Wido den Hollander
Congrats John! Great to have you on board :) Thank you for your ongoing effort in making CloudStack even better. Wido On 06/04/2013 03:35 PM, Chip Childers wrote: The Apache CloudStack PMC has invited John Burwell to join the PMC, and he has accepted. Congrats John! -chip

Re: Instructions for pushing DEB's to cloudstack.apt-get.eu

2013-06-04 Thread Wido den Hollander
On 06/04/2013 10:24 PM, Chip Childers wrote: On Tue, Jun 04, 2013 at 10:19:19AM +0200, Wido den Hollander wrote: Hi Chip, On 06/03/2013 07:22 PM, Chip Childers wrote: Wido, I have the access, and I have the results of building from the release source, but I don't have the knowledge

Re: Instructions for pushing DEB's to cloudstack.apt-get.eu

2013-06-05 Thread Wido den Hollander
On 06/05/2013 07:17 AM, Jörgen Maas wrote: Is this a non-oss build ?? I assume they are OSS builds. Wido On Tue, Jun 4, 2013 at 10:33 PM, Wido den Hollander w...@widodh.nl wrote: On 06/04/2013 10:24 PM, Chip Childers wrote: On Tue, Jun 04, 2013 at 10:19:19AM +0200, Wido den

Re: Template of systemvm

2013-06-06 Thread Wido den Hollander
On 06/06/2013 08:23 AM, Prasanna Santhanam wrote: On Thu, Jun 06, 2013 at 03:13:21PM +0900, Takaaki Suzuki wrote: Hi all I want to download the system VM template from jenkins.cloudstack.org (URL:

Orphaned libvirt storage pools

2013-06-07 Thread Wido den Hollander
Hi, So, I just created CLOUDSTACK-2893, but Wei Zhou mentioned that there are some related issues: * CLOUDSTACK-2729 * CLOUDSTACK-2780 I restarted my Agent and the issue described in 2893 went away, but I'm wondering how that happened. Anyway, after going further I found that I have some

Re: Orphaned libvirt storage pools

2013-06-07 Thread Wido den Hollander
that they can be re-used again. This cluster was upgraded to 4.1 from 4.0 with libvirt 1.0.2 (coming from 0.9.8). Somehow libvirt forgot about these storage pools. Wido On Jun 7, 2013 8:15 AM, Wido den Hollander w...@widodh.nl wrote: Hi, So, I just created CLOUDSTACK-2893, but Wei Zhou

Re: Review Request: (CLOUDSTACK-1301) VM Disk I/O Throttling

2013-06-11 Thread Wido den Hollander
mean with this. - Wido den Hollander On June 10, 2013, 5:51 p.m., Wei Zhou wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11782

Re: [ACS42] Ceph Storage Integration with Cloudstack -

2013-06-11 Thread Wido den Hollander
Hi, I recently wrote a short blog post about this: http://blog.widodh.nl/2013/06/a-quick-note-on-running-cloudstack-with-rbd-on-ubuntu-12-04/ The RBD integration in CloudStack 4.2 (master branch) is ready for testing, not everything has been verified by me, but it should work. Things that

Re: [ACS42] Ceph Storage Integration with Cloudstack -

2013-06-12 Thread Wido den Hollander
, but I haven't done that. The Object Store is something different, since that enables you to use the Amazon S3 compatible RADOS Gateway from Ceph as Secondary Storage (Backup and Template). Wido -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: Tuesday, June 11

Re: Orphaned libvirt storage pools

2013-06-12 Thread Wido den Hollander
you think it was related to the upgrade process itself (e.g. maybe the storage pools didn't carry across the libvirt upgrade)? Can you duplicate outside of the upgrade? On Fri, Jun 7, 2013 at 8:43 AM, Wido den Hollander w...@widodh.nl wrote: Hi, On 06/07/2013 04:30 PM, Marcus Sorensen wrote

Re: [Ask] Resize Primary Storage

2013-06-25 Thread Wido den Hollander
Hi, On 06/25/2013 06:41 AM, Denni Sembiring wrote: I had to install Cloudstack 4.02. I use 5 hosts, 1 as management server, and the other into the hypervisor (KVM). when all has gone well, I went to the UI and see my primary storage show only 98 Gb , while the entire capacity of hypervisor

Re: [Ask] Resize Primary Storage

2013-06-26 Thread Wido den Hollander
: running Persistent: yes Autostart: no Capacity: 1.72 TB Allocation: 150.58 GB Available: 1.57 TB Thanks, Jijun If yes, how do I enable it? Thanks, Regards, Denni sembiring 2013/6/25 Wido den Hollander w...@widodh.nl Hi, On 06/25/2013 06:41 AM, Denni Sembiring

Re: Can Hypervisors have multiple image formats?

2013-06-26 Thread Wido den Hollander
On 06/26/2013 02:43 PM, Donal Lafferty wrote: Judging by StorageManagerImpl.getHypervisorTypeFromFormat, each format can only be used by one Hypervisor type. The reason I ask, is that Hyper-V 2012 supports a legacy disk image type called 'VHD' in addition to 'VHDX'. It's straightforward to

Re: [DISCUSS] Java 7, tomcat 7 and further upgrades

2013-06-28 Thread Wido den Hollander
Hi, On 06/27/2013 12:36 AM, Hugo Trippaers wrote: Hey everyone, Back in February 2013 Oracle announced the end of public support for java 1.6 already. Today we are still using java 1.6 as our supported platform. I've been looking at the next generation of linux distributions (well mainly at

Re: Coding Convention Reminder

2013-07-03 Thread Wido den Hollander
On 07/03/2013 12:11 AM, Alex Huang wrote: I like to remind everyone to review our coding conventions. Our coding conventions have been going all over the place recently. Please take a look. https://cwiki.apache.org/confluence/display/CLOUDSTACK/Coding+conventions I also like to propose that

Re: database connection resilience

2013-07-07 Thread Wido den Hollander
Hi, On 07/07/2013 08:45 AM, Marcus Sorensen wrote: I see that my db.properties has db.cloud.autoReconnect=true, which translates to setting autoReconnect in the jdbc driver connection in utils/src/com/cloud/utils/db/Transaction.java. I also see that if I manually trigger the issue I get:

Re: Oracle VM is becoming one of the leaders on Magic Quadrant for x86 Virtualization

2013-07-08 Thread Wido den Hollander
On 07/08/2013 03:14 PM, David Nalley wrote: On Mon, Jul 8, 2013 at 8:33 AM, Alexandre Sousa alexandre.dso...@gmail.com wrote: Hi Guys, This is the last Gartner Report: http://www.gartner.com/technology/reprints.do?id=1-1GJA88Jct=130628st=sb Oracle VM is getting better year after year, so I

Re: building deb package problem

2013-07-08 Thread Wido den Hollander
Are you sure this isn't a local system error? Since all those errors in reading zipfile don't seem right. Btw, running just dpkg-buildpackage should be sufficient. Wido On 07/08/2013 06:24 PM, Thomas Schneider wrote: Hello, I try to build the deb package for cloudstack 4.1 with the

Re: building deb package problem

2013-07-08 Thread Wido den Hollander
On 07/08/2013 06:39 PM, Thomas Schneider wrote: I have the both Aha! Since debian/rules calls the mvn command this might break things. I'd say, go for Maven 3 only. Wido root@csm:~/cloudstack/apache-cloudstack-4.1.0-src# mvn --version Apache Maven 2.2.1 (rdebian-8) Java version:

Re: [ACS411][ACS42] CS-3904: Patch request

2013-07-11 Thread Wido den Hollander
On 07/10/2013 03:47 PM, Chip Childers wrote: On Wed, Jul 10, 2013 at 01:18:18PM +0200, Wido den Hollander wrote: Hi, I'd like to request a patch request for both 4.1.1 and 4.2 for issue CS-3904. Commit 8e4e56f73175363038a5361fe99e882562c2913a resolves this issue, but it should imho be fixed

Re: CloudStack Mirrors

2013-07-11 Thread Wido den Hollander
On 07/10/2013 02:54 PM, Chip Childers wrote: Adding Wido to the CC. Wido, what do you think about adding a mirror or two from your RPM / DEB repo server? No problem! I think rsync would be the best way to go here? Problem is however, I've never set up a rsync daemon or such. Wido -chip

[KVM] Agent hanging and disconnecting when libvirt doesn't respond

2013-07-11 Thread Wido den Hollander
Hi, The last two days I noticed an incident on a cluster where HA kicked in because a host was marked as down since the Agent disconnected. The problem was that libvirt didn't respond to the call the agent was doing. The underlying problem was that the Qemu/KVM process was having some

Re: GlusterFS QEMU libgfapi

2013-07-15 Thread Wido den Hollander
Hi John, On 07/15/2013 04:31 PM, John Skinner wrote: Is there any way to use GlusterFS with the native QEMU libgfapi so we do not have to use Fuse to access the shares? Or are there any plans to build libgfapi QEMU support into CloudStack in the future? As for now there is no way to use

Re: GlusterFS QEMU libgfapi

2013-07-15 Thread Wido den Hollander
are my thing, I'm not a GlusterFS expert. Wido Thanks, John On Jul 15, 2013, at 9:36 AM, Wido den Hollander w...@widodh.nl wrote: Hi John, On 07/15/2013 04:31 PM, John Skinner wrote: Is there any way to use GlusterFS with the native QEMU libgfapi so we do not have to use Fuse to access

Re: CloudStack Mirrors

2013-07-15 Thread Wido den Hollander
On 07/11/2013 01:41 PM, Wido den Hollander wrote: On 07/10/2013 02:54 PM, Chip Childers wrote: Adding Wido to the CC. Wido, what do you think about adding a mirror or two from your RPM / DEB repo server? No problem! I think rsync would be the best way to go here? Problem is however, I've

Re: [DISCUSS] coding convention for method - and class length

2013-07-16 Thread Wido den Hollander
Hi, On 07/16/2013 10:59 AM, Daan Hoogland wrote: LS, I am looking at a method 200 lines long. I've seen more of those. Yes, that is pretty long. I would propose a maximum length of 80 lines per method and There was a recent discussion about this, but I wasn't able to find it that

Re: GlusterFS QEMU libgfapi

2013-07-16 Thread Wido den Hollander
Privoznik), add fuse support for libvirt lxc (Gao feng), Add Gluster protocol as supported network disk backend (Harsh Prateek Bora), various snapshot improvements (Peter Krempa, Eric Blake) Thanks, John On Jul 15, 2013, at 9:56 AM, Wido den Hollander w...@widodh.nl wrote: Hi John, On 07/15/2013

Re: How to fix libvirt storage pool refresh issue?

2013-07-16 Thread Wido den Hollander
On 07/16/2013 12:27 AM, Marcus Sorensen wrote: I'm ok with a symptom fix on our end, if the root cause is in Libvirt we can't do much about that. This is the sort of patch that tends to get pulled into the regular update cycle of the distributions, so unless there's more to it and it's not a

Re: How to fix libvirt storage pool refresh issue?

2013-07-16 Thread Wido den Hollander
information for some time and not call the refresh that often? Refreshing also does a lot of unneeded I/O to your storage subsystem, so I'd say we do that less frequently. Suggestions? Wido Moreover, the file lock will cause performane degrade of VM deployment. -Wei 2013/7/16 Wido den Hollander

Re: Problem in adding Ceph RBD storage to CloudStack

2013-07-18 Thread Wido den Hollander
Hi, On 07/18/2013 06:09 PM, Takuma Nakajima wrote: Hi, I'm building a CloudStack 4.1 with Ceph RBD storage using RHEL 6.3 recently but it fails when adding RBD storage to primary storage. Does anybody know about the problem? No, it works for me like a charm :) Could you set the Agent

Re: New user - Introduction

2013-07-19 Thread Wido den Hollander
Hi Rene! For everybody here: Rene works for the company I work for to as well. I encouraged him to start working on CloudStack. Fix what's broken as you encounter things :) Wido On 07/19/2013 10:19 AM, René Diepstraten wrote: Hi everyone. Since I have joined the mailing list, I'd like to

Re: Review Request 12685: CLOUDSTACK-1532 added utility functions to scan URIs

2013-07-19 Thread Wido den Hollander
right. I see that Spark404 is also mentioned here, did he get a chance to look at this yet? - Wido den Hollander On July 17, 2013, 3:46 p.m., daan Hoogland wrote: --- This is an automatically generated e-mail. To reply, visit: https

Re: Problem in adding Ceph RBD storage to CloudStack

2013-07-22 Thread Wido den Hollander
Hi, On 07/22/2013 12:43 PM, Kimihiko Kitase wrote: It seems secondary storage vm could copy template to primary storage successfully, but created VM doesn't point this vol.. If we create vm manually and add this vol as boot vol, it works fine.. Which version of CloudStack are you using?

Re: GlusterFS QEMU libgfapi

2013-07-22 Thread Wido den Hollander
Hi John, On 07/21/2013 03:32 PM, John Mark Walker wrote: Greetings, CloudStackers. I noticed there was a question re: libgfapi as it pertains to libvirt and QEMU. As of last January/February, all new versions of the KVM/QEMU/libvirt/oVirt virtualization stack have been glusterized and use

4.2 KVM agent can't communicate with 4.1 management server

2013-07-22 Thread Wido den Hollander
Hi, While reviewing 12775 I upgraded my Agents from 4.1 to 4.2, but kept my management server at 4.1 When the Agent starts it sends a StartupRoutingCommand to the management server, but this has changed it seems: In 4.1 the Agent sends this JSON: Sending Startup: Seq 4-0: { Cmd , MgmtId:

Re: Problem in adding Ceph RBD storage to CloudStack

2013-07-22 Thread Wido den Hollander
-vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5 The argument to Qemu seems just fine, so I think the problem is not in CloudStack. Wido Thanks Kimi -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: Monday, July 22, 2013 7:47 PM To: dev

Re: Problem in adding Ceph RBD storage to CloudStack

2013-07-22 Thread Wido den Hollander
on the RBD storage, it works fine. If we check vm from virt manager, there is no virtual disk. So we believe the problem should be vm configuration... We will check ceph version tomorrow. Thanks Kimi -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: Monday, July 22

Re: Problem in adding Ceph RBD storage to CloudStack

2013-07-22 Thread Wido den Hollander
) : It works. Is there any other points to be checked? Thanks, Satoshi Shimazaki 2013/7/23 Wido den Hollander w...@widodh.nl Hi, On 07/22/2013 07:56 PM, Satoshi Shimazaki wrote: Hi Wido, I'm in the project with Kimi and Nakajima-san. [root@rx200s7-07m ~]# ceph -v ceph version 0.61.4

Re: 4.2 KVM agent can't communicate with 4.1 management server

2013-07-23 Thread Wido den Hollander
think it's very good to have for ops. But it looks very difficult for dev, since every little change could break the interoperability. (We have to test it?) -- Toshiaki -Original Message- From: Wido den Hollander [mailto:w...@widodh.nl] Sent: Monday, July 22, 2013 07:53 To: dev

[DISCUSS] API changes / compatibility between 4.1 and 4.2

2013-07-23 Thread Wido den Hollander
Hi, Yesterday I encountered this bug: https://issues.apache.org/jira/browse/CLOUDSTACK-3714 A short summary: A 4.2 agent can't communicate with a 4.2 management server and vise versa. What this means is that during an upgrade you can't upgrade the Agents one by one, since a upgraded Agent

Re: [GSOC]cannot add host with the lastest master

2013-07-23 Thread Wido den Hollander
Hi Meng, On 07/23/2013 09:28 PM, Han,Meng wrote: Hi Wei, Thank you for your reply. On Wed, 24 Jul 2013 02:08:36 +0800, Wei ZHOU wrote: I suggest updating the agent on host as well I run yum install cloudstack-agent on the kvm host, it told me that it's already the latest version. I found

Re: Review Request 12775: Migrate the dozens of ssh calls for KVM VmDataCommand to a single router command

2013-07-24 Thread Wido den Hollander
this, but it seems fine to me. I patched a running 4.1 cluster with this and works like a charm. DHCP entries were loaded at the same rate, but the user metadata went a lot faster. - Wido den Hollander On July 19, 2013, 9:20 p.m., Marcus Sorensen wrote

Re: [ACS4.1.1][BLOCKER] Unable to launch VNC Console to VSphere VMs

2013-07-24 Thread Wido den Hollander
Hi, I reverted this commit in the 4.1 branch: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commitdiff;h=a069f31f51d0ef1f255d85ef32d7649a5ec659c1 There has been no discussion about changing this API in the 4.1 series, I even think we can't simply do that for 4.2 either. You

Re: Review Request 12943: Replaced virsh() by python-libvirt functions

2013-07-25 Thread Wido den Hollander
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12943/#review23852 --- Ship it! Seems good to me! - Wido den Hollander On July 25

Re: [VOTE] Apache Cloudstack 4.1.1 (Second Round)

2013-07-27 Thread Wido den Hollander
+1 (binding) I've upgraded a couple of internal systems and even production systems to 4.1.1 We were facing a couple of bugs in production which lead me to deploy a homebrew version of 4.1.1 in our company. The only change is a very small change in the security groups script for something

Re: Review Request 12658: Corrected typos in log messages

2013-07-27 Thread Wido den Hollander
On 07/26/2013 11:41 PM, Animesh Chaturvedi wrote: This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/12658/ On July 18th, 2013, 9:48 a.m. UTC, *Wido den Hollander* wrote: Ship It! Wido did you commit the patch? If so this needs to be closed

Re: [VOTE] Whitespace changes to bylaws.mdtext

2013-07-30 Thread Wido den Hollander
+1 On 07/29/2013 11:55 PM, Noah Slater wrote: Hi, I'd like to make several changes to our by-laws, but before I continue, I've prepared a changset that tidies up whitespace and hard wraps. This will make it easier to edit. The only non-whitespace change my patch makes is to correct two

[ACS42][Request] CLOUDSTACK-1191

2013-07-31 Thread Wido den Hollander
Hi, I'd like to request a cherry-pick for b611394cca1bfb3e655212701562ca8b24a61034 into 4.2 This RBD code should have already been in there, but I completely forgot to do so. It changes code how the KVM Agent handles the RBD integration and it will enable snapshotting for RBD. Some time

Re: we like dev better then users :(

2013-08-01 Thread Wido den Hollander
On 08/01/2013 03:31 PM, Daan Hoogland wrote: I think the following list speaks for itself Although it's really good that you point this out I took the following decision for myself: I contribute to the project by resolving bugs and writing new features. In my case my colleague (Lennert)

Do we allow ENUM database types?

2013-08-01 Thread Wido den Hollander
Hi, I'm working on a disk cache setting for per disk offering which allows users to set it to: - none (current behaviour and default) - writeback - writethrough I've done some work in the disk-cache branch [0] where I created a new column called cache_mode in the disk_offering table. It's

Re: How to fix libvirt storage pool refresh issue?

2013-08-02 Thread Wido den Hollander
2013/7/16 Wido den Hollander w...@widodh.nl On 07/16/2013 12:27 AM, Marcus Sorensen wrote: I'm ok with a symptom fix on our end, if the root cause is in Libvirt we can't do much about that. This is the sort of patch that tends to get pulled into the regular update cycle

Re: [ACS42] Release Status Update: After Code Freeze Next Steps

2013-08-02 Thread Wido den Hollander
On 08/02/2013 11:22 AM, Dave Cahill wrote: Now that we've bumped the version number, do we need to create Upgrade420to430 and add it to engine/schema/src/com/cloud/upgrade/DatabaseUpgradeChecker.java ? Yes, I forgot that. I created the SQL file, but I didn't create the Java files. Wido

Re: Review Request 13223: (CLOUDSTACK-2729) use file lock to prevent concurrent refreshPool/deleteVolume on KVM shared storage pool

2013-08-02 Thread Wido den Hollander
add clear comments as to WHY this is in the code? Otherwise I'm afraid this will become legacy and in 6 months new committer won't have the slightest idea of why this is in there. - Wido den Hollander On Aug. 2, 2013, 6:39 a.m., Wei Zhou wrote

Re: How to fix libvirt storage pool refresh issue?

2013-08-02 Thread Wido den Hollander
(or the v2 https://www.redhat.com/archives/libvir-list/2013-July/msg00639.html) ASAP. I've been watching the thread, but it seems kind of dead. Wido -Wei 2013/8/2 Wido den Hollander w...@widodh.nl On 08/02/2013 01:55 AM, Edison Su wrote: Hi Wei, regarding to the bug CLOUDSTACK-2729, I

Re: 4.1.1 released yet? RPMs?

2013-08-05 Thread Wido den Hollander
Hi, No, it's not out there yet. The RPM and Deb packages will come online when the source has been released. It will be a minor upgrade, so it will just be a matter of installing the new packages and restarting the services. Wido On 08/05/2013 12:20 PM, France wrote: Hi All, is 4.1.1

Re: [ACS411] 4.1.1 status

2013-08-06 Thread Wido den Hollander
Hi Chip, On 08/05/2013 08:01 PM, Chip Childers wrote: Hi all, Here's where we are: DEBs (oss) are loaded into the cloustack.apt-get.eu repo. The DEBs contain snapshot in their version number. I don't think that is correct, is it? Wido RPMs (nonoss) are being built now and will be

KVM always defaulting to QCOW2 image formats

2013-08-06 Thread Wido den Hollander
Hi, I just encountered CLOUDSTACK-4114 [0] during my tests. I didn't encounter this before, but I just tried to restore from a snapshot and there it assumed the snapshot was in QCOW2 format, but it is actually a RAW device. In VolumeDoaImpl this is implemented: public ImageFormat

Re: Ubuntu noredist

2014-07-04 Thread Wido den Hollander
On 07/04/2014 03:36 PM, Sebastien Goasguen wrote: Hi, To fix: http://issues.apache.org/jira/browse/CLOUDSTACK-6892 on ubuntu we need a noredist build. anyone using Ubuntu out there, could check out the fix that was done for CentOS and provide a patch for Ubuntu ? I'll see if I can come

Re: Ubuntu noredist

2014-07-06 Thread Wido den Hollander
On 07/04/2014 08:48 PM, Wido den Hollander wrote: On 07/04/2014 03:36 PM, Sebastien Goasguen wrote: Hi, To fix: http://issues.apache.org/jira/browse/CLOUDSTACK-6892 on ubuntu we need a noredist build. anyone using Ubuntu out there, could check out the fix that was done for CentOS

Re: Ubuntu noredist

2014-07-08 Thread Wido den Hollander
by the tomcat system class loader instead of the web app class loader. Ok, I have no clue what that MySQL module does. So I'm not sure how to implement this on Ubuntu. Wido Cheers, Hugo On 7 jul. 2014, at 07:32, Wido den Hollander w...@widodh.nl wrote: On 07/04/2014 08:48 PM, Wido den

  1   2   3   4   5   6   7   8   9   10   >