Re: Managed storage with KVM

2013-09-17 Thread Mike Tutkowski
s like thin provisioning. I would be surprised if edison > didn't allow for this in the new storage framework. > On Sep 17, 2013 10:34 PM, "Mike Tutkowski" > wrote: > > > This should answer your question, I believe: > > > > * When you add primary storage

Re: [PROPOSAL] Storage Subsystem API Interface Additions

2013-09-18 Thread Mike Tutkowski
the same as doing multiple snapshot API commands. > >>>>>>> > >>>>>>> So really I would lean towards having the multiple snapshotting > >>>>>>> supported in the driver or storage subsystem, but not exposed to > the > >>>>>>> user. You can easy accomplish it by having a timed window on > >>>>>>> snapshotting. So every 10 seconds you do snapshots, if 5 requests > >>>>>>> have queued in the last 10 seconds, you do them all at once. This > >>>> could be > >>>>>> implemented as a framework thing. > >>>>>>> If your provider implements "SnapshotBatching" interface and that > has > >>>>>>> a getBatchWindowTime(), then the framework can detect that it > should > >>>>>>> try to queue up some snapshot requests and send them to the driver > in > >>>>>>> a batch. Or that could be implemented in the driver itself. I > would > >>>>>>> lean toward doing it in the driver and if that goes well, we look > at > >>>>>>> pulling the functionality into core ACS. > >>>>>>> > >>>>>>> Darren > >>>>>>> > >>>>>>> > >>>>>>> On Wed, Sep 18, 2013 at 5:22 AM, SuichII, Christopher < > >>>>>>> chris.su...@netapp.com> wrote: > >>>>>>> > >>>>>>>> I would like to raise for discussion the idea of adding a couple > >>>>>>>> methods to the Storage Subsystem API interface. Currently, > >>>>>>>> takeSnapshot() and > >>>>>>>> revertSnapshot() only support single VM volumes. We have a use > case > >>>>>>>> for snapshotting multiple VM volumes at the same time. For us, it > is > >>>>>>>> more efficient to snapshot them all at once rather than snapshot > VM > >>>>>>>> Volumes individually and this seems like a more elegant solution > >> than > >>>>>>>> queueing the requests within our plugin. > >>>>>>>> > >>>>>>>> Base on my investigation, this should require: > >>>>>>>> -Two additional API to be invoked from the UI -Two additional > >> methods > >>>>>>>> added to the Storage Subsystem API interface -Changes in between > the > >>>>>>>> API level and invoking the Storage Subsystem API implementations > (I > >>>>>>>> know this is broad and vague), mainly around the > SnapshotManger/Impl > >>>>>>>> > >>>>>>>> There are a couple topics we would like discussion on: > >>>>>>>> -Would this be beneficial/detrimental/neutral to other storage > >>>> providers? > >>>>>>>> -How should we handle the addition of new methods to the Storage > >>>>>>>> Subsystem API interface? Default them to throw an > >>>>>> UnsupportedOperationException? > >>>>>>>> Default to calling the single VM volume version multiple times? > >>>>>>>> -Does anyone see any issues with allowing multiple snapshots to be > >>>>>>>> taken at the same time or letting storage providers have a list of > >>>>>>>> all the requested volumes to backup? > >>>>>>>> > >>>>>>>> Please let me know if I've missed any major topics for discussion > or > >>>>>>>> if anything needs clarification. > >>>>>>>> > >>>>>>>> Thanks, > >>>>>>>> Chris > >>>>>>>> -- > >>>>>>>> Chris Suich > >>>>>>>> chris.su...@netapp.com > >>>>>>>> NetApp Software Engineer > >>>>>>>> Data Center Platforms - Cloud Solutions Citrix, Cisco & Red Hat > >>>>>>>> > >>>>>>>> > >>>> > >>>> > >> > >> > > -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud<http://solidfire.com/solution/overview/?video=play> *™*

Re: [PROPOSAL] Storage Subsystem API Interface Additions

2013-09-19 Thread Mike Tutkowski
inly around the > >>> SnapshotManger/Impl > >>> > >>> There are a couple topics we would like discussion on: > >>> -Would this be beneficial/detrimental/neutral to other storage > >>> providers? > >>> -How should we handle the addition of new methods to the Storage > >>> Subsystem > >>> API interface? Default them to throw an UnsupportedOperationException? > >>> Default to calling the single VM volume version multiple times? > >>> -Does anyone see any issues with allowing multiple snapshots to be > taken > >>> at the same time or letting storage providers have a list of all the > >>> requested volumes to backup? > >>> > >>> Please let me know if I've missed any major topics for discussion or if > >>> anything needs clarification. > >>> > >>> Thanks, > >>> Chris > >>> -- > >>> Chris Suich > >>> chris.su...@netapp.com > >>> NetApp Software Engineer > >>> Data Center Platforms ­ Cloud Solutions > >>> Citrix, Cisco & Red Hat > >>> > >>> > > > > -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud<http://solidfire.com/solution/overview/?video=play> *™*

Re: Managed storage with KVM

2013-09-20 Thread Mike Tutkowski
You appear to be correct. This is from the MS log (below). Discovery timed out. I'm not sure why this would be. My network settings shouldn't have changed since the last time I tried this. I am able to ping the KVM host from the MS host and vice versa. I'm even able to manually kick off a VM on

Re: Managed storage with KVM

2013-09-20 Thread Mike Tutkowski
2013 at 10:08 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > You appear to be correct. This is from the MS log (below). Discovery timed > out. > > I'm not sure why this would be. My network settings shouldn't have changed > since the last time I tried

Re: Managed storage with KVM

2013-09-20 Thread Mike Tutkowski
well to tell it the real ms IP. > On Sep 20, 2013 10:12 PM, "Mike Tutkowski" > wrote: > > > Here's what my /etc/network/interfaces file looks like, if that is of > > interest (the 192.168.233.0 network is the NAT network VMware Fusion set > > up): > &

Re: Managed storage with KVM

2013-09-20 Thread Mike Tutkowski
s an > agent log for the agent and one for the setup when it adds the host, both > in /var/log > On Sep 20, 2013 10:42 PM, "Mike Tutkowski" > wrote: > > > Is it saying that the MS is at the IP address or the KVM host? > > > > The KVM host is at 192.168.233.

Re: Managed storage with KVM

2013-09-20 Thread Mike Tutkowski
I get the same error running the command manually: mtutkowski@ubuntu:/etc/cloudstack/agent$ sudo /usr/sbin/service cloudstack-agent status * could not access PID file for cloudstack-agent On Fri, Sep 20, 2013 at 11:00 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > agent.

Re: Managed storage with KVM

2013-09-20 Thread Mike Tutkowski
When I re-deployed the DEBs, I didn't remove cloudstack-agent first. Would that be a problem? I just did a sudo apt-get install cloudstack-agent. On Fri, Sep 20, 2013 at 11:03 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > I get the same error running the co

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
Hey Marcus, I haven't yet been able to test my new code, but I thought you would be a good person to ask to review it: https://github.com/mike-tutkowski/incubator-cloudstack/commit/ea74b312a8a36801994500407fd54f0cdda55e37 All it is supposed to do is attach and detach a data disk (tha

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
nt. It won't run without complaining loudly if it > can't get to the mgmt server, and I didn't see that in your agent log, so > perhaps its not running. I assume you know how to stop/start the agent on > KVM via 'service cloud stacks agent'. > On Sep 21, 2013 3:

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
in /etc/cloudstack/agent change all INFO to > DEBUG. I imagine the agent just isn't starting, you can tail the log when > you try to start the service, or maybe it will spit something out into one > of the other files in /var/log/cloudstack/agent > On Sep 21, 2013 5:19 PM, "

Re: storage subsystem 2.0 question

2013-09-21 Thread Mike Tutkowski
t; already do this in the storage plugin? I can fetch the current > > size/used in the initialize, or even when hosts attach in the Listener > > (which I don't see any documentation on), but I think the plugin > > framework needs the equivalent of GetStorageStatsCommand if it doesn&

Re: storage subsystem 2.0 question

2013-09-21 Thread Mike Tutkowski
follow this practice (it does call into the hypervisors), but the idea is to get away from that. On Sat, Sep 21, 2013 at 11:07 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Hey Marcus, > > As far as I remember, grantAccess and revokeAccess are not invoked at all >

Re: storage subsystem 2.0 question

2013-09-21 Thread Mike Tutkowski
o true KVM cluster to handle this). On Sat, Sep 21, 2013 at 11:10 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Also, we can bring John Burwell into this as he had related comments > several months ago, but we did not want to have the storage plug-ins > calling into the hyp

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
target or how it likes to be > treated then I'd say that they should be named something less generic > than iScsiAdmStorage. > > On Sat, Sep 21, 2013 at 7:23 PM, Mike Tutkowski > wrote: > > Great - thanks! > > > > Just to give you an overview of what

Re: storage subsystem 2.0 question

2013-09-21 Thread Mike Tutkowski
t's where everything was done, so > that's what we made talk to the SAN. > > On Sat, Sep 21, 2013 at 11:19 PM, Mike Tutkowski > wrote: > > I believe, though, we should look into adding calls to grantAccess and > > revokeAccess for 4.3. > > > > For 4.2 I

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
Adding a connectPhysicalDisk method sounds good. I probably should add a disconnectPhysicalDisk method, as well, and not use the deletePhysicalDisk method. On Sat, Sep 21, 2013 at 11:38 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > That's an interesting comment,

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
eateCommand in > LibvirtComputingResource, since that's the only place > createPhysicalDisk is called, and it occurred to me that CreateCommand > might be skipped altogether when utilizing storage plugins. > > On Sat, Sep 21, 2013 at 11:38 PM, Mike Tutkowski > wrote: > >

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
lDisk is called, and it occurred to me that CreateCommand > might be skipped altogether when utilizing storage plugins. > > On Sat, Sep 21, 2013 at 11:38 PM, Mike Tutkowski > wrote: > > That's an interesting comment, Marcus. > > > > It was my intent that it should

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
Conversely, if the storage framework called the DestroyCommand for managed storage after the DetachCommand, then I could have had my remove SR/datastore logic placed in the DestroyCommand handling rather than in the DetachCommand handling. On Sun, Sep 22, 2013 at 12:06 AM, Mike Tutkowski

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
Same would work for KVM. If CreateCommand and DestroyCommand were called at the appropriate times by the storage framework, I could move my connect and disconnect logic out of the attach/detach logic. On Sun, Sep 22, 2013 at 12:08 AM, Mike Tutkowski < mike.tutkow...@solidfire.com>

Re: Managed storage with KVM

2013-09-21 Thread Mike Tutkowski
First step is for me to get this working for KVM, though. :) Once I do that, I can perhaps make modifications to the storage framework and hypervisor plug-ins to refactor the logic and such. On Sun, Sep 22, 2013 at 12:09 AM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > S

Re: storage subsystem 2.0 question

2013-09-21 Thread Mike Tutkowski
the hypervisors (as in StorageManager shouldn't be sending them). I believe it's VolumeApiService. For example, the AttachCommand being sent in VolumeApiService.sendAttachVolumeCommand. On Sat, Sep 21, 2013 at 11:43 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > I

Re: Managed storage with KVM

2013-09-23 Thread Mike Tutkowski
92.168.233.1 8250 Trying 192.168.233.1... Connected to 192.168.233.1. Escape character is '^]'. So that looks good. I turned on more info in the debug log, but nothing obvious jumps out as of yet. If you have any thoughts on this, please shoot them my way. :) Thanks! On Sun, Sep 2

Re: [PROPOSAL] adding [SOLVED] tag in mailing list subject

2013-09-23 Thread Mike Tutkowski
bers then the one who raised the issue please reply > >to the thread by adding [SOLVED] tag. > > > > > >Also please add the accumulated steps performed to solve it, this will > >helpful to other members when they gets the similar issues. > > > &

Re: Managed storage with KVM

2013-09-23 Thread Mike Tutkowski
he Java VM started? After a reboot, I assume the JVM is started automatically? How do you debug your KVM-side Java code? Been looking through the logs and nothing obvious sticks out. I will have another look. Thanks On Mon, Sep 23, 2013 at 2:15 PM, Mike Tutkowski < mike.tutkow...@solidfire.com&g

Re: Managed storage with KVM

2013-09-23 Thread Mike Tutkowski
Looks like it's running, though: mtutkowski@ubuntu:~$ ps -ef | grep jsvc 1000 7097 7013 0 14:32 pts/100:00:00 grep --color=auto jsvc On Mon, Sep 23, 2013 at 2:31 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Hey Marcus, > > Maybe you could give

Re: Managed storage with KVM

2013-09-23 Thread Mike Tutkowski
't > get far enough (say it's missing a class or something and can't > start). > > On Mon, Sep 23, 2013 at 2:33 PM, Mike Tutkowski > wrote: > > Looks like it's running, though: > > > > mtutkowski@ubuntu:~$ ps -ef | grep jsvc > > 1000 70

Re: Managed storage with KVM

2013-09-23 Thread Mike Tutkowski
-23 15:30:56,123 DEBUG [utils.script.Script] (main:null) Looking for call_firewall.sh Is there a log file for the Java code that I could write stuff out to and see how far we get? On Mon, Sep 23, 2013 at 3:17 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Thanks, Marcus &

Re: Managed storage with KVM

2013-09-23 Thread Mike Tutkowski
Weird...no such file exists. On Mon, Sep 23, 2013 at 4:54 PM, Marcus Sorensen wrote: > maybe cloudstack-agent.out > > On Mon, Sep 23, 2013 at 4:44 PM, Mike Tutkowski > wrote: > > OK, so, nothing is screaming out in the logs. I did notice the following: >

Re: Managed storage with KVM

2013-09-23 Thread Mike Tutkowski
init script on Ubuntu and see I'd you can decipher where > it sends stdout. > On Sep 23, 2013 5:21 PM, "Mike Tutkowski" > wrote: > > > Weird...no such file exists. > > > > > > On Mon, Sep 23, 2013 at 4:54 PM, Marcus Sorensen > >wrote: >

Re: Managed storage with KVM

2013-09-24 Thread Mike Tutkowski
ethod to see what's going on there. > > > > > > On Mon, Sep 23, 2013 at 5:45 PM, Marcus Sorensen >wrote: > > > >> It might be a centos specific thing. These are created by the init > scripts. > >> Check your agent init script on Ubuntu and see

Re: [PROPOSAL] move away from time-based releases and/or revamp release process

2013-09-24 Thread Mike Tutkowski
stack don't > always have time to look at the big picture and focus on the unstable > branches. We use the releases and focus on making the stable ones > better and/or fixing/adding our pet features, until the next stable > one comes around. Until the development branches st

Re: [PROPOSAL] move away from time-based releases and/or revamp release process

2013-09-24 Thread Mike Tutkowski
sted logic remains intact. This of course being > only part of 'all the' answers. > > regards, > > > On Tue, Sep 24, 2013 at 9:09 PM, Mike Tutkowski < > mike.tutkow...@solidfire.com> wrote: > > > I was a bit hesitant to keep pushing this because ther

Fwd: [PROPOSAL] move away from time-based releases and/or revamp release process

2013-09-25 Thread Mike Tutkowski
Accidentally just sent this to Daan. -- Forwarded message -- From: Mike Tutkowski Date: Wed, Sep 25, 2013 at 8:34 AM Subject: Re: [PROPOSAL] move away from time-based releases and/or revamp release process To: Daan Hoogland I think that would be a really good use of a

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
00:00:00 grep --color=auto jsvc On Wed, Sep 25, 2013 at 3:48 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > This appears to be the offending method: > > public String parseCapabilitiesXML(String capXML) { > > if (!_initialized) { > &

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
Out of curiosity, what do you get when you do 'lsmod | grep kvm' ? I > know you didn't end up using it, but the devcloud-kvm instructions for > vmware fusion tell you to ensure that your guest has hardware > virtualization passthrough enabled, I'm wondering if it isn't.

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
-sock srwxrwx--- 1 root libvirtd 0 Sep 25 16:05 /var/run/libvirt/libvirt-sock mtutkowski@ubuntu:/etc/cloudstack/agent$ ls -l /dev/kvm crw-rw+ 1 root kvm 10, 232 Sep 25 15:22 /dev/kvm On Wed, Sep 25, 2013 at 4:53 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > This

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
Sounds good. Thanks, Marcus! :) On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen wrote: > Ok, so the next step is to track that stdout and see if you can see > what jsvc complains about when it fails to start up the service. > > On Wed, Sep 25, 2013 at 4:56 PM, Mike Tutkow

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
with a return value of 5 On Wed, Sep 25, 2013 at 5:07 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Sounds good. > > Thanks, Marcus! :) > > > On Wed, Sep 25, 2013 at 5:04 PM, Marcus Sorensen wrote: > >> Ok, so the next step is to track that stdout an

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
the jna packages? > > On Wed, Sep 25, 2013 at 5:40 PM, Mike Tutkowski > wrote: > > I basically just leveraged the code you provided to redirect the output > on > > Ubuntu. > > > > Here is the standard err: > > >

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
, Sep 25, 2013 at 5:46 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Was there a step in the docs I may have missed where I was to install > them? I don't recall installing them, but there are several steps and I > might have forgotten that I did install them,

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
s), because we don't have > any clues as to whether it's your setup or master. > > On Wed, Sep 25, 2013 at 5:49 PM, Marcus Sorensen > wrote: > > ok, just a guess. I'm assuming it's still this: > > > > Caused by: java.lang.NoSuchMethodError: com.sun.jn

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
I mean switch over to 4.2 from master. :) On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > I can switch my branch over to master. I'm afraid master is not working > with Libvirt on Ubuntu, as well. > > > On Wed, Sep 25, 2013 a

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
It's been a bit rough getting this up and running, but at least I've been learning about how CloudStack works on KVM, so that's really good. On Wed, Sep 25, 2013 at 6:03 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > I mean switch over to 4.2 from master.

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
By simply switching to 4.2, will CS use the proper version of Libvirt or is there more I need to do since I've already run 4.3 on this Ubuntu install? Thanks On Wed, Sep 25, 2013 at 6:07 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > It's been a bit rough

Re: Managed storage with KVM

2013-09-25 Thread Mike Tutkowski
bs (or use the release > artifacts), remove the old packages, install the new ones, then you'll > have to clear the database and start fresh on 4.2. > > On Wed, Sep 25, 2013 at 6:09 PM, Mike Tutkowski > wrote: > > By simply switching to 4.2, will CS use the proper version of Libvir

Re: Libvirt-java 0.5.0 has been released

2013-09-25 Thread Mike Tutkowski
na > > - provided > > ${cs.jna.version} > > > > > > > > > > 2013/9/25 Wei ZHOU > > > >> I tried both java 6 and java 7. > >> build and install successfully > >> agent can not restart. > >> I

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
n /usr/share/cloudstack-agent/lib > , then it should be ok. > > -Wei > > > 2013/9/26 Mike Tutkowski > > > Hi, > > > > I've been having a difficult time getting the KVM agent on master to > start > > on Ubuntu 12.04. > > > > The t

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
(--configure): subprocess installed post-installation script returned error exit status 1 E: Sub-process /usr/bin/dpkg returned an error code (1) On Thu, Sep 26, 2013 at 8:45 AM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Let me update and try again and see if that s

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
OK, thanks! On Thu, Sep 26, 2013 at 2:52 PM, Wei ZHOU wrote: > Mike, > Sorry my fault. already fixed by commit > 522860c03de5d05126f92fc44b6e3f50ed8439f0 > Please pull the latest code. > > > 2013/9/26 Mike Tutkowski > > > Any thoughts on this error message? >

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
post-installation script returned error exit status 1 Errors were encountered while processing: cloudstack-agent E: Sub-process /usr/bin/dpkg returned an error code (1) On Thu, Sep 26, 2013 at 2:57 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > OK, thanks! > > > On Th

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
Hey Marcus, I implemented your recommendations regarding adding connect and disconnect methods. It is not yet checked in (as you know, having trouble with my KVM environment), but it is on GitHub here: https://github.com/mike-tutkowski/incubator-cloudstack/commit

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
Oh, SnapshotTestWithFakeData is just modified because the code wasn't building until I corrected this. It has nothing really to do with my real changes. On Thu, Sep 26, 2013 at 4:31 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Hey Marcus, > > I implemented

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
and the adaptor can decide if it needs to > do anything. > > Comments are attached to your commit, I just wanted to echo them here > on-list. > > On Thu, Sep 26, 2013 at 4:32 PM, Mike Tutkowski > wrote: > > Oh, SnapshotTestWithFakeData is just modified because the code wasn&#

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
> > Comments are attached to your commit, I just wanted to echo them here > on-list. > > On Thu, Sep 26, 2013 at 4:32 PM, Mike Tutkowski > wrote: > > Oh, SnapshotTestWithFakeData is just modified because the code wasn't > > building until I corrected this. It h

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
Also, if we went the non-CHAP route, before attaching a volume to a VM, we'd have to tell the plug-in to set up a volume access group. When a volume is detached from a VM, we'd have to tell the plug-in to delete the volume access group. On Thu, Sep 26, 2013 at 7:32 PM, Mike

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
ep 26, 2013 at 3:41 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Looks like the new code references cloudstack-agent-upgrade. > > I'm on Ubuntu 12.04, by the way. > > /var/lib/dpkg/info/cloudstack-agent.postinst: line 39: > /usr/bin/cloudstack-agent-upgrade

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
d be all the way > back in the plugin to avoid custom code for every adaptor that wants > to set details. > [Mike T.] If I'm not using the volumes.path field for anything, I can stick the IQN in volumes.path (as well as leaving it in volumes.iscsi_name, which is used elsewhere). That way

Re: 4.2 press plan?

2013-09-26 Thread Mike Tutkowski
ecific timeslot availability. > > > >I'm also going to give press@ a heads up that we are announcing and > >doing our own press outreach. > > > >> > >> Best regards, > >> > >> Karen > > -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud<http://solidfire.com/solution/overview/?video=play> *™*

Problem using DevCloud2 with 4.2

2013-09-26 Thread Mike Tutkowski
w we use DevCloud2? I started with a clean build, cleaned the DB, and had reset DevCloud2 to its initial state before running the setup script. Thanks! -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world

Re: Problem using DevCloud2 with 4.2

2013-09-26 Thread Mike Tutkowski
Eh...cancel my query here. I just repeated the steps and it worked this time. Odd Hopefully it was user error and this isn't a timing issue or something. On Thu, Sep 26, 2013 at 10:38 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Hi, > > I haven't tr

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
o problem there. But how will I know which volumes belong to a given storage pool if I have to rebuild that map? How will I even know which volumes are in use at all? Thanks On Thu, Sep 26, 2013 at 11:37 PM, Marcus Sorensen wrote: > On Thu, Sep 26, 2013 at 10:23 PM, Mike Tutkowski > wrote

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
ppen if you execute cloudstack-setup-agent? > > > 2013/9/27 Mike Tutkowski > > > Looks like the newly checked in code is looking for > > /usr/bin/cloudstack-agent-upgrade. > > > > I don't see that file in /usr/bin, however. > > > > I only see the

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
osts as needed. I'd actually rather not even bother with CHAP when using KVM. On Fri, Sep 27, 2013 at 12:06 AM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Hey Marcus, > > I agree that CHAP does not fulfill the same role as fencing. > > I think we're going to

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
es, is the attach-volume command invoked as many times as need be (depending on how many volumes need to be attached) when VM 1 is restarted on Host 2? On Fri, Sep 27, 2013 at 12:17 AM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Let me clarify this line a bit: > >

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
ld you paste the result of the following command in your source > directory? > "grep cloudstack-agent-upgrade debian/rules" > -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the c

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
found references in the source directory. On Fri, Sep 27, 2013 at 12:30 AM, Wei ZHOU wrote: > It is correct. > Have you re-created the cloudstack-agent deb files and uploaded to your > local apt repository? > > > 2013/9/27 Mike Tutkowski > > > Here you go

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
ain? > > > 2013/9/27 Mike Tutkowski > > > Yeah, I had cleaned, rebuilt the codebase, regenerated the DEBs, then > > apt-get update and apt-get install cloudstack-agent. > > > > I can try it again and see what happens. I thought I tried the process > > twice and got

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
ot;dpkg -i" to install it? > > I will test it on my local machine. > > > > 2013/9/27 Mike Tutkowski > > > Before re-installing the DEBs I run the following: > > > > #sudo apt-get remove --purge cloudstack-agent > > > > #sudo apt-get c

Re: add connect method on KVM storage code

2013-09-26 Thread Mike Tutkowski
anding - how it works with XenServer and VMware). On Fri, Sep 27, 2013 at 12:45 AM, Marcus Sorensen wrote: > On Fri, Sep 27, 2013 at 12:21 AM, Mike Tutkowski > wrote: > > Maybe I should seek a little clarification as to how live migration works > > in CS with KVM. > > &g

Re: Libvirt-java 0.5.0 has been released

2013-09-26 Thread Mike Tutkowski
Thanks for investigating this! Talk to you soon! On Fri, Sep 27, 2013 at 12:54 AM, Wei ZHOU wrote: > good night > > > 2013/9/27 Mike Tutkowski > > > Sounds good > > > > Might have to get back to you tomorrow, though. I have to get up early. > :) > >

Re: Libvirt-java 0.5.0 has been released

2013-09-27 Thread Mike Tutkowski
dstack-agent-upgrade > /var/log/cloudstack/agent > /usr/share/cloudstack-agent/lib/* > /usr/share/cloudstack-agent/plugins > > > 2013/9/27 Mike Tutkowski > > > Thanks for investigating this! > > > > Talk to you soon! > > > > > > On Fri, Sep 27, 20

Re: Libvirt-java 0.5.0 has been released

2013-09-27 Thread Mike Tutkowski
(1) On Fri, Sep 27, 2013 at 8:26 AM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Great - thanks, Wei! > > > On Fri, Sep 27, 2013 at 2:34 AM, Wei ZHOU wrote: > >> Mike, >> cloudstack-agent-upgrade is missing in cloudstack-agent installation. >> I

Re: Libvirt-java 0.5.0 has been released

2013-09-27 Thread Mike Tutkowski
+ str(bridges)) else: print("Upgrade succeed") On Fri, Sep 27, 2013 at 1:43 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Kind of made progress here. :) Looks like we have another problem. Is it > possible another item is missing from the scripts?

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
Sure, sounds good - let me know when it's up on Review Board and I can take a look. I made most of the changes you and I talked about: https://github.com/mike-tutkowski/incubator-cloudstack/commit/eb9b2edfc9062f9ca7961fecd5379b180ca3aed1 I have a new idea, though, that I think will sim

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
URL has changed to this: https://github.com/mike-tutkowski/incubator-cloudstack/commit/636cf78bcd9d32ae9f20c0ccd631fcf41b829d43 I've just been squashing my commits and sending them to GitHub as one commit. It should make it easier to see what's changed when comparing against what'

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
sense to me because it is CloudStack-managed storage (so CloudStack is calling into the hypervisor to create and delete these types of objects...it's managing them). On Fri, Sep 27, 2013 at 5:00 PM, Marcus Sorensen wrote: > On Fri, Sep 27, 2013 at 4:22 PM, Mike Tutkowski > wrote: >

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
them). > > > On Fri, Sep 27, 2013 at 5:00 PM, Marcus Sorensen wrote: > >> On Fri, Sep 27, 2013 at 4:22 PM, Mike Tutkowski >> wrote: >> > Sure, sounds good - let me know when it's up on Review Board and I can >> take >> > a look. >> > &

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
he end, we kind of have two different storage models in CloudStack: Non-managed (preallocated storage by admin) and managed (plug-in dynamically creates storage on a storage system). On Fri, Sep 27, 2013 at 6:46 PM, Marcus Sorensen wrote: > On Fri, Sep 27, 2013 at 6:03 PM, Marcus Sorensen > wrote: &

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
voked). Same idea for VMware. On Fri, Sep 27, 2013 at 6:46 PM, Marcus Sorensen wrote: > On Fri, Sep 27, 2013 at 6:03 PM, Marcus Sorensen > wrote: > > On Fri, Sep 27, 2013 at 5:16 PM, Mike Tutkowski > > wrote: > >> createAsync is just for creating the SAN (or whatever stor

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
, Marcus Sorensen wrote: > The plugin itself doesn't talk to the hypervisor. > On Sep 27, 2013 7:28 PM, "Mike Tutkowski" > wrote: > > > Yeah, we should bring John Burwell into this conversation. He had a > strong > > opposition to storage plug-ins tal

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
Sep 28, 2013 at 12:09 AM, Mike Tutkowski > wrote: > > Yes, you are correct that our SAN requires CHAP or for the host and > volume > > to be in a Volume Access Group. > > > > If CHAP is provided, it is used. If it fails for whatever reason, the > > Volume A

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
, say, 10,000 KVM hosts each using at least one SolidFire volume, you'd have 10,000 VAGs. That would be OK, though. On Sat, Sep 28, 2013 at 12:25 AM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > CHAP credentials are per SolidFire/CloudStack account. A volume on the &

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
currently > setting the chap info prior to the attach command. > > On Sat, Sep 28, 2013 at 12:25 AM, Mike Tutkowski > wrote: > > CHAP credentials are per SolidFire/CloudStack account. A volume on the > > SolidFire SAN belongs to an account. I have a one-to-one mapping be

Re: add connect method on KVM storage code

2013-09-27 Thread Mike Tutkowski
inst rouge nodes. CHAP won't protect this way either, but if we don't have a grantAccess and revokeAccess in the storage plug-in, then CHAP would just be the easier route to go. On Sat, Sep 28, 2013 at 12:30 AM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > That works.

Re: Libvirt-java 0.5.0 has been released

2013-09-28 Thread Mike Tutkowski
a:357) at com.cloud.agent.AgentShell.start(AgentShell.java:454) ... 5 more Cannot start daemon Service exit with a return value of 5 On Fri, Sep 27, 2013 at 1:45 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > Looks like listNetworks() is called a couple times in > cloudst

Re: Libvirt-java 0.5.0 has been released

2013-09-29 Thread Mike Tutkowski
00f3fc93e5f3e81a**b342f5b860<https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=e6fd794ca0b10a00f3fc93e5f3e81ab342f5b860> > > That should fix it! > > Wido > > > 2013/9/29, Mike Tutkowski **: >> >>> Hi Wei, >>> >>> So,

Re: [PROPOSAL] Provide Option to Quiesce VMs While Taking Snapshots

2013-09-30 Thread Mike Tutkowski
rk on formalizing a full functional spec if needed but wanted to > >get this up for discussion ASAP. > > > >I have created a JIRA ticket: > >https://issues.apache.org/jira/browse/CLOUDSTACK-4774 > > > >Thanks, > >Chris > >-- > >Chris Suich > >chris

Re: [PROPOSAL] Provide Option to Quiesce VMs While Taking Snapshots

2013-09-30 Thread Mike Tutkowski
VM quiescing should be sufficient for hypervisor snapshots, though, because you are presumably snapping the disks and the memory. On Mon, Sep 30, 2013 at 4:02 PM, Mike Tutkowski < mike.tutkow...@solidfire.com> wrote: > I would say 'no'. Let's say you have a DB app run

Re: [PROPOSAL] Provide Option to Quiesce VMs While Taking Snapshots

2013-09-30 Thread Mike Tutkowski
; chris.su...@netapp.com > NetApp Software Engineer > Data Center Platforms – Cloud Solutions > Citrix, Cisco & Red Hat > > On Sep 30, 2013, at 6:03 PM, Mike Tutkowski > wrote: > > > VM quiescing should be sufficient for hypervisor snapshots, though, > because

Re: [ANNOUNCE] New PMC member: Daan Hoogland

2013-10-01 Thread Mike Tutkowski
OUNCE] New PMC member: Daan Hoogland > > The Project Management Committee (PMC) for Apache CloudStack has asked > Daan Hoogland to join the PMC and we are pleased to announce that they have > accepted. > > Join me in congratulating Daan! > > -The CloudStack PMC > -

Hypervisor Questions

2013-10-01 Thread Mike Tutkowski
availability: Distributed Resource Scheduling: Thanks! -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud<http://solidfire.com/solution/overview/?video=play> *™*

Re: Hypervisor Questions

2013-10-01 Thread Mike Tutkowski
irstfit', 'userdispersing', 'userconcentratedpod_random', > 'userconcentratedpod_firstfit' : Order in which hosts within a cluster will > be considered for VM/volume allocation. > > That being said, after deployment there isn't any further

Re: Hypervisor Questions

2013-10-01 Thread Mike Tutkowski
support assigning a priority to a VM in case not all VMs can be restarted on the remaining resources? On Tue, Oct 1, 2013 at 6:35 PM, Mike Tutkowski wrote: > Thanks, Clayton! > > Yeah, copy/paste mistake there. :) I meant it as you said. > > > On Tue, Oct 1, 2013 at 4:54 PM, Cl

System offerings mixed in with Disk Offerings

2013-10-02 Thread Mike Tutkowski
Hi, I assume this is a mistake: http://imgur.com/XVBeNRf System offerings are mixed in with Disk Offerings (in master). -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.746.7302 Advancing the way the world uses the cloud<h

VolumeApiServiceImpl Question

2013-10-02 Thread Mike Tutkowski
meSizeInGb, which appears to be the problem. It is read from, but never written to (its default value is 0 since it is a 'long' member variable). Am I missing something here? Thanks! -- *Mike Tutkowski* *Senior CloudStack Developer, SolidFire Inc.* e: mike.tutkow...@solidfire.com o: 303.74

XenServer Question

2013-10-03 Thread Mike Tutkowski
x27;reserved' or 'provisioned'. On these systems, 'used' is always less than or equal to 'allocated'. Typically 'used' is less than 'allocated' because as 'used' approaches 'allocated', 'allocated' is expan

Re: System offerings mixed in with Disk Offerings

2013-10-03 Thread Mike Tutkowski
It appears to be an API issue. I've opened CLOUDSTACK-4801 for this. On Wed, Oct 2, 2013 at 2:35 PM, Mike Tutkowski wrote: > Sure. > > Preparing for a meeting now, but I should be able to do this later today. > > By the way, when you go to the Add Volume dialog and d

  1   2   3   4   5   6   7   8   9   10   >