Cloud Storage and Image upload - Instance snapshot via deltacloud core API

2010-07-12 Thread mar...@redhat.com
Task: "Implement Cloud Storage via the Deltacloud API where available, in order to ultimately enable custom Image upload. In addition and where image upload is not (yet) supported, implement 'Instance Snapshot' functionality, where available. " Hi All, David, Michal and myself had a discussion

Re: Cloud Storage and Image upload - Instance snapshot via deltacloud core API

2010-07-15 Thread mar...@redhat.com
Hi Jeff, comments in-line: On 15/07/10 02:17, Jeff Darcy wrote: On 01/-10/-28163 02:59 PM, mar...@redhat.com wrote: I think there are two independent subtasks here: **Work out the operations for the generic cloud storage (i.e. s3/cloudfiles) and implement 'Blob Management'. This w

Re: [PATCH core] Added possibility to configure supported collections per driver

2010-07-15 Thread mar...@redhat.com
+1 ACK ... great stuff - this is a much neater way of doing this - applied cleanly and started up gogrid and ec2 drivers with no explosions. On 15/07/10 12:46, mfoj...@redhat.com wrote: --- server/lib/deltacloud/base_driver/base_driver.rb | 10 ++ .../lib/deltacloud/drivers/gogri

deltacloud API spec for DMTF

2010-08-12 Thread mar...@redhat.com
Hi, attached pdf is the current version of Deltacloud API spec to be submitted to the DMTF Cloud Management Working Group . I have to submit this by tomorrow (Friday 13th) afternoon to meet the deadline so if anyone has any comments/wants to add something please let me know before then, mar

Re: deltacloud API spec for DMTF

2010-08-12 Thread mar...@redhat.com
:) I think you are right :) thanks On 12/08/10 10:54, Sassy Natan wrote: I think you forgot to attach the PDF file On Thu, Aug 12, 2010 at 12:50 PM, mar...@redhat.comwrote: Hi, attached pdf is the current version of Deltacloud API spec to be submitted to the DMTF Cloud Management Working Gro

Re: deltacloud API spec for DMTF

2010-08-12 Thread mar...@redhat.com
No - it was attached first time - unfortunately looks like we cant do attachments here... On 12/08/10 10:57, mar...@redhat.com wrote: :) I think you are right :) thanks On 12/08/10 10:54, Sassy Natan wrote: I think you forgot to attach the PDF file On Thu, Aug 12, 2010 at 12:50 PM, mar

Re: deltacloud API spec for DMTF

2010-08-12 Thread mar...@redhat.com
Ok, you can access the pdf from: https://fedorahosted.org/pipermail/deltacloud-devel/attachments/20100812/8af80ac5/attachment-0001.pdf please let me know if you have any issues and I will send it to you direct, marios On 12/08/10 10:58, mar...@redhat.com wrote: No - it was attached first

Re: Basic Blobstore functions - read containers and blobs

2010-08-13 Thread mar...@redhat.com
On 13/08/10 22:30, mandr...@redhat.com wrote: individual blobs for Amazon S3 and EC2 sorry that should be Amazon S3 and Rackspace Cloudfiles

'A Blob by any other name'...

2010-08-26 Thread mar...@redhat.com
Hi, I have so far been using the nouns 'Container' and 'Blob' for the entities in our (developing) cloud storage API. It was always the intention to change these at some point so I thought it would be a good idea to get some input from the wider group. A 'blob' is a uniquely named collection of

Re: 'A Blob by any other name'...

2010-08-27 Thread mar...@redhat.com
Thanks for all your comments... I'll keep this thread open 'til next week and see if there are any more takers before we decide, all the best, marios (Happy Friday!) On 26/08/10 10:29, mar...@redhat.com wrote: Hi, I have so far been using the nouns 'Container' and '

Re: 'A Blob by any other name'...

2010-09-06 Thread mar...@redhat.com
'buckets' and 'blobs' it is then... On 30/08/10 13:11, Michal Fojtik wrote: On 30/08/10 08:11 -0400, Jeff Darcy wrote: On 08/26/2010 05:49 PM, David Lutterkort wrote: On Thu, 2010-08-26 at 10:29 +0100, mar...@redhat.com wrote: Hi, I have so far been using the nouns &

Re: ['PATCH' 2/4] Adds haml views for buckets and blobs - part of blobstore API

2010-09-21 Thread mar...@redhat.com
Hi Jeff, thanks for your comments: I'm not very fluent in HAML (sigh), but it looks to me like: hehe - me neither (monkey see, do :) ) basically i poked at the existing haml templates until things stopped blowing up buckets/index.html and buckets/show.html will list blobs within e

Re: ['PATCH' 2/4] Adds haml views for buckets and blobs - part of blobstore API

2010-09-23 Thread mar...@redhat.com
Hi David, On 22/09/10 23:31, David Lutterkort wrote: On Mon, 2010-09-20 at 19:52 +0100, mandr...@redhat.com wrote: Looks good. One question: diff --git a/server/views/buckets/show.xml.haml b/server/views/buckets/show.xml.haml new file mode 100644 index 000..e61470f --- /dev/null +++ b/se

Re: ['PATCH' 3/4] Adds driver methods and helpers for blobstore api - rackspace cloudfiles, amazon s3, micfosoft azure. Also helper method for 'streaming' using (thin) eventmachine async callback.

2010-09-23 Thread mar...@redhat.com
First off: can we has a mock driver, too ? off corrs we can haz mock draiva. srsly. As we discussed offline, we should also set Content-Type/Length from whatever the backend cloud sends us. David I fixed up the content-length/type and will push. The mock driver can be a further patch (

Re: ['PATCH' 4/4] Adds buckets collection to server.rb and other changes for blobstore api

2010-09-23 Thread mar...@redhat.com
Hi David - got rid of all this stuff from server.rb. Michal had put the relevant code into respond_to but forgot to push. Its now there in svn commit: r1000397, marios On 23/09/10 00:26, David Lutterkort wrote: On Mon, 2010-09-20 at 19:52 +0100, mandr...@redhat.com wrote: From: marios ---

Re: ['PATCH'] Tidy up /server/lib/sinatra/respond_to.rb - 'stock' sinatra code was stripping off extension in requests (myblob.txt) and trying to guess content type based on that. This caused problems

2010-09-24 Thread mar...@redhat.com
Actually, I need to NACK this patch because lot of our specs are failing with this code. See attached output of 'rake test': Btw. after quick look on failed tests I think we will need update our tests to omit usage of '.format' and switch to '?format' instead. ok mate thanks, yes forgot that

Re: Various core fixes

2010-09-30 Thread mar...@redhat.com
ACK. Tried this out with rackspace and ec2 drivers... '?format=' works very well. Also: * cd deltacloud/server; rake test ==> 55 tests, 0 assertions, 0 failures, 0 errors * cd deltacloud/tests; rake cucumber ==> 44 scenarios (44 passed), 310 steps (310 passed) * cd deltacloud/test

Re: storage volume support

2010-10-05 Thread mar...@redhat.com
Hi Toby, On 05/10/10 15:13, Toby Crawley wrote: Deltacloud currently has limited storage volume support (index, show) for ec2 only. We would like to provide some storage volume management functionality in SteamCannon, and would prefer that it be via Deltacloud. great! Are there any plans to

Re: Question about instance states

2010-10-07 Thread mar...@redhat.com
What does the Linode state machine look like? It would be helpful if you could list all the Linode states? RE 'boot failed', can that not be 'stopped'? I mean, you try to start an instance and it doesn't start (due to whatever error), so it ends up as 'stopped'? marios On 07/10/10 12:27, L

Re: Question about instance states

2010-10-07 Thread mar...@redhat.com
You're right. It makes sense so I could define it as STOPPED. :) Woah there! I don't know about that, it was just one possible suggestion - again I don't know anything about Linode and it might still be tricky to map the 'failed' to stopped - e.g. what's the trigger? eg: Stopped to running

Re: Installation

2010-10-13 Thread mar...@redhat.com
Hi Burr, in addition to what Tomas has said, in order to run the ec2 driver for deltacloud you need the 'amazon-ec2' gem and the 'right_aws' gems ('sudo gem install amazon-ec2' and 'sudo gem install right_aws'). Please do join us on #deltacloud (irc freenode) and we can hopefully get you up

Re: Installation

2010-10-13 Thread mar...@redhat.com
this can cause confusion. For now however this is a necessary evil, marios On 13/10/10 11:29, André Dietisheim wrote: Hi Marios as far as I remember the right_aws is not needed (I checked with my current gems and I dont have it and things are running here). Cheers André On 10/13/2010 10:

Re: Installation

2010-10-13 Thread mar...@redhat.com
I should clarify, the problem was not with the 'amazon-ec2' gem but rather with the 'aws/s3' gem (which we were using prior to the righscale one). marios On 13/10/10 11:32, mar...@redhat.com wrote: Hi Andre, right_aws is needed if you want to use s3 - there was a probl

Re: cannot start deltacloudd since gem update

2010-10-20 Thread mar...@redhat.com
Hi Andre, need more info - perhaps a list of gems with versions. Probably the best though is to join the irc channel and we can chat there, marios On 20/10/10 20:31, André Dietisheim wrote: Hi guys I just updated my gems (sudo gem update) and fail to start deltacloudd since then.l Since I am

Re: Add version checking from client to API

2010-10-26 Thread mar...@redhat.com
Hi Max, * developers get the latest version of code from the git-svn repo * patches made against that code and posted to this list * other developers can apply the patch to their code and ack or nack accordingly * if you get at least one ack and no nack then the code is pushed into the core rep

Re: Fixed xml_to_class method in client (rev 2)

2010-10-27 Thread mar...@redhat.com
On 15/10/10 18:42, mfoj...@redhat.com wrote: Hi, Just a little update to get this rolling under Rails environment. -- Michal ACK * all 4 patches apply cleanly - minor whitespace issues (yes, I'm a fine one to talk about that): ===> [PATCH core 2_4] Fixed xml_to_class method in client.

Re: [VOTE] release deltacloud 0.1.0

2010-11-02 Thread mar...@redhat.com
On 30/10/10 03:01, David Lutterkort wrote: Hi, as mentioned previously here, I uploaded a release candidate for deltacloud 0.1.0. The release candidate can be found at http://people.apache.org/~lutter/deltacloud/0.1.0/rc1/ Please vote on whether this should become the official 0.1.0 release by

Re: DeltaCloud Acceptance Test

2010-11-10 Thread mar...@redhat.com
Hi Sang-Min, We’re planning to get Eucalyptus working with DeltaCloud. Probably, we’re going to use the existing EC2 drivers with some patches. awesome! Please give us a shout for any help - either here or come to the freenode irc channel #deltacloud. I have one question regarding testi

API driver methods and parameters

2010-11-12 Thread mar...@redhat.com
Hi, I am (finally) back onto working on the blobstore. I wanted to get some opinions (alternatively, find out if anyone feels strongly either way) about the driver method signatures. This is not terribly important but its a choice all the same. So far most driver methods (i.e. defined in base_

Re: API driver methods and parameters

2010-11-12 Thread mar...@redhat.com
less clear/harder to follow/more like magic :) if we are hiding all our parameters. I don't know which is the overriding concern. marios On 12/11/10 15:19, Ladislav Martincik wrote: Hi, On Nov 12, 2010, at 2:11 PM, mar...@redhat.com wrote: Hi, I am (finally) back onto working on the blob

Re: Initial EC2 driver rewrite (rev 1)

2010-11-12 Thread mar...@redhat.com
Hi Michal, I just did some really quick and dirty testing for this - I was mostly interested to see if they solved the regions issue with the new gem... but I didn't get that far. The patches apply fine but when I run I am getting lots of errors... Get /images gives: " # Aws::Ec2 returne

Re: Initial EC2 driver rewrite (rev 1)

2010-11-15 Thread mar...@redhat.com
I vote we default to 'images owned by current user' - apart from being more 'practical' (assuming the user has < 500 images ;) ) this is also typically what we do with other providers. However, it should be possible to keep the option open for listing all 'public' images via a parameters in o

Re: EC2 driver rewrite (rev 2) + Tobi patches

2010-11-19 Thread mar...@redhat.com
nack Theres too much going on in this patch series - I specifically looked at whether the new gem and/or new driver breaks buckets (and wanted to check region support but couldn't get that far). I cannot get a bucket listing - looks like its a problem with the aws gem (tried through irb and

Re: Fix for #DTACLOUD-9: Removed start action from EC2 state machine

2010-11-25 Thread mar...@redhat.com
Amazon allows 'stopped' ==> 'start' for EBS backed instances (http://docs.amazonwebservices.com/AWSEC2/latest/UserGuide/index.html?Concepts_BootFromEBS.html). The 'problem' as far as deltacloud is concenred is that when you 'stop' an instance, ec2 takes a while to actually remove it from your av

Re: Create - Delete Blob for S3

2010-11-25 Thread mar...@redhat.com
Ok, Please ignore this patch, Michal pushed something to core after this patch was sent which means it will now not apply. I will have to rebase and send again, marios On 25/11/10 14:32, mandr...@redhat.com wrote: Adds create blob and delete blob operations for blobstore API: * Functionali

Re: EC2 driver rewrite (rev 2) + Tobi patches

2010-11-26 Thread mar...@redhat.com
, I'll pick this up Monday. With risk of this last point being overlooked - I propose that we split this patch-bomb (nuke?) into its constituent parts - for sure the new ec2 driver warrants its own stand-alone patch. marios On 25/11/10 12:25, Michal Fojtik wrote: On 19/11/10 13:39 +0200,

Re: [PATCH core] Added ASF license header to files

2010-12-03 Thread mar...@redhat.com
ACK (but reminder to fix it so you don't push the new ec2 driver [or old one even]) On 23/11/10 17:00, mfoj...@redhat.com wrote: From: Michal Fojtik --- server/config.ru | 20 +- server/deltacloud.rb | 21 +- server/lib/de

Re: Fixes in GoGrid driver

2010-12-03 Thread mar...@redhat.com
ack - BUT I don't have gogrid account so didn't test 'live' - patches apply cleanly against latest core and server runs fine with no explosions. I agree that we can just keep the hardware profile code for 'future use' - its not that big in any case, marios On 02/12/10 11:52, mfoj...@redhat.c

Re: [PATCH] Adds 'create_blob' and 'delete_blob' for rackspace cloudfiles. Also some minor mods to haml for aesthetics (move 'delete' button and only display when bucket.size == 0)

2010-12-03 Thread mar...@redhat.com
thanks, pushed On 03/12/10 13:40, Michal Fojtik wrote: On 29/11/10 16:53 +0200, mar...@redhat.com wrote: Resending this ACK ;-) From: marios ACK. Code looks safe to me. EC2 driver fix is backported also for new EC2 driver. -- Michal --- server/lib/deltacloud/drivers/ec2/ec2_driver.rb | 4

Re: [PATCH] Adds create_blob and delete_blob for the Microsoft Azure driver

2010-12-03 Thread mar...@redhat.com
Ok thanks Michal, made the edit and pushed On 03/12/10 13:40, Michal Fojtik wrote: On 02/12/10 19:08 +0200, mar...@redhat.com wrote: Hi, I'm not going to test this with live Azure (don't have an Account ;) just 1 inline code comment: Otherwise code looks sane to me, ACK. -- Mic

Re: [PATCH core 1/3] Added warning for unhandled exception. This will show just 'visible' message to developer, that he needs to 'catch' this exception and display it as an XML error to client instead

2010-12-07 Thread mar...@redhat.com
ack to all 3, apply fine and all working ok. Only just noticed the 'catched_exception_list' mechanism, this is very nice - didn't realise we could define these per driver (i think so far we only have this for ec2). marios On 07/12/10 13:40, mfoj...@redhat.com wrote: From: Michal Fojtik ---

Re: [PATCH core] Added 'assign_address' for instance (EC2 Elastic IP)

2010-12-07 Thread mar...@redhat.com
Ack, applied fine, runs fine. I fired up an instance and associated an address which all worked ok. comments: i thought it would be nicer if we had some kind of 'list' of available addresses rather than a text field. I quickly realised this is dependent on 'ip address management' functions whi

Re: [VOTE] release deltacloud 0.1.0

2010-12-07 Thread mar...@redhat.com
I believe Michal went through the code and sent out some patches with the missing license headers ("[PATCH core] Added ASF license header to files" 23 Nov). These have been acked so they should be in the latest version of core soon marios On 07/12/10 16:57, Carl Trieloff wrote: On 11/22/20

Re: Added support for Address collection to API

2010-12-08 Thread mar...@redhat.com
big ack, this is a great addition to the api. Only comment is *make sure* we can fit this model the way gogrid 'do ip addresses' before you push. re Mark's comments on the 'subcollection' - this is an intuitive approach and a good fit for the way ec2 'does ip addresses'. In fact we already us

Re: [PATCH] Allow setting the provider on the server side, and implement region overriding in the ec2 driver based off of the provider.

2010-12-09 Thread mar...@redhat.com
ack, Toby should I push this? What are we doing about getting you commit rights? I am assuming that 'API_PROVIDER' is what AWS call the 'Service Endpoint' right? As in http://docs.amazonwebservices.com/AWSEC2/2010-08-31/DeveloperGuide/index.html?Using_Endpoints.html# - so we should document t

Fwd: Announcing Amazon S3 Large Object Support

2010-12-10 Thread mar...@redhat.com
streaming uploads/downloads of blobs just got even more important - amazon announce blob size is now max 5 terabytes (was 5 gigabytes) marios Original Message Subject:Announcing Amazon S3 Large Object Support Date: Fri, 10 Dec 2010 09:35:57 + (UTC) From: Amazon

Re: Various fixes in REST (status codes, etc)

2010-12-10 Thread mar...@redhat.com
after chatting with Michal on irc, i will ack-ish this patch :) Basically it needs to be reworked, comments below: On 07/12/10 16:05, mfoj...@redhat.com wrote: Hi, This patch includes a lot of REST-specific fixes to be more 'RESTish' ;-) Some notes: * Start action on stopped instance (EC2 es

Re: [PATCH] Allow setting the provider on the server side, and implement region overriding in the ec2 driver based off of the provider.

2010-12-10 Thread mar...@redhat.com
Hi Toby On 10/12/10 14:02, Toby Crawley wrote: On 12/10/2010 02:14 AM, mar...@redhat.com wrote: ack, Toby should I push this? What are we doing about getting you commit rights? I don't yet have commit rights, so if you could push this, that would be great. Let me send a new patch

Re: Allow client to fetch drivers and regions

2010-12-10 Thread mar...@redhat.com
Hi Toby On 10/12/10 14:10, Toby Crawley wrote: Michal: Should we use the more generic 'providers' at this level, instead of 'regions'? Not all drivers will support regions, but they may provide some other separation concept. Also, you refer to the EU region as 'eu', instead of the full region

Re: [RELEASE] Deltacloud 0.1.0

2010-12-17 Thread mar...@redhat.com
Hi Toby, On 17/12/10 17:06, Toby Crawley wrote: Congrats on the first Apache release! (more below) On Dec 16, 2010, at 6:24 PM, David Lutterkort wrote: At long last, the release of Deltacloud 0.1.0 is available. The release consists of four files total: the server and the Ruby client, in ge

issue with aws gem v.2.4.0 (latest) used by ec2 driver

2011-01-17 Thread mar...@redhat.com
Hi, whilst trying to catch up with the project I came across an issue with the latest version of the aws gem (2.4.0) which is used by the ec2 driver... running deltacloudd -i ec2 gives: " # /usr/lib/ruby/gems/1.8/gems/aws-2.4.0/lib/awsbase/awsbase.rb:33: undefined method `require_relative' for

Re: User metadata for EC2 blobs - first cut

2011-01-21 Thread mar...@redhat.com
Hi, pls ignore as this patch has been succeeded by a newer version - Fri 21 Jan 'user metadata for blob creation - S3, Cloudfiles, Azure' marios On 20/01/11 00:25, mar...@redhat.com wrote: As it says on the tin - this is a first cut at user metadata for ec2. This is not a full so

Re: [PATCH] Adds ability to specify arbitrary user metadata (KEY-VALUE) for S3, Cloudfiles and Azure, during blob creation.

2011-01-24 Thread mar...@redhat.com
On 22/01/11 02:14, David Lutterkort wrote: Some comments below: +def replace_hash_keys(hash, pattern) Nit pick: what you call 'pattern' is really the replacement. The Ruby way to do something like this is to define it directly in the Hash class, i.e. doing something like class H

Re: user metadata for blob creation - S3, Cloudfiles, Azure

2011-01-25 Thread mar...@redhat.com
On 21/01/11 21:34, mar...@redhat.com wrote: This adds the ability to put arbitrary user metadata during blob creation for Amazon S3, Rackspace Cloudfiles and Microsoft Azure. As previously mentioned, this doesn't include the ability to update/delete individual metadata (but planned for

Re: [VOTE] release deltacloud 0.2.0

2011-01-26 Thread mar...@redhat.com
+1 for release - minor point and at risk of being pedantic, you probably want to update server.rb to set the api version to '0.2.0' ( I tried http://people.apache.org/~lutter/deltacloud/0.2.0/rc1/deltacloud-core-0.2.0.tgz and version reported in xml and html as 0.1.0). marios On 26/01/11 01

Re: user metadata for blob creation [v.2.0] - S3, Cloudfiles, Azure

2011-01-27 Thread mar...@redhat.com
On 25/01/11 22:04, mar...@redhat.com wrote: This is v2 of the upload blob metadata patch series - allows uploading of arbitrary blob metadata during blob creation for amazon s3, rackspace cloudfiles and microsoft azure. Includes fixes suggested by lutter in previous thread - 21st Jan 2011

Re: [VOTE] release deltacloud 0.2.0 rc2

2011-01-28 Thread mar...@redhat.com
+1 marios On 27/01/11 19:03, David Lutterkort wrote: Hi all, I just uploaded the second release candidate for Deltacloud 0.2.0. The rc is available from http://people.apache.org/~lutter/deltacloud/0.2.0/rc2/ The rc2 was necessary because rc1 reported an incorrect API version. Please vote o

Re: [PATCH] Adds ability to specify arbitrary user metadata (KEY-VALUE) for S3, Cloudfiles and Azure, during blob creation

2011-01-28 Thread mar...@redhat.com
y' to a hash), marios On 28/01/11 03:04, David Lutterkort wrote: On Tue, 2011-01-25 at 22:04 +0200, mar...@redhat.com wrote: From: marios ACK, with a few nits. diff --git a/server/lib/deltacloud/drivers/azure/azure_driver.rb b/server/lib/deltacloud/drivers/azure/azure_driver.rb

Re: user metadata for blob creation [v.2.0] - S3, Cloudfiles, Azure

2011-01-28 Thread mar...@redhat.com
On 25/01/11 22:04, mar...@redhat.com wrote: This is v2 of the upload blob metadata patch series - allows uploading of arbitrary blob metadata during blob creation for amazon s3, rackspace cloudfiles and microsoft azure. Includes fixes suggested by lutter in previous thread - 21st Jan 2011

Re: [PATCH] Introduces blob metadata - Adds ability to specify arbitrary user metadata (KEY-VALUE) for S3, Cloudfiles and Azure, during blob creation

2011-01-31 Thread mar...@redhat.com
_array two dimensional array and ... iterate over the user_meta array etc etc). Out of curiosity where are you getting 'ruby best practice' from (e.g. can you recommend a good book/site/blog etc?) many thanks, marios On 31/01/11 11:28, Michal Fojtik wrote: On 28/01/11 20:15 +020

Re: [PATCH] Introduces blob metadata - Adds ability to specify arbitrary user metadata (KEY-VALUE) for S3, Cloudfiles and Azure, during blob creation

2011-01-31 Thread mar...@redhat.com
Ok, I have changed the code to use .inject - its a new toy and its pretty cool. I will let this sit till tomorrow and if there are no other objections I will commit this code (aka I *aint* sendin out another patch unless someone asks me nicely). Very good example of how to use .inject can be

Re: [PATCH] Introduces blob metadata - Adds ability to specify arbitrary user metadata (KEY-VALUE) for S3, Cloudfiles and Azure, during blob creation

2011-02-01 Thread mar...@redhat.com
adata key). So, especially for Michal: waz_blob.metadata.inject({}) { |result_hash, (k,v)| blob_metadata[k]=v if k.to_s.match(/x_ms_meta/i)} :) thanks marios On 01/02/11 17:08, Michal Fojtik wrote: On 31/01/11 22:52 +0200, mar...@redhat.com wrote: Yes, actually it's http://rubybestp

Re: Run command on instance (Rackspace)

2011-02-01 Thread mar...@redhat.com
Michal, the patch applies cleanly but I couldn't get it to run - ping me on irc tomorrow afternoon and we can see if I'm doing something silly. For reference I used curl to launch the instance like: curl -i -d 'image_id=51' -d 'realm_id=1' -d 'hwp_id=1' -d 'name=myShinYMachine' --user 'BLA:BLA

Re: Create images from running or stopped EBS instances (EC2)

2011-02-03 Thread mar...@redhat.com
Hey Michal, here's a copy/paste from the notes I made about snapshots back in July - might be useful to have this in one place/save some time looking at the APIs (AWS, Rackspace, Rimu, Gogrid, Terremark): : Q. Which of our currently supported clouds allows 'register custom Image from clou

Issue with S3 API and creating buckets that already exist (and owned by you)

2011-02-04 Thread mar...@redhat.com
Hi, Michal reported an issue with the aws s3 (ec2) in teambox https://teambox.com/projects/deltacloud: " I recently found that when you create a new bucket in EC2 and you use name which is already taken by another bucket it will always return 'true' instead of throwing an exception. Seems li

Re: Support for OPTIONS and HEAD calls in API

2011-02-07 Thread mar...@redhat.com
On 05/02/11 02:54, David Lutterkort wrote: (btw, is there a command line tool that will generate OPTIONS requests ? I had to try this with telnet) behold the awesomeness of curl; the -X flag allows you to set pretty much any 'method' you like: "curl -X OPTIONS --user 'name:password' http://l

Re: Get and Set user metadata for blobs

2011-02-07 Thread mar...@redhat.com
On 02/02/11 21:05, mar...@redhat.com wrote: Note: if you intend to test the Azure driver There was an ommission in the azure gem (latest 1.0.3) which caused problems with setting metadata. I've made the fix and issued a pull request to the author ( https://github.com/johnnyhalife/waz-st

Re: [PATCH] Adds get and set (user-defined) blob metadata for azure and cloudfiles drivers

2011-02-07 Thread mar...@redhat.com
On 07/02/11 17:45, Michal Fojtik wrote: On 02/02/11 22:05 +0200, mar...@redhat.com wrote: ACK. Code looks good, just small inline comment about returning some content / status code from HEAD and POST blocks. +#get blob metadata +head '/api/buckets/:bucket/:blob' do + @blob_id = pa

Re: [URGENT] - Missing report scheduled for February 2011

2011-02-14 Thread mar...@redhat.com
I've filled in some info regarding release 0.2.0 (copied from Lutter's post about the release); still needs a mentor to sign this off though, marios On 13/02/11 19:52, Mohammad Nour El-Din wrote: Hi... Would you please provide your report scheduled for February 2011 on [1] ?. I would like

Re: Rackspace driver update (rev 2)

2011-02-14 Thread mar...@redhat.com
On 14/02/11 17:19, mfoj...@redhat.com wrote: Hi, Sorry for reposting this patch. This patches will add support for creating images from instances inside Rackspace. This features is part of 'Create Image from Instance' task. -- Michal came across a couple of issues: *The password reporti

Re: [PATCH core 3/3] Fixed run_on_instance and launching instance with default HWP

2011-02-15 Thread mar...@redhat.com
runoninstance gave me a 'execution expired error' [marios@marios deltacloud]$ curl -F 'cmd=uname -a' -F 'password=bla' --user 'foo:bar' http://localhost:3001/api/instances/615657/run?format=xml backend_error 500 Deltacloud::Runner::InstanceSSHError On 15/02/11 13:40, mfoj..

Re: [PATCH core 3/3] Fixed run_on_instance and launching instance with default HWP

2011-02-15 Thread mar...@redhat.com
On 15/02/11 22:33, Michal Fojtik wrote: On Feb 15, 2011, at 9:16 PM, mar...@redhat.com wrote: Hi, runoninstance gave me a 'execution expired error' [marios@marios deltacloud]$ curl -F 'cmd=uname -a' -F 'password=bla' --user 'foo:bar' http://localhost:

Re: [PATCH core 3/3] Fixed run_on_instance and launching instance with default HWP

2011-02-15 Thread mar...@redhat.com
On 15/02/11 22:33, Michal Fojtik wrote: Your instance needs to be in RUNNING state in order to execute some commands on it. This error usually happens if instance is not in RUNNING state or SSH is not started. Can you please try it again? definitely in running state - same error Btw. tes

Re: [PATCH core 3/3] Fixed run_on_instance and launching instance with default HWP

2011-02-16 Thread mar...@redhat.com
On 16/02/11 15:04, Michal Fojtik wrote: Yes, there is a 5 seconds timeout set for connecting to instance. Maybe I should increase this timeout. Can you please do it manually for this time and if it will work I'll raise this value. as discussed on irc, i increased the timeout to 10s (ru

Re: Improved driver advertising (+client) rev2

2011-02-21 Thread mar...@redhat.com
came across a very minor (but deadly) typo which needs fixing before push: * in ec2 endpoint_for_service - Deltacloud::Drivers::driver_config[:ec2][:entry_points] should be [:entrypoints] or you can't get at any of the collections otherwise, ACK general thoughts: *should we list '/drivers/'

Re: Scope of API definitions

2011-02-21 Thread mar...@redhat.com
Hi Sang-Min, On 21/02/11 22:04, Sang-Min Park wrote: found that there’re functions that are not listed on Deltacloud API ( http://incubator.apache.org/deltacloud/api.html) For example, they are ‘keys’, ‘buckets/blobs’, ‘load balancer’, ‘storage volume’, etc. yes, you're right, that could do wi

Re: [jira] Created: (DTACLOUD-20) deltacloudc command line arguments on Win7

2011-03-11 Thread mar...@redhat.com
just pushed some client updates to trunk including the patch that addresses this - Justin can you test and then we can close this jira? marios On 23/02/11 16:26, Justin Clift (JIRA) wrote: deltacloudc command line arguments on Win7 --

Re: Initial RackSpace unit tests

2011-03-29 Thread mar...@redhat.com
Applies cleanly, 'real' test work fine but mock gave me some errors. I leave the branch in place and we can talk tomorrow if you'd like me to run again/do something different etc. Traces (real first and then mock): REAL=== rake test:rackspace (in /home/marios/Documents/WORK/NewEclip

Re: [VOTE] release deltacloud 0.3.0

2011-04-04 Thread mar...@redhat.com
+1 release On 04/04/11 13:46, Adrian Cole wrote: +1 support for deltacloud 0.3.0 was tested in jclouds tonight using rackspace and mock back-ends running on jruby 1.6.0 (1.8 mode). Cheers, -adrian On Mon, Apr 4, 2011 at 12:59 AM, Michal Fojtik wrote: On Apr 2, 2011, at 12:16 AM, David Lutte

Re: Typo in website

2011-04-15 Thread mar...@redhat.com
thanks for spotting that Tomas On 15/04/11 13:44, Tomas Von Veschler wrote: http://incubator.apache.org/deltacloud/download.html At the bottom, the deltacloud-devel mailing list link points to: deltacloud-dev-subscr...@incubtaor.apache.org should be: incubator Cheers, Tomas

net/http issue?

2011-04-19 Thread mar...@redhat.com
Jayg came across an interesting issue which we talked about on irc #deltacloud last night... i've spent some more (than I should have for sure) time on it today and tracked it down to weirdness in net/http. I'm not convinced its a real problem but thought i'd post it here to see if anyone else

Re: [VOTE] release deltacloud 0.3.0 (RC3)

2011-04-20 Thread mar...@redhat.com
On 20/04/11 00:01, David Lutterkort wrote: Hi all, I just uploaded the third release candidate for Deltacloud 0.3.0. The rc is available from http://people.apache.org/~lutter/deltacloud/0.3.0/rc3/ This RC fixes a critical bug in the EC2 driver. Please vote on the release candidate by Friday, 20

Re: ERROR: wrong number of arguments (1 for 0)

2011-04-21 Thread mar...@redhat.com
Hi Sebastian, can I have some more info about the installation - did you get the sources as per http://incubator.apache.org/deltacloud/contribute.html (so 'git clone git://git.apache.org/deltacloud.git core')? Regardless of the fact that you have OpenNebula configured/running, you should be

Re: Opennebula driver

2011-04-26 Thread mar...@redhat.com
Hi, On 26/04/11 14:48, Sebastian Neg wrote: Hi, I'm new and I want installed Deltacloud Adaptor. I have already installed opennebula and i have a working Deltacloud Server, but I can not configure it with a known URL. you need to set an environment variable called 'OCCI_URL' which tells the o

Re: Improved error/exception reporting (rev 2)

2011-04-28 Thread mar...@redhat.com
ACK (minor typo needs fixing before commit): * clean application (minor whitespace [non] issue) * Rakefile lines 124/125/126 - typo - you forgot to specify the :mock namespace (e.g. Rake::Task["mock:fixtures:clean"].invoke) so gives an error * The rake mock:setup/clean/reset stuff is very

aws 2.5.2 incompatibility issue with ruby 1.8.6

2011-05-10 Thread mar...@redhat.com
Hi (tl;dr: latest aws gem v.2.5.2 and ruby v.1.8.6 == problem) I ran into an issue using the EC2 driver today - it is particular to ruby 1.8.6 (yes i really need to get off fedora 13...) and the latest aws gem v. 2.5.2. Basically aws gem uses "string.each_char" which doesn't exist in ruby 1.8

Re: [PATCH] implements 'firewalls' - which are ec2 security groups

2011-05-16 Thread mar...@redhat.com
On 16/05/11 13:30, Michal Fojtik wrote: On May 16, 2011, at 9:06 AM, mar...@redhat.com wrote: Actually NACK. However this patch works fine the only major doubt I have on it are missing 'safely..end' block. This prevent reporting errors to client correctly. It would be also ni

Re: Eucalyptus_driver help

2011-05-17 Thread mar...@redhat.com
On 17/05/11 14:14, delta op wrote: hello everyone II installed Eucalyptus and I would list the pictures, forums, .. through Deltacloud. So i installed Deltacloud and I tested it with "i-deltacloudd eucalyptus-p 3001" it works, now i can access the GUI. Now I am working to follow the link "# http:

Re: Eucalyptus_driver help

2011-05-17 Thread mar...@redhat.com
Hi On 17/05/11 17:58, seb delta wrote: Thanks Marios for responding. The problem is that I can not connect to my Eucalyptus installation via Deltacloud, according to the web site, I understand that the driver should pointed to the installation of Eucalyptus by passing the request headers: X-De

Re: Incubator PMC/Board report for May 2011 (deltacloud-dev@incubator.apache.org)

2011-05-19 Thread mar...@redhat.com
seems we missed the deadline again (saw the original request, duly forgot about it, only just searched through my mailbox to find it) fwiw - i just filled in 'deltacloud', though the report is labelled as 'closed' so i don't know how useful this is at this point. A mentor may need to sign-off

Re: jboss tools deltacloud java client contributions

2011-05-24 Thread mar...@redhat.com
On 23/05/11 16:13, André Dietisheim wrote: Hi guys I just finished cleaning my Deltacloud java client code and pushed things to my DC fork on github. I added 2 java projects (org.jboss.tools.deltacloud.client & org.jboss.tools.deltacloud.client.test) to the java folder in clients/. I'd greatly a

Re: firewalls - ec2 security groups - revision 1

2011-05-26 Thread mar...@redhat.com
aws; gem build aws.gemspec; sudo gem install aws-2.5.3.gem [OPTIONAL cleanup: cd ../../ ; rm -rf ./tempdir/ ] marios On 16/05/11 20:45, mar...@redhat.com wrote: first revision of firewalls including suggestions by Michal: * in xml output: rather thantheID ... * safely do ... bl

Re: why do instance details differ when requesting single instance/all instances?

2011-05-27 Thread mar...@redhat.com
On 26/05/11 20:37, Chris Lalancette wrote: On 05/26/11 - 12:39:02AM, André Dietisheim wrote: Hi guys I just stumbled upon a change that must have been applied to the REST API btw. 0.1.2 and 0.3: If you request the full listing of all running instances, you will not get the authentication bits

Re: [PATCH] Fix keyname listing in EC2.

2011-05-27 Thread mar...@redhat.com
ACK, thanks and nice catch - pushing this with a couple additional changes to show.html.haml and index.xml.haml which weren't displaying the key/passwords (if present for given driver). marios On 26/05/11 20:38, Chris Lalancette wrote: The instance view expects an "instance.keyname" as part

Re: [PATCH] Fix keyname listing in EC2.

2011-05-27 Thread mar...@redhat.com
On 27/05/11 15:41, Chris Lalancette wrote: On 05/27/11 - 01:00:06PM, mar...@redhat.com wrote: ACK, thanks and nice catch - pushing this with a couple additional changes to show.html.haml and index.xml.haml which weren't displaying the key/passwords (if present for given driver). T

ruby 1.8.6 and aws gem compatibility issue

2011-05-27 Thread mar...@redhat.com
Hi, I've come across another compatibility issue with the aws gem (ec2/s3 driver) and ruby 1.8.6. The error occurs if you are trying to list your s3 buckets and is thrown in aws-2.5.3/lib/s3/s3_interface.rb line 337 ('def incrementally_list_bucket'). The offending line looks like: internal_o

Re: Debugging communication between Deltacloud and specific providers

2011-05-29 Thread mar...@redhat.com
I don't know if its trivial/possible to capture the communication between deltacloud and a given provider since that communication typically happens in a third party ruby gem (e.g. the 'aws' gem in the case of ec2). However I agree that this needs some thought as whenever I implement something

Re: [PATCH] implements 'firewalls' - ec2 security groups [revision 1]

2011-05-30 Thread mar...@redhat.com
On 30/05/11 12:17, Michal Fojtik wrote: On May 16, 2011, at 7:45 PM, mar...@redhat.com wrote: Hi, Sorry that I need to NACK this patch again, but I have same doubts as with previous revision. Seems like you fixed safely..end blocks but: * Please rename Firewall_Rule to FirewallRule * Please

Re: jboss tools deltacloud java client contributions

2011-05-30 Thread mar...@redhat.com
Michal can you please merge on github? Or should I push from my local branch? If I understand correctly github repo is just a mirror right? marios On 24/05/11 19:04, mar...@redhat.com wrote: On 23/05/11 16:13, André Dietisheim wrote: Hi guys I just finished cleaning my Deltacloud java

Re: Andre Dietisheim updated java client

2011-06-01 Thread mar...@redhat.com
ok, pushed On 01/06/11 12:45, André Dietisheim wrote: Hi marios thanks for the extensive howto! I did all those steps, compiled and ran the tests (by typing "mvn clean install" in both projects). All green, ACK from me :) Thanks André On 05/31/2011 12:44 PM, mar...@redhat.com

  1   2   >