[Openstack] First release of Elasticluster is out!
The Grid Computing Competence Center (GC3) is pleased to announce release 1.0.0 of Elasticluster. Do you need... * an Hadoop cluster with preconfigured HDFS ? * a ready-to-go HPC cluster based on different flavours of workload manager like SLURM, SGE, PBS ? * test distributed filesystems like chep, gluster or pvfs ? Elasticluster is a Python tool to automate the creation, configuration and management of clusters of virtual machines hosted on a cloud. It can provision clusters on Amazon's Elastic Compute Cloud EC2 and compatible ones, like OpenStack. A video demoes the basic features of Elasticluster setting up a SLURM compute cluster: http://youtu.be/cR3C7XCSMmA If you are interested, please visit http://gc3-uzh-ch.github.io/elasticluster/ or get in touch with us at elasticlus...@googlegroups.com The Grid Computing Competence Center -- antonio.s.mess...@gmail.com antonio.mess...@uzh.ch+41 (0)44 635 42 22 GC3: Grid Computing Competence Centerhttp://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Suggestions on how to filter an host
Hi all, We are using OpenStack Folsom and we recently got a quite fat node with a lot of ram that we want to use only for specific instances run by a specific tenant. We will also need to create a specific flavor that should be available only to this tenant, so that users not belonging to that tenant wouldn't see it. My question is thus: how can I 1) create a private flavor (nova flavor-create --is-public 0 is not enough) 2) allow only that specific flavor to run on that specific machine. Of course, any alternative solution would be good for us :) .a. P.S. as far as I know, correct me if I am wrong, on Folsom private flavors are just flavors not listed on horizon or via nova flavor-list, there is no concept of private-to-a-tenant flavor -- antonio.s.mess...@gmail.com antonio.mess...@uzh.ch+41 (0)44 635 42 22 GC3: Grid Computing Competence Centerhttp://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] floating ips history
Hi all, I wonder if there is an easy way to know the instance a specific floating ip was assigned to on a specific point in time. .a. -- antonio.s.mess...@gmail.com GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Keypair name - unsupported chars?
Hi all, I've just found that nova only accepts alphanumeric chars for keypair name, but it's giving an unclear message when you try to create a keypair using a non-alphanumeric char: (cloud)antonio@kenny:~$ nova keypair-add a/b --pub-key ~/.ssh/id_dsa.pub ERROR: Keypair data is invalid (HTTP 400) (Request-ID: req-5617dbb4-1c92-435b-ba88-7bcee5684f21) (cloud)antonio@kenny:~$ nova keypair-add a.b --pub-key ~/.ssh/id_dsa.pub ERROR: Keypair data is invalid (HTTP 400) (Request-ID: req-54078fcf-f8b1-4268-ba9e-3f20f79ce995) (cloud)antonio@kenny:~$ nova keypair-add a,b --pub-key ~/.ssh/id_dsa.pub ERROR: Keypair data is invalid (HTTP 400) (Request-ID: req-29bc9b76-83b3-42e4-8af2-ff9dd28c9149) (cloud)antonio@kenny:~$ nova keypair-add a:b --pub-key ~/.ssh/id_dsa.pub ERROR: Keypair data is invalid (HTTP 400) (Request-ID: req-87a32c9e-0f90-4fb9-b380-4d34c4f2df50) is this a knew feature or should I open a bug? This has been tested on folsom/ubuntu. .a. -- antonio.s.mess...@gmail.com GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Creation of snapshot failure
Sorry, I think I have found the problem: one of the disk of the swift server seems to have problems. .a. On Mon, Feb 11, 2013 at 5:11 PM, Antonio Messina antonio.s.mess...@gmail.com wrote: Hi all, We have a folsom installation on ubuntu, and we are having trouble creating snapshots. Sometimes (quite often indeed) the process fails and the snapshot image goes in killed status. This happen with both the Web frontend and nova image-create client. The funny thing is that creation of a snapshot on the very same instance can fail a few times, but it will eventually succeed. The nova-compute.log shows: 2013-02-11 17:03:54 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf qemu-img snapshot -c 656baf75ff104768bce7169233cb76d0 /var/lib/nova/instances/instance-045c/disk execute /usr/lib/python2.7/dist-packages/nova/utils.py:183 2013-02-11 17:03:55 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Result was 0 execute /usr/lib/python2.7/dist-packages/nova/utils.py:199 2013-02-11 17:03:55 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Running cmd (subprocess): qemu-img convert -f qcow2 -O qcow2 -s 656baf75ff104768bce7169233cb76d0 /var/lib/nova/instances/instance-045c/disk /var/lib/nova/instances/snapshots/tmpQYvmFD/656baf75ff104768bce7169233cb76d0 execute /usr/lib/python2.7/dist-packages/nova/utils.py:183 2013-02-11 17:03:58 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Result was 0 execute /usr/lib/python2.7/dist-packages/nova/utils.py:199 2013-02-11 17:03:58 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf qemu-img snapshot -d 656baf75ff104768bce7169233cb76d0 /var/lib/nova/instances/instance-045c/disk execute /usr/lib/python2.7/dist-packages/nova/utils.py:183 2013-02-11 17:03:58 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Result was 0 execute /usr/lib/python2.7/dist-packages/nova/utils.py:199 2013-02-11 17:04:01 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf tee /sys/class/net/vnet0/brport/hairpin_mode execute /usr/lib/python2.7/dist-packages/nova/utils.py:183 2013-02-11 17:04:01 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Result was 0 execute /usr/lib/python2.7/dist-packages/nova/utils.py:199 2013-02-11 17:04:30 DEBUG nova.utils [req-a789eaef-d7f7-4f41-807a-a7b910471a0b c5c6eb3e0ea8456c98acd07100a627af c4f9ddbce4f8444c896722e7c672d945] Got semaphore compute_resources for method update_usage... inner /usr/lib/python2.7/dist-packages/nova/utils.py:721 2013-02-11 17:04:30 24056 ERROR nova.openstack.common.rpc.amqp [-] Exception during message handling 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last): 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp File /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py, line 276, in _process_data 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args) 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp File /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py, line 145, in dispatch 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs) 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp File /usr/lib/python2.7/dist-packages/nova/exception.py, line 117, in wrapped 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp temp_level, payload) 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp File /usr/lib/python2.7/contextlib.py, line 24, in __exit__ 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp self.gen.next() 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp File /usr/lib/python2.7/dist-packages/nova/exception.py, line 92, in wrapped 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp return f(*args, **kw) 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp File /usr/lib/python2.7/dist-packages/nova/compute/manager.py, line 175, in decorated_function 2013-02-11 17:04:30 24056 TRACE nova.openstack.common.rpc.amqp pass 2013-02-11 17
Re: [Openstack] Unable to download images from glance.
On Thu, Feb 7, 2013 at 8:25 PM, Iccha Sethi iccha.se...@rackspace.com wrote: Unfortunately this is a known design flaw and has been reported previously as a bug as well - https://bugs.launchpad.net/glance/+bug/1100220 . We will hopefully be looking at rectifying it sometime soon. Thank you very much, I had a very bad time trying to figure out what was happening... .a. -Original Message- From: Antonio Messina antonio.s.mess...@gmail.com Sent: Thursday, February 7, 2013 2:10pm To: openstack@lists.launchpad.net Subject: [Openstack] Unable to download images from glance. Hi all, I've recently updated the password of the glance, swift and nova services via keystone user-update-password, and now I am unable to run instances because nova-compute is unable to download the image from glance. I know it sounds stupid, but I am pretty sure all the configuration files are fine, and the password works for *some* of the functionalities but not for glance image-download. I tried swift -U service:glance ... download glance image-id and it worked. Als glance image-list works. When I try glance -d download-image ..., however, I get: (cloud)antonio@kenny:~$ glance -d image-download d5b25046-fd08-4e30-950b-ab956c547f8d --file /tmp/antanicurl -i -X GET -H 'X-Auth-Token: 819f0cf1786e4d80ba0a1f672bbe9713' -H 'Content-Type: application/octet-stream' -H 'User-Agent: python-glanceclient' http://myhostname:9292/v1/images/d5b25046-fd08-4e30-950b-ab956c547f8d HTTP/1.1 500 Internal Server Error date: Thu, 07 Feb 2013 19:02:13 GMT content-length: 5424 content-type: text/plain connection: close Traceback (most recent call last): File /usr/lib/python2.7/dist-packages/eventlet/wsgi.py, line 382, in handle_one_response result = self.application(self.environ, start_response) File /usr/lib/python2.7/dist-packages/webob/dec.py, line 147, in __call__ resp = self.call_func(req, *args, **self.kwargs) File /usr/lib/python2.7/dist-packages/webob/dec.py, line 210, in call_func return self.func(req, *args, **kwargs) File /usr/lib/python2.7/dist-packages/glance/common/wsgi.py, line 326, in __call__ response = req.get_response(self.application) File /usr/lib/python2.7/dist-packages/webob/request.py, line 1086, in get_response application, catch_exc_info=False) File /usr/lib/python2.7/dist-packages/webob/request.py, line 1055, in call_application app_iter = application(self.environ, start_response) File /usr/lib/python2.7/dist-packages/keystone/middleware/auth_token.py, line 278, in __call__ return self.app(env, start_response) File /usr/lib/python2.7/dist-packages/webob/dec.py, line 147, in __call__ resp = self.call_func(req, *args, **self.kwargs) File /usr/lib/python2.7/dist-packages/webob/dec.py, line 210, in call_func return self.func(req, *args, **kwargs) File /usr/lib/python2.7/dist-packages/glance/common/wsgi.py, line 326, in __call__ response = req.get_response(self.application) File /usr/lib/python2.7/dist-packages/webob/request.py, line 1086, in get_response application, catch_exc_info=False) File /usr/lib/python2.7/dist-packages/webob/request.py, line 1055, in call_application app_iter = application(self.environ, start_response) File /usr/lib/python2.7/dist-packages/paste/urlmap.py, line 203, in __call__ return app(environ, start_response) File /usr/lib/python2.7/dist-packages/webob/dec.py, line 159, in __call__ return resp(environ, start_response) File /usr/lib/python2.7/dist-packages/routes/middleware.py, line 131, in __call__ response = self.app(environ, start_response) File /usr/lib/python2.7/dist-packages/webob/dec.py, line 159, in __call__ return resp(environ, start_response) File /usr/lib/python2.7/dist-packages/webob/dec.py, line 147, in __call__ resp = self.call_func(req, *args, **self.kwargs) File /usr/lib/python2.7/dist-packages/webob/dec.py, line 210, in call_func return self.func(req, *args, **kwargs) File /usr/lib/python2.7/dist-packages/glance/common/wsgi.py, line 532, in __call__ request, **action_args) File /usr/lib/python2.7/dist-packages/glance/common/wsgi.py, line 549, in dispatch return method(*args, **kwargs) File /usr/lib/python2.7/dist-packages/glance/api/v1/images.py, line 318, in show image_meta['location']) File /usr/lib/python2.7/dist-packages/glance/api/v1/images.py, line 294, in _get_from_store image_data, image_size = get_from_backend(context, where) File /usr/lib/python2.7/dist-packages/glance/store/__init__.py, line 221, in get_from_backend return store.get(loc) File /usr/lib/python2.7/dist-packages/glance/store/swift.py, line 291, in get resp_chunk_size=self.CHUNKSIZE) File /usr/lib/python2.7/dist-packages/swiftclient/client.py, line 1048, in get_object resp_chunk_size=resp_chunk_size) File /usr/lib/python2.7/dist-packages/swiftclient/client.py, line 969, in _retry self.url, self.token = self.get_auth() File /usr/lib/python2.7/dist-packages/swiftclient/client.py, line 957, in get_auth
Re: [Openstack] Glance, boto and image id
Apparently not. This is the output of glance image-show: +---+--+ | Property | Value| +---+--+ | Property 'kernel_id' | e1c78f4d-eca9-4979-9ee0-54019d5f79c2 | | Property 'ramdisk_id' | 99c8443e-c3b2-4aef-8bf8-79cc58f127a2 | | checksum | 2f81976cae15c16ef0010c51e3a6c163 | | container_format | ami | | created_at| 2012-12-04T22:59:13 | | deleted | False| | disk_format | ami | | id| 67b612ac-ab20-4227-92fc-adf92841ba8b | | is_public | True | | min_disk | 0| | min_ram | 0| | name | cirros-0.3.0-x86_64-uec | | owner | ab267870ac72450d925a437f9b7c064a | | protected | False| | size | 25165824 | | status| active | | updated_at| 2012-12-04T22:59:14 | +---+--+ Looking at the code in https://github.com/openstack/nova/blob/master/nova/api/ec2/ec2utils.py#L70and https://github.com/openstack/nova/blob/master/nova/api/ec2/ec2utils.py#L126it seems that the conversion is simply done by getting an id of type integer (not uuid-like string) and then converting it to hex form and appending it to the string 'ami-' Question is: where this id comes from and is there any way to show it in the horizon web interface? .a. On Sun, Jan 13, 2013 at 10:17 PM, Jay Pipes jaypi...@gmail.com wrote: The EC2-style image ID would probably be stored in the custom key/value pairs in the Glance image record for the image... so if you do a glance image-show IMAGE_UUID you should see the EC2 image ID in there... -jay On 01/11/2013 09:51 AM, Antonio Messina wrote: Hi all, I am using boto library to access an folsom installation, and I have a few doubts regarding image IDs. I understand that boto uses ec2-style id for images (something like ami ami-16digit number) and that nova API converts glance IDs to EC2 id. However, it seems that there is no way from the horizon web interface nor from euca-tools to get this mapping. How can I know the EC2 id of an image, having access only to the web interface or boto? I could use the *name* of the instance instead of the ID, but the name is not unique... .a. -- antonio.s.mess...@gmail.com mailto:antonio.s.mess...@gmail.com GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- antonio.s.mess...@gmail.com GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Glance, boto and image id
On Mon, Jan 14, 2013 at 6:18 PM, Vishvananda Ishaya vishvana...@gmail.comwrote: On Jan 14, 2013, at 7:49 AM, Jay Pipes jaypi...@gmail.com wrote: There is an integer key in the s3_images table that stores the map between the UUID and the AMI image id: https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/models.py#L964 Not sure this is available via Horizon... sorry. Correct. Here are some options: a) query the db directly for the mapping b) write an api extension to nova that exposes the mapping c) write an external utility that syncs the info from the nova db into glance metadata d) modify horizon to list images through the ec2 api instead of glance I guess d) depends on b), since we cannot assume horizon is running on the same machine as the nova-api service. .a. -- antonio.s.mess...@gmail.com GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Glance, boto and image id
On Mon, Jan 14, 2013 at 7:07 PM, Vishvananda Ishaya vishvana...@gmail.comwrote: On Jan 14, 2013, at 9:28 AM, Antonio Messina antonio.s.mess...@gmail.com wrote: On Mon, Jan 14, 2013 at 6:18 PM, Vishvananda Ishaya vishvana...@gmail.com wrote: On Jan 14, 2013, at 7:49 AM, Jay Pipes jaypi...@gmail.com wrote: There is an integer key in the s3_images table that stores the map between the UUID and the AMI image id: https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/models.py#L964 Not sure this is available via Horizon... sorry. Correct. Here are some options: a) query the db directly for the mapping b) write an api extension to nova that exposes the mapping c) write an external utility that syncs the info from the nova db into glance metadata d) modify horizon to list images through the ec2 api instead of glance I guess d) depends on b), since we cannot assume horizon is running on the same machine as the nova-api service. Not really. The ec2 api exposes ec2_style ids instead of uuids. It seems better to just provide one view of ids to your users. If you are suggesting they use the ec2 api then the uuids may not be needed. I just misread: instead of d), I've read something like e) modify horizon to list ec2 images id together with glance uuid I will try to better explain the issue: I want my users to be able to customize some of the images already present on our cloud by creating snapshots. Then, they should be able to use our software (which uses EC2 api) to run their jobs. Our software is non-interactive, so I can't print a list from which the user can chose the correct image, the user must write the id on a configuration file. I thing d) or e) would be fine, but d) will make our use case hard to apply to other clouds, while if OpenStack would accept a patch for e) we could be able to use other clouds as well... .a. -- antonio.s.mess...@gmail.com GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Glance, boto and image id
Hi all, I am using boto library to access an folsom installation, and I have a few doubts regarding image IDs. I understand that boto uses ec2-style id for images (something like ami ami-16digit number) and that nova API converts glance IDs to EC2 id. However, it seems that there is no way from the horizon web interface nor from euca-tools to get this mapping. How can I know the EC2 id of an image, having access only to the web interface or boto? I could use the *name* of the instance instead of the ID, but the name is not unique... .a. -- antonio.s.mess...@gmail.com GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Failure when creating more than n instances. networking fail.
I have the same problem, I can't create more than around 15 instances at once or I get a timeout error. BTW, the default was decreased in essex from 3600 to 60: https://bugs.launchpad.net/nova/+bug/938287 If you can find a reasonable default value would be very appreciated :) thanx .a. On Fri, Dec 28, 2012 at 6:26 PM, Davanum Srinivas dava...@gmail.com wrote: Vish, Should we increase the default timeout? Would there be any issues with that? -- dims On Fri, Dec 28, 2012 at 12:18 PM, Vishvananda Ishaya vishvana...@gmail.com wrote: This is generally due to timeouts talking to the network server. It will be much better with multi_host networking. Also you could avoid some issues by upping the rpc call timeout: rpc_response_timeout=180 (defaults to 60 seconds) Vish On Dec 28, 2012, at 2:53 AM, Andrew Holway a.hol...@syseleven.de wrote: Hello, Anyone else seen this? https://bugs.launchpad.net/openstack-ci/+bug/1094226 When creating lots a instances simultaneously there is a point where it begins to fall apart. It seems to be related to the speed of the CPU. I tested this on a much slower E5430 and I could handle about 20 Instances before causing error. My machines with E5-2670 can hangle much more. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- Davanum Srinivas :: http://davanum.wordpress.com ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp -- antonio.s.mess...@gmail.com arcimbo...@gmail.com GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Fwd: [swift3] api - boto and libcloud = AccessDenied
I tried with the EC2 credentials too, but without luck.
Do I need to create specific endpoints for s3 in keystone? Using what URLs?
Is my configuration and code correct?
.a.
On Thu, Dec 6, 2012 at 11:46 PM, Blair Bethwaite
blair.bethwa...@gmail.comwrote:
Hi Antonio,
It sounds like you might be using the wrong credentials. The S3 layer
works with the EC2 credentials.
On 6 December 2012 06:33, Antonio Messina arcimbo...@gmail.com wrote:
Hi all,
I'm trying to access SWIFT using the S3 API compatibility layer, but I
always get an AccessDenied.
I'm running folsom on ubuntu precise 12.04 LTS, packages are from
ubuntu-cloud.archive.canonical.com repository. Swift is correctly
configured, login and password have been tested with the web interface and
from command line. Glance uses it to store the images.
I've installed swift-plugin-s3 and I've configured proxy-server.conf as
follow:
pipeline = catch_errors healthcheck cache ratelimit authtoken
keystoneauth swift3 proxy-logging proxy-server
[filter:swift3]
use = egg:swift3#swift3
I've then tried to connect using my keystone login and password (and I've
also tried with the EC2 tokens, with the same result).
The code I'm using is:
from libcloud.storage.types import Provider as StorageProvider
from libcloud.storage.providers import get_driver as get_storage_driver
s3driver = get_storage_driver(StorageProvider.S3)
s3 = s3driver(ec2access, ec2secret, secure=False, host=s3host, port=8080)
s3.list_containers()
What I get is:
Traceback (most recent call last):
File stdin, line 1, in module
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/storage/drivers/s3.py,
line 176, in list_containers
response = self.connection.request('/')
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/common/base.py,
line 605, in request
connection=self)
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/common/base.py,
line 93, in __init__
raise Exception(self.parse_error())
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/storage/drivers/s3.py,
line 68, in parse_error
raise InvalidCredsError(self.body)
libcloud.common.types.InvalidCredsError: '?xml version=1.0
encoding=UTF-8?\r\nError\r\n CodeAccessDenied/Code\r\n
MessageAccess denied/Message\r\n/Error'
Using boto instead:
import boto
s3conn = boto.s3.connection.S3Connection(
aws_access_key_id=ec2access, aws_secret_access_key=ec2secret, port=s3port,
host=s3host, is_secure=False,debug=3)
s3conn.get_all_buckets()
send: 'GET / HTTP/1.1\r\nHost: cloud-storage1:8080\r\nAccept-Encoding:
identity\r\nDate: Wed, 05 Dec 2012 19:25:00 GMT\r\nContent-Length:
0\r\nAuthorization: AWS
7c67d5b35b5a4127887c5da319c70a18:WXVx9AONXvIkDiIdg8rUnfncFnM=\r\nUser-Agent:
Boto/2.6.0 (linux2)\r\n\r\n'
reply: 'HTTP/1.1 403 Forbidden\r\n'
header: Content-Type: text/xml; charset=UTF-8
header: Content-Length: 124
header: X-Trans-Id: tx7a823c742f624f2682bfddb19f31bcc2
header: Date: Wed, 05 Dec 2012 19:24:42 GMT
Traceback (most recent call last):
File stdin, line 1, in module
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/boto/s3/connection.py,
line 364, in get_all_buckets
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
?xml version=1.0 encoding=UTF-8?
Error
CodeAccessDenied/Code
MessageAccess denied/Message
/Error
Login and password work when using the command line tool `swift`.
I think I may be missing something very basilar here, but I couldn't find
so much documentation...
Thanks in advance
.a.
--
antonio.s.mess...@gmail.com
arcimbo...@gmail.com
GC3: Grid Computing Competence Center
http://www.gc3.uzh.ch/
University of Zurich
Winterthurerstrasse 190
CH-8057 Zurich Switzerland
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
--
Cheers,
~Blairo
--
antonio.s.mess...@gmail.com
arcimbo...@gmail.com
GC3: Grid Computing Competence Center
http://www.gc3.uzh.ch/
University of Zurich
Winterthurerstrasse 190
CH-8057 Zurich Switzerland
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Fwd: [swift3] api - boto and libcloud = AccessDenied
'swift-proxy.conf' is a typo for 'proxy-server.conf' right?
.a.
On Fri, Dec 7, 2012 at 11:23 AM, Blair Bethwaite
blair.bethwa...@gmail.comwrote:
Ah yes, you said that already - sorry. It looks like you missed the
S3token middleware in your proxy conf, see:
http://docs.openstack.org/trunk/openstack-compute/admin/content/configuring-swift-with-s3-emulation-to-use-keystone.html
On 7 December 2012 21:16, Antonio Messina arcimbo...@gmail.com wrote:
I tried with the EC2 credentials too, but without luck.
Do I need to create specific endpoints for s3 in keystone? Using what
URLs? Is my configuration and code correct?
.a.
On Thu, Dec 6, 2012 at 11:46 PM, Blair Bethwaite
blair.bethwa...@gmail.com wrote:
Hi Antonio,
It sounds like you might be using the wrong credentials. The S3 layer
works with the EC2 credentials.
On 6 December 2012 06:33, Antonio Messina arcimbo...@gmail.com wrote:
Hi all,
I'm trying to access SWIFT using the S3 API compatibility layer, but I
always get an AccessDenied.
I'm running folsom on ubuntu precise 12.04 LTS, packages are from
ubuntu-cloud.archive.canonical.com repository. Swift is correctly
configured, login and password have been tested with the web interface and
from command line. Glance uses it to store the images.
I've installed swift-plugin-s3 and I've configured proxy-server.conf as
follow:
pipeline = catch_errors healthcheck cache ratelimit authtoken
keystoneauth swift3 proxy-logging proxy-server
[filter:swift3]
use = egg:swift3#swift3
I've then tried to connect using my keystone login and password (and
I've also tried with the EC2 tokens, with the same result).
The code I'm using is:
from libcloud.storage.types import Provider as StorageProvider
from libcloud.storage.providers import get_driver as get_storage_driver
s3driver = get_storage_driver(StorageProvider.S3)
s3 = s3driver(ec2access, ec2secret, secure=False, host=s3host,
port=8080)
s3.list_containers()
What I get is:
Traceback (most recent call last):
File stdin, line 1, in module
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/storage/drivers/s3.py,
line 176, in list_containers
response = self.connection.request('/')
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/common/base.py,
line 605, in request
connection=self)
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/common/base.py,
line 93, in __init__
raise Exception(self.parse_error())
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/storage/drivers/s3.py,
line 68, in parse_error
raise InvalidCredsError(self.body)
libcloud.common.types.InvalidCredsError: '?xml version=1.0
encoding=UTF-8?\r\nError\r\n CodeAccessDenied/Code\r\n
MessageAccess denied/Message\r\n/Error'
Using boto instead:
import boto
s3conn = boto.s3.connection.S3Connection(
aws_access_key_id=ec2access, aws_secret_access_key=ec2secret, port=s3port,
host=s3host, is_secure=False,debug=3)
s3conn.get_all_buckets()
send: 'GET / HTTP/1.1\r\nHost: cloud-storage1:8080\r\nAccept-Encoding:
identity\r\nDate: Wed, 05 Dec 2012 19:25:00 GMT\r\nContent-Length:
0\r\nAuthorization: AWS
7c67d5b35b5a4127887c5da319c70a18:WXVx9AONXvIkDiIdg8rUnfncFnM=\r\nUser-Agent:
Boto/2.6.0 (linux2)\r\n\r\n'
reply: 'HTTP/1.1 403 Forbidden\r\n'
header: Content-Type: text/xml; charset=UTF-8
header: Content-Length: 124
header: X-Trans-Id: tx7a823c742f624f2682bfddb19f31bcc2
header: Date: Wed, 05 Dec 2012 19:24:42 GMT
Traceback (most recent call last):
File stdin, line 1, in module
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/boto/s3/connection.py,
line 364, in get_all_buckets
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
?xml version=1.0 encoding=UTF-8?
Error
CodeAccessDenied/Code
MessageAccess denied/Message
/Error
Login and password work when using the command line tool `swift`.
I think I may be missing something very basilar here, but I couldn't
find so much documentation...
Thanks in advance
.a.
--
antonio.s.mess...@gmail.com
arcimbo...@gmail.com
GC3: Grid Computing Competence Center
http://www.gc3.uzh.ch/
University of Zurich
Winterthurerstrasse 190
CH-8057 Zurich Switzerland
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
--
Cheers,
~Blairo
--
antonio.s.mess...@gmail.com
arcimbo...@gmail.com
GC3: Grid Computing Competence Center
http://www.gc3.uzh.ch/
University of Zurich
Winterthurerstrasse 190
CH-8057 Zurich Switzerland
--
Cheers,
~Blairo
--
antonio.s.mess...@gmail.com
arcimbo...@gmail.com
GC3: Grid Computing Competence Center
http
[Openstack] Fwd: [swift3] api - boto and libcloud = AccessDenied
Hi all,
I'm trying to access SWIFT using the S3 API compatibility layer, but I
always get an AccessDenied.
I'm running folsom on ubuntu precise 12.04 LTS, packages are from
ubuntu-cloud.archive.canonical.com repository. Swift is correctly
configured, login and password have been tested with the web interface and
from command line. Glance uses it to store the images.
I've installed swift-plugin-s3 and I've configured proxy-server.conf as
follow:
pipeline = catch_errors healthcheck cache ratelimit authtoken keystoneauth
swift3 proxy-logging proxy-server
[filter:swift3]
use = egg:swift3#swift3
I've then tried to connect using my keystone login and password (and I've
also tried with the EC2 tokens, with the same result).
The code I'm using is:
from libcloud.storage.types import Provider as StorageProvider
from libcloud.storage.providers import get_driver as get_storage_driver
s3driver = get_storage_driver(StorageProvider.S3)
s3 = s3driver(ec2access, ec2secret, secure=False, host=s3host, port=8080)
s3.list_containers()
What I get is:
Traceback (most recent call last):
File stdin, line 1, in module
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/storage/drivers/s3.py,
line 176, in list_containers
response = self.connection.request('/')
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/common/base.py,
line 605, in request
connection=self)
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/common/base.py,
line 93, in __init__
raise Exception(self.parse_error())
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/libcloud/storage/drivers/s3.py,
line 68, in parse_error
raise InvalidCredsError(self.body)
libcloud.common.types.InvalidCredsError: '?xml version=1.0
encoding=UTF-8?\r\nError\r\n CodeAccessDenied/Code\r\n
MessageAccess denied/Message\r\n/Error'
Using boto instead:
import boto
s3conn = boto.s3.connection.S3Connection( aws_access_key_id=ec2access,
aws_secret_access_key=ec2secret, port=s3port, host=s3host,
is_secure=False,debug=3)
s3conn.get_all_buckets()
send: 'GET / HTTP/1.1\r\nHost: cloud-storage1:8080\r\nAccept-Encoding:
identity\r\nDate: Wed, 05 Dec 2012 19:25:00 GMT\r\nContent-Length:
0\r\nAuthorization: AWS
7c67d5b35b5a4127887c5da319c70a18:WXVx9AONXvIkDiIdg8rUnfncFnM=\r\nUser-Agent:
Boto/2.6.0 (linux2)\r\n\r\n'
reply: 'HTTP/1.1 403 Forbidden\r\n'
header: Content-Type: text/xml; charset=UTF-8
header: Content-Length: 124
header: X-Trans-Id: tx7a823c742f624f2682bfddb19f31bcc2
header: Date: Wed, 05 Dec 2012 19:24:42 GMT
Traceback (most recent call last):
File stdin, line 1, in module
File
/home/antonio/.virtualenvs/cloud/local/lib/python2.7/site-packages/boto/s3/connection.py,
line 364, in get_all_buckets
response.status, response.reason, body)
boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
?xml version=1.0 encoding=UTF-8?
Error
CodeAccessDenied/Code
MessageAccess denied/Message
/Error
Login and password work when using the command line tool `swift`.
I think I may be missing something very basilar here, but I couldn't find
so much documentation...
Thanks in advance
.a.
--
antonio.s.mess...@gmail.com
arcimbo...@gmail.com
GC3: Grid Computing Competence Center
http://www.gc3.uzh.ch/
University of Zurich
Winterthurerstrasse 190
CH-8057 Zurich Switzerland
___
Mailing list: https://launchpad.net/~openstack
Post to : openstack@lists.launchpad.net
Unsubscribe : https://launchpad.net/~openstack
More help : https://help.launchpad.net/ListHelp
