Re: [Openstack] Swift3 bucket naming conventions

2018-07-18 Thread Shyam Prasad N
e underscores in them... almost any >> character is valid. >> >> But I guess s3api thinks that's maybe not a valid bucket name? >> >> https://github.com/openstack/swift/blob/master/test/unit/com >> mon/middleware/s3api/test_utils.py#L38 >> >> -Clay >&g

[Openstack] Swift3 bucket naming conventions

2018-06-21 Thread Shyam Prasad N
Hi, On my openstack swift s3 interface, I tried to create bucket names similar to what I have in my AWS S3. But swift3 doesn't seem to allow bucket names containing underscore. Once I remove the underscore and try to create the bucket, it works. Is there a way to overcome this? -- -Shyam

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-06-21 Thread Shyam Prasad N
I forgot to close loop on this. I managed to solve this problem with a config change in /etc/swift/proxy-server.conf: I needed to include the line: auth_version = 3 under [filter:s3token] On Fri, Jun 1, 2018 at 5:02 PM, Shyam Prasad N wrote: > Hi Kota, > > I tried with the ch

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-06-01 Thread Shyam Prasad N
0 > > then, the string to sign should include the info corretly. > > Looking at s3curl code, it looks to fall into cname case? > > https://github.com/scality/S3/blob/master/tests/functional/ > s3curl/s3curl.pl#L311-L328 > > Once I played with s3curl the request with ordinary endpoi

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-06-01 Thread Shyam Prasad N
ount in the path so far as well as actual > amazon s3. > > Best, > Kota > > (2018/05/31 21:33), Shyam Prasad N wrote: > > Hi Yuxin, > > > > Thank you for sharing your configs. > > So I've managed to get past the Signature not matching error.

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-31 Thread Shyam Prasad N
ential > > openstack credential create --type ec2 --project testproject testuser > '{"access": "testaccess", "secret": "testsecret"}' > > 4. Use it in s3curl > > add the endpoint url to `my @endpoints` in s3curl.pl > add the credential to .s3c

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-25 Thread Shyam Prasad N
not missing anything in configuration. Regards, Shyam On Fri, May 25, 2018 at 3:05 PM, Shyam Prasad N <nspmangal...@gmail.com> wrote: > Tried that. Unfortunately same error. > Is there anything I can do to troubleshoot this? > > On Fri, May 25, 2018 at 2:56 PM, Yuxin Wang <wang.

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-25 Thread Shyam Prasad N
Tried that. Unfortunately same error. Is there anything I can do to troubleshoot this? On Fri, May 25, 2018 at 2:56 PM, Yuxin Wang <wang.yu...@ostorage.com.cn> wrote: > They can be any strings. > > Replace them with whatever you want. > > - Yuxin > > 在 2018年5月25日,14:5

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-25 Thread Shyam Prasad N
hacking. Basically the software > hadn't been updated in about a year, and the newest release was > incompatible with the version of OpenStack that we were selling. > > On Thu, May 24, 2018 at 11:57 PM, Shyam Prasad N <nspmangal...@gmail.com> > wrote: > >> Thanks. I'll try

Re: [Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-25 Thread Shyam Prasad N
/knowledgecenter/en/STXKQY_4.1. > 1/com.ibm.spectrum.scale.v4r11.adv.doc/bl1adv_ > ConfigureOpenstackEC2credentials.htm > > 在 2018年5月25日,10:32,Shyam Prasad N <nspmangal...@gmail.com> 写道: > > Yes, I did. > I don't think this is s3curl related issue, because I tried with python > AWS SDK, and got t

[Openstack] Struggling to get the s3 api interface to work with swift.

2018-05-24 Thread Shyam Prasad N
Hi, I've been trying to get swift3 to work for several days now. But I haven't managed to get it running. Both with tempauth and keystoneauth, I'm getting the same error: eightkpc@objectstore1:~/s3curl$ ./s3curl.pl --id=testerks -- http://127.0.0.1:8080/ SignatureDoesNotMatchThe request

[Openstack] Not able to use openstack swift using the s3 api plugin...

2018-05-03 Thread Shyam Prasad N
Hi, I tried installing the swift3 plugin using the following link: https://docs.openstack.org/mitaka/config-reference/object-storage/configure-s3.html However, I'm not able to perform the operations: # ./s3curl.pl --id=personal -get -- -s -v http://proxy-server:8080 Unknown option: get * Rebuilt

[Openstack] Swift3 configuration...

2018-04-17 Thread Shyam Prasad N
Hi, I'm trying to setup an s3 API frontend for my swift cluster using this guide: https://docs.openstack.org/mitaka/config-reference/object-storage/configure-s3.html But I'm unable to figure out how to configure the access_key_id and secret_access_key. The page says I should pick up from aws

Re: [Openstack] Domain not found error

2018-04-17 Thread Shyam Prasad N
hould suffice since > keystone is essential to all other services, so you wouldn't do too much > damage. > Another way would be to login to your database and change the respective > values, but since I don't know what exactly the bootstrap command does I > would not recommend

Re: [Openstack] Domain not found error

2018-04-16 Thread Shyam Prasad N
also points to 35357 again, so this is probably a bug. > > You should fix this prior to any further steps. > > > > Zitat von Shyam Prasad N <nspmangal...@gmail.com>: > > Here is the documentation page I followed: >> https://docs.openstack.org/keystone/queens/inst

Re: [Openstack] Domain not found error

2018-04-16 Thread Shyam Prasad N
Here is the documentation page I followed: https://docs.openstack.org/keystone/queens/install/keystone-install-ubuntu.html On Mon, Apr 16, 2018 at 3:14 PM, Shyam Prasad N <nspmangal...@gmail.com> wrote: > Hi Eugen, > > Ignore the different IPs. I had tried keystone install o

Re: [Openstack] Domain not found error

2018-04-16 Thread Shyam Prasad N
ey should > reflect the configuration you bootstrapped with keystone-manage. > > Change your admin-rc to point to the correct IP and the correct port, then > retry the domain list command after sourcing the credentials. > > > > Zitat von Shyam Prasad N <nsp

Re: [Openstack] Domain not found error

2018-04-16 Thread Shyam Prasad N
at von Eugen Block <ebl...@nde.ag>: > > > The missing command has been in Newton, Ocata and Pike release. They fixed >> it in Queens again. >> >> I filed a bug report: https://bugs.launchpad.net/keystone/+bug/1763297 >> >> Regards >> >&g

Re: [Openstack] Domain not found error

2018-04-12 Thread Shyam Prasad N
Thanks Eugen :) On Thu, Apr 12, 2018, 13:57 Eugen Block <ebl...@nde.ag> wrote: > The missing command has been in Newton, Ocata and Pike release. They > fixed it in Queens again. > > I filed a bug report: https://bugs.launchpad.net/keystone/+bug/1763297 > > Regards > &

Re: [Openstack] Domain not found error

2018-04-12 Thread Shyam Prasad N
s cloud. > > Did the keystone-manage bootstrap command work? > Yes. It did not throw any errors. > > Regards > > > Zitat von Shyam Prasad N <nspmangal...@gmail.com>: > > > Hi, >> >> I'm trying to install keystone for my swift cluster. >> I fo

[Openstack] Domain not found error

2018-04-11 Thread Shyam Prasad N
Hi, I'm trying to install keystone for my swift cluster. I followed this document for install and configuration: https://docs.openstack.org/keystone/pike/install/ However, I'm getting this error for a command: # openstack user create --domain default --password-prompt swift The request you have

[Openstack] EC stability status in openstack swift

2018-03-23 Thread Shyam Prasad N
Hi, I wanted to understand the stability of the erasure coding feature in openstack swift. Is it in widespread production use? We're exploring the possibility of using EC instead of replication on few of our servers which are not so loaded in terms of storage capacity. Also, I expect EC to be

Re: [Openstack] [openstack-dev] 503 Errors for PUT and POST calls....

2017-08-11 Thread Shyam Prasad N
n't have permissions?) > > Hope you can get it squared. You might jump in IRC and join > #openstack-swift on Freenode for some more iterative feedback (I'd recommend > irccloud.com if you're new to IRC). > > GL, > > -Clay > > > On Tue, Aug 8, 2017 at 2:54 AM, Shya

Re: [openstack-dev] [Openstack] 503 Errors for PUT and POST calls....

2017-08-11 Thread Shyam Prasad N
n't have permissions?) > > Hope you can get it squared. You might jump in IRC and join > #openstack-swift on Freenode for some more iterative feedback (I'd recommend > irccloud.com if you're new to IRC). > > GL, > > -Clay > > > On Tue, Aug 8, 2017 at 2:54 AM, Shya

[Openstack] 503 Errors for PUT and POST calls....

2017-08-08 Thread Shyam Prasad N
Hi, In my openstack swift cluster, I'm seeing a lot of 503 errors as a result of tracebacks in swift logs with "No such file or directory" exceptions... # grep -Rnw txdaba05e70c6b4dfaa5884-0059895aca /var/log/swift/* /var/log/swift/proxy.error:31030:Aug 7 23:31:39

[openstack-dev] 503 Errors for PUT and POST calls....

2017-08-08 Thread Shyam Prasad N
Hi, In my openstack swift cluster, I'm seeing a lot of 503 errors as a result of tracebacks in swift logs with "No such file or directory" exceptions... # grep -Rnw txdaba05e70c6b4dfaa5884-0059895aca /var/log/swift/* /var/log/swift/proxy.error:31030:Aug 7 23:31:39

Re: [Openstack] [Swift] Object replication...

2016-12-13 Thread Shyam Prasad N
to an older version? Please note that I'm okay to sacrifice high availability, if that ensures that the data is strictly consistent. Regards, Shyam On Dec 13, 2016 22:46, "John Dickinson" <m...@not.mn> wrote: On 13 Dec 2016, at 0:21, Shyam Prasad N wrote: Hi, I have an openstack swif

[Openstack] [Swift] Object replication...

2016-12-13 Thread Shyam Prasad N
Hi, I have an openstack swift cluster with 2 nodes, and a replication count of 2. So, theoretically, during a PUT request, both replicas are updated synchronously. Only then the request will return a success. Please correct me if I'm wrong on this. I have a script that periodically does a PUT to

[Openstack] Geo-replicated cluster...

2015-06-23 Thread Shyam Prasad N
Hi, I'm planning to setup a geo-replicated swift cluster and run an application which will use this cluster as a backend. I understand that the two mechanisms that support this are container sync and region based disk location. I'm okay with synchronization being asynchronous (synchronous

Re: [Openstack] Swift setup with replica count of two and node down...

2015-04-28 Thread Shyam Prasad N
Thanks Hugo. On Tuesday 28 April 2015 07:25 PM, Kuo Hugo wrote: Btw, for operational questions. Please post to https://ask.openstack.org/en/questions/ . It's a better place for anyone would like to ask same question in the future. Thanks // Hugo 2015-04-28 17:57 GMT+08:00 Shyam Prasad N

Re: [Openstack] Swift setup with replica count of two and node down...

2015-04-28 Thread Shyam Prasad N
, 2015 at 3:27 PM, Shyam Prasad N nspmangal...@gmail.com wrote: Hi, I have a setup with object replica count of 2. The setup has 2 machines (say A and B), with 2 disks (sdb and sdc) in each machine. An object X is created when the whole setup (both A and B) is up and running. A is down

[Openstack] Swift setup with replica count of two and node down...

2015-04-28 Thread Shyam Prasad N
Hi, I have a setup with object replica count of 2. The setup has 2 machines (say A and B), with 2 disks (sdb and sdc) in each machine. An object X is created when the whole setup (both A and B) is up and running. A is down for maintenance. What is the expected behaviour for this setup when: 1.

Re: [Openstack] Remove storage from the rings and then re-add..

2014-10-21 Thread Shyam Prasad N
Thanks for the reply, Sam. Will explore this option. BTW, I'm running the Havana release of swift. Did swift have the above features in this release? Regards, Shyam On Mon, Oct 20, 2014 at 10:12 PM, Samuel Merritt s...@swiftstack.com wrote: On 10/19/14, 11:24 PM, Shyam Prasad N wrote: Hi

[Openstack] Remove storage from the rings and then re-add..

2014-10-20 Thread Shyam Prasad N
Hi, I've written a few scripts to make adding of storage to swift cluster easier: remakerings: removes existing ring files and builds new empty rings. addtorings: adds new IP:DISK pair to existing rings. removefromrings: removes an IP:DISK pair from existing rings. I'm facing a problem in one

Re: [openstack-dev] Swift global cluster replication latency...

2014-08-19 Thread Shyam Prasad N
with a COPY request to the global policy. Do you have a specific use case for geo-distributed objects that you could share or are you just trying to understand the implementation? -Clay On Mon, Aug 18, 2014 at 3:32 AM, Shyam Prasad N nspmangal...@gmail.com wrote: Hi, Went through the following

[openstack-dev] Swift global cluster replication latency...

2014-08-18 Thread Shyam Prasad N
Hi, Went through the following link: https://swiftstack.com/blog/2012/09/16/globally-distributed-openstack-swift-cluster/ I'm trying to simulate the 2-region 3-replica scenario. The document says that the 3rd replica will be asynchronously moved to the remote location with a 2-region setup.

[Openstack] Swift global cluster replication latency...

2014-08-18 Thread Shyam Prasad N
Hi, Went through the following link: https://swiftstack.com/blog/2012/09/16/globally-distributed-openstack-swift-cluster/ I'm trying to simulate the 2-region 3-replica scenario. The document says that the 3rd replica will be asynchronously moved to the remote location with a 2-region setup.

[Openstack] Replication count change on running cluster...

2014-07-07 Thread Shyam Prasad N
Hi, Is it possible to change the ring replication count for a cluster which is already running, and has data? From what I read, I'll need to recreate the rings with new replication count. But this will clear all my existing data in the cluster. Right? Thanks in advance for the replies. --

[Openstack] Replication count..

2014-07-04 Thread Shyam Prasad N
Hi, I have a swift setup with 2 disks each on 2 nodes. The swift rings have been setup with replication count of 2, with each node with unique zone id. After creation of a few objects, I pulled out one of the disks from node1. After some more object creations, I pulled out the remaining swift

Re: [Openstack] Replication count..

2014-07-04 Thread Shyam Prasad N
what is going wrong from the proxy server logs can you post the o/p of the following 2 commands: swift-ring-builder /etc/swift/object.builder swift-get-nodes /etc/swift/object.ring.gz blah blah blah Gerry. *From:* Shyam Prasad N [mailto:nspmangal...@gmail.com] *Sent:* 04 July 2014 10:45

Re: [openstack-dev] [Openstack] Bad perf on swift servers...

2014-05-30 Thread Shyam Prasad N
diagram will help. Hugo Kuo 2014-05-29 1:06 GMT+08:00 Shyam Prasad N nspmangal...@gmail.com: Hi, Confused about the right mailing list to ask this question. So including both openstack and openstack-dev in the CC list. I'm running a swift cluster with 4 nodes. All 4 nodes are symmetrical

Re: [Openstack] Bad perf on swift servers...

2014-05-30 Thread Shyam Prasad N
diagram will help. Hugo Kuo 2014-05-29 1:06 GMT+08:00 Shyam Prasad N nspmangal...@gmail.com: Hi, Confused about the right mailing list to ask this question. So including both openstack and openstack-dev in the CC list. I'm running a swift cluster with 4 nodes. All 4 nodes are symmetrical

[openstack-dev] Bad perf on swift servers...

2014-05-28 Thread Shyam Prasad N
Hi, Confused about the right mailing list to ask this question. So including both openstack and openstack-dev in the CC list. I'm running a swift cluster with 4 nodes. All 4 nodes are symmetrical. i.e. proxy, object, container, and account servers running on each with similar storage

[openstack-dev] Modification of a running swift setup...

2014-05-14 Thread Shyam Prasad N
Hi, After setup and usage of a two-node swift cluster, let's say I want to rebuild the rings with zones and regions differently mapped. I mean, I initially mapped disk1a and disk1b in node1 to zone1 and disk2a and disk2b in node2 to zone2; and now want to change the setup to each disk in a

Re: [openstack-dev] (no subject)

2014-05-10 Thread Shyam Prasad N
: This is a development list, and your question sounds more usage-related. Please ask your question on the users list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Thanks. -Ben On 05/09/2014 06:57 AM, Shyam Prasad N wrote: Hi, I have

[openstack-dev] (no subject)

2014-05-09 Thread Shyam Prasad N
Hi, I have a two node swift cluster receiving continuous traffic (mostly overwrites for existing objects) of 1GB files each. Soon after the traffic started, I'm seeing the following traceback from some transactions... Traceback (most recent call last): File

[openstack-dev] Objects not getting distributed across the swift cluster...

2014-05-01 Thread Shyam Prasad N
Hi, I created a swift cluster and configured the rings like this... swift-ring-builder object.builder create 10 3 1 ubuntu-202:/etc/swift$ swift-ring-builder object.builder object.builder, build version 12 1024 partitions, 3.00 replicas, 1 regions, 4 zones, 12 devices, 300.00 balance The

Re: [openstack-dev] Objects not getting distributed across the swift cluster...

2014-05-01 Thread Shyam Prasad N
correctly. -- Chuck On Thu, May 1, 2014 at 5:28 AM, Shyam Prasad N nspmangal...@gmail.comwrote: Hi, I created a swift cluster and configured the rings like this... swift-ring-builder object.builder create 10 3 1 ubuntu-202:/etc/swift$ swift-ring-builder object.builder object.builder

Re: [openstack-dev] Objects not getting distributed across the swift cluster...

2014-05-01 Thread Shyam Prasad N
-corruption. 2. It would have been really useful if the rebalancing operations could be logged by swift somewhere and automatically run later (after min_part_hours). Regards, Shyam On Thu, May 1, 2014 at 11:15 PM, John Dickinson m...@not.mn wrote: On May 1, 2014, at 10:32 AM, Shyam Prasad N

[openstack-dev] Swift ring building..

2014-04-04 Thread Shyam Prasad N
Hi, I have a question regarding the ring building process in a swift cluster. Many sources online suggest building the rings using ring-builder and scp the generated ring files to all the nodes in the cluster. What I'm trying to understand is if the scp step is just to simplify things, or is it