[Openstack] Swift patches for the essex release

2012-03-07 Thread John Dickinson
The final swift release for openstack essex is coming quickly. Swift 1.4.8 is tentatively scheduled for March 22nd. To get your patches into this release, please submit them for review by next week so we have enough time to review and QA them. --John smime.p7s Description: S/MIME cryptograp

[Openstack] Swift 1.4.7 released

2012-03-09 Thread John Dickinson
I'm happy to announce swift 1.4.7 has been released today. Changelog: Full set of commits since the last release:

Re: [Openstack] swift and two data-centres - hierarchical zones?

2012-03-12 Thread John Dickinson
On Mar 10, 2012, at 5:58 AM, John Leach wrote: > > I think what I need here is hierarchical zones - I'd define one parent > zone per data-centre, and then multiple child zones within each > (representing racks or whatever). > > Swift would be configured to write 3 replicas in 3 child zones, aimi

Re: [Openstack] Swift concept architecture

2012-03-12 Thread John Dickinson
On Mar 11, 2012, at 12:16 AM, Dmitry Ukov wrote: > Hi all, > I want to introduce some ideas about Swift. > > Let’s assume we have huge amount of data stored in Swift (e.g. 10Pb). This > data are dynamically changed by users. So we need to reduce network load > caused by replication and intensi

Re: [Openstack] Swift: NAS or DAS?

2012-03-16 Thread John Dickinson
Generally, you would introduce latency in the storage system by using a NAS attached to a storage drive. Also, at scale, your costs will be dominated by drive, so you will want to optimize the storage nodes for dense, cheap storage. --John On Mar 16, 2012, at 8:32 AM, Michaël Van de Borne wrot

Re: [Openstack] Distributed rate-limiting

2012-03-17 Thread John Dickinson
If you're looking for wsgi rate limiting, take a look at swift's rate limiting middleware. It's distributed, simple (uses memcached to keep track of what's going on), supports multiple tiers of rate limiting (with interpolation between them), and white/black lists. While swift's rate limiting i

Re: [Openstack] Where does Keystone middleware for Swift belong?

2012-04-11 Thread John Dickinson
I do not think that these pieces of middleware belong in the core swift repo. 1) Including them in swift would require swift to depend on keystone for full testing. 2) (When the middleware was created) Keystone's API was in a state of constant flux. Keystone has changed quite a bit since then,

Re: [Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?

2012-04-12 Thread John Dickinson
Swift keeps total bytes, container, and object count (eventually) up-to-date in the account metadata. There are also log processing tools (like slogging - http://github.com/notmyname/slogging) that can provide usage information (including bandwidth) based on swift logs. While I think that it's

Re: [Openstack] [Swift] Does there any exist blueprint or sub-project of user's storage space quota or counting method for Swift ?

2012-04-12 Thread John Dickinson
I should also mention the summit session talking about this very topic led by Everett Toews. It's (currently) scheduled for 9am on wednesday. http://summit.openstack.org/sessions/view/81 --John On Apr 12, 2012, at 8:51 PM, John Dickinson wrote: > Swift keeps total bytes, contai

Re: [Openstack] HTTP status value naming normalization

2012-04-21 Thread John Dickinson
I like what you are trying to do here. Can you please submit this as a patch through gerrit so we can get the rest of the core devs to look at it? --John On Apr 20, 2012, at 12:14 PM, Victor Rodionov wrote: > There are many place in Swift code where used hard coded values, such > as response s

Re: [Openstack] [Openstack-operators] Question Regarding Swift Distribution Statistics

2012-05-02 Thread John Dickinson
On your proxy server, use swift-get-nodes to see which servers your object is on. With no arguments or --help you will get usage info. --John On May 2, 2012, at 3:48 PM, Duncan McGreggor wrote: > cc'ing openstack list > > On Wed, May 2, 2012 at 4:45 PM, Richard Raseley wrote: >> I am trying

[Openstack] [Swift] swift news and plans

2012-05-04 Thread John Dickinson
TL;DR: removing code from swift, associated projects doc, swift 1.5.0 I want to let the openstack community know of some recent changes within swift and how those changes will affect the next version of swift. Swift has a growing developer community and a rapidly expanding deployed base. While t

Re: [Openstack] Opening up bug triaging rights

2012-05-14 Thread John Dickinson
On May 14, 2012, at 10:06 AM, Thierry Carrez wrote: > Hello everyone, > > Currently the bug triaging rights for a given PROJECT (ability to set > status and importance of bugs, but also ability to nominate a bug for a > past series) is restricted to the corresponding PROJECT-bugs team, which > i

[Openstack] Swift 1.5.0 release

2012-06-05 Thread John Dickinson
I'm pleased to announce the release of swift 1.5.0. This is a big release with some big changes. I recommend that deployers upgrade, and, as always, you can upgrade your production cluster with no downtime. Swift docs: http://swift.openstack.org Swift code: http://github.com/openstack/swift Openst

Re: [Openstack] [Swift] Interested in implementing swift ring builder server

2012-06-19 Thread John Dickinson
It looks like Florian (at Rackspace) is working on that blueprint. He just assigned it to himself. I'm happy to hear that you have some extra devs for swift work. I'd love to help coordinate some swift goals with you. Off the top of my head, here are a few things that could be worked on: 1) Ha

Re: [Openstack] [Swift] S3 like ACL for Swift

2012-06-20 Thread John Dickinson
Yes, this could be good for swift. ACLs in swift do need to be stored in swift (for scale reasons), but their implementation is dependent on the particular auth system that you are using. The auth middleware is responsible for determining if a request is granted access to a particular swift ent

Re: [Openstack] [Swift] S3 like ACL for Swift

2012-06-20 Thread John Dickinson
On Jun 20, 2012, at 11:02 AM, Victor Rodionov wrote: > > Also, I want ask do you think it's good idea to store object ACL in object > metadata? I'd suggest looking at container-level ACLs rather than object-level. But either way, the data does need to be stored in the metadata in swift itself

Re: [Openstack] Swift Probetests

2012-06-26 Thread John Dickinson
The probe tests are internal whole-system type of tests that test functionality never exposed through normal integration testing. They exist at the level between unit tests and functional tests. For example, one of the probetests makes sure that asynchronous container updates actually happen. Un

Re: [Openstack] [Swift] [Storage node] Lots of timeouts in load test after several hours around 1, 000, 0000 operations

2012-07-01 Thread John Dickinson
I hope you are able to get an answer. I'm traveling this week, so I won't have a chance to look in to it. I hope some of the other core devs will have a chance to help you find an answer. --John On Jul 1, 2012, at 2:03 PM, Kuo Hugo wrote: > Hi all , > > I did several loading tests for swif

Re: [Openstack] Statsd on SWIFT 1.4.8

2012-07-05 Thread John Dickinson
statsd integration was added in swift 1.5.0 On Jul 5, 2012, at 9:07 AM, Leandro Reox wrote: > On swift essex stable 1.4.8, is the capacity to send statistics to a statsd > server available? Its not in the docs > > Regards > ___ > Mailing list: https:

Re: [Openstack] [Swift] LFS patch (Ia32c9c34)

2012-07-18 Thread John Dickinson
Nexenta's LFS patch (https://review.openstack.org/#/c/7524/) has languished for a while, and I'd like to address that. First, thank you for your patch submission. This patch adds new functionality that potentially can allow swift to be deployed in more places. The original version of the patch,

[Openstack] next swift release just around the corner

2012-07-23 Thread John Dickinson
The next swift release is scheduled for public release next Monday (July 30). That means we've got a little bit of work to do this week to get it ready. In order to allow Cloud Files QA time to check it, we need to have packages built by the middle of the day Wednesday. This means all outstandin

[Openstack] Swift 1.6.0 released

2012-08-06 Thread John Dickinson
I'm happy to announce that Swift 1.6.0 has been released. You can get the tarball at https://launchpad.net/swift/folsom/1.6.0. As always, you can upgrade your production Swift clusters to this new version with no downtime to your clients. The complete changelog for this release is at https://g

[Openstack] [swift] Operational knowledge sharing

2012-08-10 Thread John Dickinson
In a standard swift deployment, the proxy server is running behind a load balancer and/or an SSL terminator. At SwiftStack, we discovered an issue that may arise from some config parameters in this layer, and we'd like to share it with other swift deployers. Symptom: Users updating metadata (i

Re: [Openstack] Swift + keystone integration

2012-08-11 Thread John Dickinson
Make sure that the endpoint stored in keystone is returning the right hostname/domain name and port (8080 based on your config). --John On Aug 11, 2012, at 12:58 PM, Miguel Alejandro González wrote: > Hello > > I have 3 nodes with ubuntu 12.04 server and installed openstack with packages >

[Openstack] [Swift] community update and what's coming in Folsom

2012-08-13 Thread John Dickinson
We just released Swift 1.6.0 last Monday ( https://lists.launchpad.net/openstack/msg15505.html ). We've got a lot of great features and improvements in it, and I wanted to take some time to update the wider community about where Swift is. Swift 1.4.8 was included with the last OpenStack realease (

[Openstack] [Swift] Where do we go from here?

2012-08-14 Thread John Dickinson
Swift has many exciting features coming in the OpenStack Folsom Release this fall, but where do we go from here? What's next for Swift in grizzly? I've got some ideas. I'd like to mention them and see where you the community will take them. I've written up most of them into quick one- line bluepri

Re: [Openstack] OpenStack Summit Tracks & Topics

2012-08-14 Thread John Dickinson
SwiftStack would like to do an intro session on swift on Monday. We'll also be signing up for several workshops. --John On Aug 14, 2012, at 9:57 AM, Lauren Sell wrote: > We have space available Monday if someone wants to run a getting started > track in the morning (or all day), but it would

Re: [Openstack] Question about undo delete in Swift with Object Version

2012-08-22 Thread John Dickinson
With the current implementation of versioning in Swift, this isn't possible. It's better to think of the feature as "versioned writes". --John On Aug 22, 2012, at 12:13 AM, ZHOU Yuan wrote: > Hi stackers, > > I'm trying to understand the object version feature in Swift. > In the current impl

[Openstack] [swift] important upgrade note for swift deployers

2012-08-28 Thread John Dickinson
Swift 1.7 = The next release of Swift will be version 1.7. This will be our release for OpenStack Folsom, and is scheduled land mid-September. There is an important change for deployers in this release. This email has the details so you can begin planning your upgrade path. What's the cha

[Openstack] Swift PTL candidacy

2012-09-04 Thread John Dickinson
I am running to continue my position as Swift PTL. I have been involved with swift since the project started. I am an active contributor, reviewer, and community participant. I have lead meetups about swift, given conference presentations on swift, and am active in IRC helping those who have qu

Re: [Openstack] [OpenStack][Swift][Replicator] Does object replicator push "exist" object to handoff node while a node/disk/network fails ?

2012-09-06 Thread John Dickinson
you can force a replicator to push to a handoff node by unmounting the drive one of the primary replicas is on. --John On Sep 6, 2012, at 9:00 AM, Kuo Hugo wrote: > Hi folks , John and Chmouel , > > I did post a question about this long time ago. And my test result is match > to Chmouel's a

[Openstack] [swift] 1.7.0-final pushed

2012-09-12 Thread John Dickinson
e the Essex release, but I wanted to publicly thank everyone who contributed to Swift during the Folsom release cycle. The following people have code contributions in Swift during the Folsom release cycle. Thanks again! Greg Holt John Dickinson Darrell Bishop Samuel Merritt Florian Hines David

Re: [Openstack] [swift] make swift.common.utils.streq_const_time more efficient

2012-09-13 Thread John Dickinson
The intended purpose of this string comparison is to explicitly compare every character. Doing it this way guards against timing attacks (http://en.wikipedia.org/wiki/Timing_attack). --John On Sep 13, 2012, at 12:06 AM, Mike Green wrote: > def streq_const_time(s1, s2): > > if len(s1) !=

[Openstack] [Swift] community meeting Oct 1

2012-09-24 Thread John Dickinson
As we finish up Folsom and head into the Grizzly summit, I'd like to have a Swift community meeting. Who: The Swift community (users, deployers, contributors, core devs) When: October 1, 2012 at 8pm (UTC), 3pm (Central), 1pm (Pacific) Where: #openstack-meeting on freenode (IRC) Agenda: http://w

Re: [Openstack] Swift reliability

2012-09-26 Thread John Dickinson
The 404s on object PUTs are probably related to the timeout errors you are seeing on the container servers. This may be because of IO contention on your hardware (eg overtaxed drives). How does the disk IO look on your physical hardware? The disk full errors may be because you are running out o

Re: [Openstack] [openstack-dev] [Swift] community meeting Oct 1

2012-10-01 Thread John Dickinson
Reminder for today's meeting. On Sep 24, 2012, at 10:59 PM, John Dickinson wrote: > As we finish up Folsom and head into the Grizzly summit, I'd like to have a > Swift community meeting. > > Who: The Swift community (users, deployers, contributors, core devs) > When

Re: [Openstack] [SWIFT] Proxies Sizing for 90.000 / 200.000 RPM

2012-10-24 Thread John Dickinson
Sorry for the delay. You've got an interesting problem, and we were all quite busy last week with the summit. First, the standard caveat: Your performance is going to be highly dependent on your particular workload and your particular hardware deployment. 3500 req/sec in two different deploymen

Re: [Openstack] [SWIFT] Proxies Sizing for 90.000 / 200.000 RPM

2012-10-24 Thread John Dickinson
arify, because i really want to understand what my real metrics are > so i can know where to tune in case i need to. > Thanks ! > > --- > Alejandrito > > > On Wed, Oct 24, 2012 at 3:28 PM, John Dickinson wrote: > Sorry for the delay. You've got an interesting pr

[Openstack] Swift 1.7.5 release plan

2012-10-25 Thread John Dickinson
Fast on the heels of a productive summit in San Diego, we are getting ready to release Swift 1.7.5. Our current schedule is to cut the QA release on November 5 and, assuming it passes all QA tests, prepare the final release on November 8. This is quite a solid release with a ton of bug fixes and

Re: [Openstack] Troubleshooting Swift 1.7.4 on mini servers

2012-10-26 Thread John Dickinson
A 507 is returned by the object servers in 2 situations: 1) the drives are full or 2) the drives have been unmounted because of disk error. It's highly likely that you simply have full drives. Remember that the usable space in your cluster is 1/N where N = replica count. As an example, with 3 r

Re: [Openstack] Troubleshooting Swift 1.7.4 on mini servers

2012-10-29 Thread John Dickinson
I can write files to the mounted filesystem directly before, > during, and after the Swift error occurs. So the problem must be some kind > of timeout that is causing the object server to think that something is wrong > with the disk. > > I'll keep digging... >

Re: [Openstack] Nova middleware for enabling CORS?

2012-10-30 Thread John Dickinson
Since the CORS support in Swift allows the preflight OPTIONS response to be different on a per-container basis (which is correct in a multi-tenant system), the CORS support was added directly into Swift's proxy server rather than as middleware. In order to fulfill the OPTIONS request, container

Re: [Openstack] How to Create Object Folders/Directories

2011-08-05 Thread John Dickinson
You only need a "-H 'Content-Length: 0'" in that command and it should work. For more infor on nested virtual directories, see http://programmerthoughts.com/programming/nested-folders-in-cloud-files/ --John On Aug 5, 2011, at 4:24 AM, 홍성희 wrote: > Hi > I now want to create a virtual folder. >

[Openstack] swift update

2011-08-12 Thread John Dickinson
A quick update from the swift team: Since my last update, we added some additional quarantine checks for corrupted objects and a nice ops tool called recon. Recon is middleware that is loaded on the object server and monitors a storage node for various things like async pending files, load, dis

Re: [Openstack] Is Openstack suitable to my problem?

2011-08-15 Thread John Dickinson
See http://programmerthoughts.com/programming/nested-folders-in-cloud-files/ for info on how to use a nested directory structure in swift. --John On Aug 14, 2011, at 11:07 PM, Thiago Moraes wrote: > I took a look at some distributed file systems and went a little deeper in > Hadoop and his HD

Re: [Openstack] AuthZ functionality in Keystone - Re: [WAS]OpenStack Identity: Keystone API Proposal

2011-08-18 Thread John Dickinson
On Aug 18, 2011, at 5:50 PM, Vishvananda Ishaya wrote: > > On Aug 18, 2011, at 3:45 PM, Somik Behera wrote: > >> Hi Vish, >> >> That would be one very reasonable way to do it, but in that case we are >> fragmenting AuthZ in multiple services instead of Keystone taking care of >> AuthZ across

[Openstack] swift at the essex summit

2011-08-25 Thread John Dickinson
I beginning to think about the things that need to be covered at the design summit about swift specifically. I've started an etherpad, and I welcome all input. http://etherpad.openstack.org/swift-essex --John ___ Mailing list: https://launchpad.net/

Re: [Openstack] New nova service proposal

2011-08-26 Thread John Dickinson
On Aug 26, 2011, at 6:10 PM, Monsyne Dragon wrote: > > The proper way, IMHO, for this to work is that a request generates a > workorder with a set of tasks. > This gets sent to something (scheduler, probably) which looks at the first > uncompleted task on the workorder, makes the decision on

[Openstack] swift 1.4.3 (diablo) fast approaches

2011-08-29 Thread John Dickinson
We are fast approaching the next swift release, version 1.4.3. This is the version of swift that will be in the diablo release of openstack. Since swift 1.4.3 is scheduled for next week, all patches that will be included need to be proposed now. We will be doing final dev and QA work this week t

[Openstack] Openstack swift code now on github

2011-09-06 Thread John Dickinson
tion (http://wiki.openstack.org/GerritWorkflow#Project_Setup). If you have any questions, please join #openstack-dev on freenode and ask. --John Dickinson notmyname ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net U

Re: [Openstack] X-Copy-From and Large Object Support

2011-09-07 Thread John Dickinson
A server-side copy will consolidate the file to one object. The new target object has the same limitations as other objects in the system (<5GB). --John On Sep 7, 2011, at 5:34 PM, Caitlin Bestler wrote: > What is the expected behavior when an object uploaded using Large Object > Support > i

[Openstack] swift 1.4.3 (diablo) released

2011-09-12 Thread John Dickinson
We have released swift 1.4.3 today. The changelog is below. Baring something we missed in testing, this release is the swift version that will be released as Openstack Diablo. The launchpad landing page for this release is https://launchpad.net/swift/diablo/1.4.3. swift (1.4.3) * Addition

Re: [Openstack] [Swift] [Keystone] Account migration

2011-09-13 Thread John Dickinson
Swift treats the or part of the account as an opaque string. (Technically, the first one isn't a hash but a uuid.) I don't think there is any migration path because there is nothing to migrate. But I may be missing something. --John On Sep 13, 2011, at 2:55 PM, Nguyen, Liem Manh wrote: > H

Re: [Openstack] [Swift] [Keystone] Account migration

2011-09-13 Thread John Dickinson
ng something here? > > Liem > > -Original Message- > From: John Dickinson [mailto:m...@not.mn] > Sent: Tuesday, September 13, 2011 1:11 PM > To: Nguyen, Liem Manh > Cc: openstack@lists.launchpad.net > Subject: Re: [Openstack] [Swift] [Keystone] Account migration >

Re: [Openstack] [Swift] [Keystone] Account migration

2011-09-13 Thread John Dickinson
=hp@lists.launchpad.net >> [mailto:openstack-bounces+bob.souza=hp@lists.launchpad.net] On >> Behalf Of John Dickinson >> Sent: Tuesday, September 13, 2011 4:11 PM >> To: Nguyen, Liem Manh >> Cc: openstack@lists.launchpad.net >> Subject: Re: [Openstack] [Swift] [Keystone] Acc

Re: [Openstack] Essex sessions

2011-09-16 Thread John Dickinson
Matt, I've been busy with some other work-related things this week, but I hope to focus some more on the summit sessions next week. If you have some ideas of things you'd like to see discussed, please add them. --John On Sep 16, 2011, at 10:51 AM, Matt Colton wrote: > I've been looking over t

Re: [Openstack] Community metrics, developers' engagement

2011-09-26 Thread John Dickinson
On Sep 26, 2011, at 12:10 PM, Mike Scherbakov wrote: > > Do you mean something different from the summaries like this one? > > http://eavesdrop.openstack.org/meetings/openstack-meeting/2011/openstack-meeting.2011-09-20-22.15.html > > Yeah, it's not clear what was actually discussed. I'm looking

Re: [Openstack] OpenStack Satellite

2011-09-27 Thread John Dickinson
What benefits does an openstack-satellite project bring? Other than all using some openstack component, what do these projects have in common that justifies grouping them? For example, I know of many open source projects that use swift (swauth, slogging, cyberduck, all the rackspace language bin

Re: [Openstack] Improving meetbot reports (was Re: Community metrics, developers' engagement)

2011-09-27 Thread John Dickinson
aking process transparent and accessible. The current setup meets the letter of the law, but perhaps not the spirit. --John On Sep 27, 2011, at 7:08 PM, Stefano Maffulli wrote: > On Mon, 2011-09-26 at 12:51 -0500, John Dickinson wrote: >> I too would like to see official community a

Re: [Openstack] OpenStack Satellite

2011-09-27 Thread John Dickinson
So you're looking for a place to point marketing? We already have http://openstack.org/projects/ (which has a long list on it) and the wiki has plenty of space to add new pages, if necessary. However, the original proposal is not about a marketing landing page to promote an openstack ecosystem.

Re: [Openstack] Why does object server's Put have a container method?

2011-09-28 Thread John Dickinson
Remember that there are 3 copies of each container, too. The proxy is setting a header in each PUT to the object server. The object server reads the header to know which container server to update. Failure scenarios are handled better this way. All ok: proxy sends PUT to 3 object servers. All 3

Re: [Openstack] Swift git differences between launchpad vs github milestone-proposed branch history

2011-09-29 Thread John Dickinson
ab33970b58b8219245bfd89e2ad9442c0e94f17refs/tags/1.4.1 > > (https://github.com/openstack/swift/commit/9ab33970b58b8219245bfd89e2ad9442c0e94f17) > > $ git log -n1 9ab33970b58b8219245bfd89e2ad9442c0e94f17 > commit 9ab33970b58b8219245bfd89e2ad9442c0e94f17 > Merge: 8526098 c4f0b55

Re: [Openstack] 55PB storage cloud hosted using Swift

2011-09-29 Thread John Dickinson
clarification: 5.5PB On Sep 29, 2011, at 3:00 PM, Brian Schott wrote: > In case you missed it, SDSC is hosting a commercial 55 petabyte storage cloud > using Swift: > > http://arstechnica.com/business/news/2011/09/supercomputing-center-targets-55-petabyte-storage-at-academics-students.ars > ht

Re: [Openstack] Creating openstack-dev mailing list

2011-10-07 Thread John Dickinson
; From: openstack-bounces+john=openstack@lists.launchpad.net >> [mailto:openstack-bounces+john=openstack@lists.launchpad.net] On Behalf >> Of Stefano Maffulli >> Sent: Thursday, October 06, 2011 1:35 PM >> To: openstack >> Subject: [Openstack] Creating openstack-d

Re: [Openstack] New git-review tool ready for people to try

2011-10-14 Thread John Dickinson
I'd much prefer storing data in git config rather than in a dot file. On Oct 14, 2011, at 7:33 AM, Julien Danjou wrote: > On Fri, Oct 14 2011, James E. Blair wrote: > >> Another idea though is to add a small dotfile into each repository >> indicating the canonical location of that repo's gerrit.

Re: [Openstack] New git-review tool ready for people to try

2011-10-14 Thread John Dickinson
On Oct 14, 2011, at 8:04 AM, Julien Danjou wrote: > On Fri, Oct 14 2011, John Dickinson wrote: > >> I'd much prefer storing data in git config rather than in a dot file. > > A dot file is commit-able. Git config is not. > So in this case, providing the dot file w

Re: [Openstack] +1, All services should have WADLs

2011-10-27 Thread John Dickinson
I am concerned about some of the implications that are being discussed. 1) A WADL is part of documentation of an API. Nobody is going to object to more documentation. 2) Being an open-source project, if somebody wants to commit to creating and maintaining a WADL for a particular part of Opensta

Re: [Openstack] +1, All services should have WADLs

2011-10-28 Thread John Dickinson
On Oct 28, 2011, at 10:04 AM, Ed Leafe wrote: > Swift had the advantage of starting out as a closed source project that > only had to serve a single master, and thus didn't need external > orchestration to keep it on track. Nova, OTOH, as a community development > effort, essentially had

Re: [Openstack] proposal for policy around and management of client libraries

2011-11-07 Thread John Dickinson
In general, I support the idea of good, supported client libraries. I have a few questions about this particular proposal. 1) Would a distinct python client (and the associated project) be required for each core openstack project that exposes an API? 2) Why does the PPB need to vote? Actually,

Re: [Openstack] proposal for policy around and management of client libraries

2011-11-07 Thread John Dickinson
On Nov 7, 2011, at 4:23 PM, Monty Taylor wrote: > >> 2) Why does the PPB need to vote? Actually, what would the PPB be >> voting on (assuming the answer to #1 is "no")? > > Well, it would be effectively promoting several existing projects which > are managed in a few different places (rackspace,

Re: [Openstack] [Openstack-poc] proposal for policy around and management of client libraries

2011-11-08 Thread John Dickinson
On Nov 8, 2011, at 10:54 AM, Thierry Carrez wrote: > > With solution (2), if you look at the issue from Gerrit, GitHub, > Launchpad or Jenkins, those will be separate projects though. The fact > that they share the same PTL is not enough to make them "one". For > example, they will have separate

Re: [Openstack] Tutorials of how to install openstack swift into centos 6

2011-11-09 Thread John Dickinson
Awesome. Thanks for putting this together. I know a lot of people have been interested in getting swift running on non-ubuntu systems. Thanks for sharing this with everyone. --John On Nov 9, 2011, at 12:00 AM, pf shineyear wrote: > openstack swift install on centos 6 > > 1. proxy install >

Re: [Openstack] Update Container Metadata.

2011-11-14 Thread John Dickinson
Updating existing container metadata with a POST is entirely supported and intended behavior. (The same also applies to adding/updating metadata on an account.) --John On Nov 14, 2011, at 8:10 PM, easco wrote: > Anne, > > Thank you for your help, and you're correct, that is the case I am pu

Re: [Openstack] Keystone & Swift: swiftauth tenant namespace collisions?

2011-11-20 Thread John Dickinson
I don't think that is exactly right, but my understanding of tenants vs accounts vs users may be lacking. Nonetheless, auth v2.0 support was added to the swift cli tool by Chmouel recently. Have you tried with the code in swift's trunk (also the 1.4.4 release scheduled for Tuesday)? --John On

Re: [Openstack] rpms for rhel5.x to install Open stack Object Storage

2011-11-21 Thread John Dickinson
I suspect there is a communication gap somewhere, but this is certainly not the case. Openstack Object Storage (swift) is not deprecated. Glance provides a bridge between nova and swift, but all three are important, active projects. Sudhaker, I know that rpms exist for swift, but I don't know

[Openstack] Swift 1.4.4 released

2011-11-24 Thread John Dickinson
release is https://launchpad.net/~swift-core/+archive/release. As always, we welcome all input and patches. The swift code is found on github at https://github.com/openstack/swift and we'd be happy to answer questions on the openstack mailing list or on IRC (#openstack on freenode). -

Re: [Openstack] [RFC] Common config options module

2011-12-06 Thread John Dickinson
Overall, I think it's a great thing to have commonality between the projects on option names and environment variables. I think it's worthwhile to push for that in the swift cli tool in the essex timeframe. On the topic of common config libraries, though, I think the differences are less import

Re: [Openstack] Several questions about HOW SWIFT WORKS

2012-01-03 Thread John Dickinson
Answers inline. On Jan 3, 2012, at 11:32 AM, Alejandro Comisario wrote: > > So, lets get down to business. > > # 1 we have memcache service running on each proxy, so as far as we know, > memcache actually caches keystone tokens and object paths as the request ( > PUT , GET) enters the proxy,

[Openstack] swift release 1.4.5

2012-01-04 Thread John Dickinson
It's time again for a swift release. We have cut the swift 1.4.5 release and it's headed to QA. We expect it to be validated by the end of this week and it should land for public use early next week. Below is the changelog for this release. The highlights are the swift-orphans and swift-oldies

Re: [Openstack] Several questions about HOW SWIFT WORKS

2012-01-06 Thread John Dickinson
The best, technical description of the ring was written by the person who had the biggest role in writing it for swift: http://www.tlohg.com/p/building-consistent-hashing-ring.html --John smime.p7s Description: S/MIME cryptographic signature ___ Ma

Re: [Openstack] Using Gerrit to verify the CLA

2012-01-09 Thread John Dickinson
https://rackspace.echosign.com/verifier On Jan 9, 2012, at 8:08 AM, Mark McLoughlin wrote: > Hey, > > On Thu, 2012-01-05 at 10:02 -0800, James E. Blair wrote: >> This change is in place; membership in openstack-cla is required in >> order to submit changes to Gerrit. >> >> All of the -core gro

[Openstack] swift essex status update

2012-01-11 Thread John Dickinson
he improvements we've made to swift, and I expect some more exciting things to come before our final essex release is made. As always, patches welcome! John Dickinson Swift Project Technical Lead notmyname on IRC smime.p7s Description: S/MIME cryptographic signature ___

[Openstack] swift object versions

2012-01-12 Thread John Dickinson
I've recently started working on adding versioning to objects stored in swift (https://github.com/notmyname/swift/tree/version_manifest). Since this is such a requested feature, I thought it would be a good idea to get early input. I've created an etherpad (http://etherpad.openstack.org/swift-ob

Re: [Openstack] swift object versions

2012-01-12 Thread John Dickinson
On Thu, Jan 12, 2012 at 1:42 PM, John Dickinson wrote: > I've recently started working on adding versioning to objects stored in swift > (https://github.com/notmyname/swift/tree/version_manifest). Since this is > such a requested feature, I thought it would be a good idea to get ea

Re: [Openstack] (no subject)

2012-01-19 Thread John Dickinson
look in syslog on your proxy server to see what caused the error. --John On Jan 19, 2012, at 6:28 PM, Khaled Ben Bahri wrote: > Hi all, > > I tryed to install OpenStack swift, > > after creating and configuring all nodes, when i want to check that swift > works, > I execute this command : >

Re: [Openstack] Swift supported file system

2012-01-23 Thread John Dickinson
That functionality is left up to a client. For example, you could use FUSE to spoof swift as a filesystem or you could use a client like Cyberduck or even write your own. Last week someone on this mailing list talked about adding webDAV support to swift. All of these "work" in that they present

Re: [Openstack] Swift supported file system

2012-01-23 Thread John Dickinson
The storage volumes referenced in the ring are identified by an IP, port, and mount point. So, it is possible to use network attached storage for swift (as long as it still supports xattrs). However, I don't know if this has ever really been tried (especially in production), and I'd be surprised

Re: [Openstack] Swift Container Name Restrictions

2012-01-24 Thread John Dickinson
On Jan 24, 2012, at 5:22 PM, Matthew Wodrich wrote: > Hi Folks, > > I'm trying to write some scripts to work with Swift containers, but I don't > actually know what the restrictions on container names are. Does anyone know > what the specification is, or where I can read up on it? > > For ex

[Openstack] Swift 1.4.6 release

2012-02-10 Thread John Dickinson
I'm happy to announce that swift 1.4.6 has been released today. We've added some great new features in this release and fixed several outstanding bugs. The full changelog is below, but I'd like to highlight a few key points. Swift 1.4.6 includes new middleware that adds the ability to upload objec

Re: [Openstack] Doubts about virtual CPUs and Swift storage capacity.

2012-02-11 Thread John Dickinson
On Feb 11, 2012, at 7:29 AM, Jorge Luiz Corrêa wrote: > > 2) About Swift, how do I determine the total usable storage capacity of the > system? For example: I have 3 nodes with 5 HDs of 1 TB each one. Straightly I > have 15 TB of space. If I use raid 1 I can say that I'm going to have 7,5 TB >

Re: [Openstack] python-swiftclient?

2012-02-13 Thread John Dickinson
On Feb 13, 2012, at 8:29 AM, Chmouel Boudjnah wrote: > > > What do you think if we : > > - split swift.common.client to its own. > - have bin/swift import that package and shipped with it. > - have a comprehensive test suite covering the CLI and the library. > - have some proper PIP release for

Re: [Openstack] swprobe: swift middleware for sending metrics to graphite using statsd

2012-02-21 Thread John Dickinson
That's great. Have you by any chance seen https://github.com/pandemicsyn/swift-informant? It's something similar that we've been playing with at Rackspace. --John On Feb 21, 2012, at 10:36 AM, Jasper Capel wrote: > Hi all, > > I'm announcing a piece of Swift middleware, swprobe [1], designed

Re: [Openstack] Swift container ACLs and container visibility question

2012-02-23 Thread John Dickinson
It all depends on the auth system you are using. Below is for swauth and tempauth: Are the users using the same shared storage? If so, set them up as .admin users with the same storage endpoint. If they are not using the same shared storage, then you may be stuck. The ACL support in swauth and

Re: [Openstack] [Swift] Cannot create container.

2012-02-24 Thread John Dickinson
a 507 response means that the drive was unmounted. If you are running this in a VM (like the SAIO), then you need to disable to mount check. Docs for this are in the SAIO docs. --John On Feb 24, 2012, at 9:13 AM, Leander Bessa wrote: > Hello, > > I'm trying to set up a custom swift server in

[Openstack] swift authors list

2012-02-24 Thread John Dickinson
Stefano has asked that swift start keeping email addresses in our AUTHORS file. I'll be adding these soon, but some contributors have more than one email. If you have a particular email address you'd like to have me add to your name, please let me know. Otherwise, I will use one from git log. N

Re: [Openstack] How to contribute Nova?

2011-01-03 Thread John Dickinson
> I want to contribute the project. What should I do to contribute? Check out http://wiki.openstack.org/HowToContribute and follow the instructions there. --John ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchp

Re: [Openstack] [RFC] OpenStack Programming Model Framework

2011-01-03 Thread John Dickinson
On Jan 3, 2011, at 6:13 PM, John Purrier wrote: > > API/Service Protocol: RESTful interfaces specific to each service. Each > service will present a Public API, a Management API, and optionally, a > Notification API. The set and format of the service interface calls define > the Service Protoco

Re: [Openstack] Problems with path, prefix and delimiter with Object Storage

2011-03-17 Thread John Dickinson
A path query requires directory marker objects to be present (http://docs.openstack.org/openstack-object-storage/developer/content/ch03s02.html#d5e514) I would recommend using prefix+delimiter over path. Path query parameters are in swift to support backwards compatibility with the original Clou

Re: [Openstack] Request help choosing a topic to be developed on cloud computing

2011-04-04 Thread John Dickinson
> Hello, > > I do not know if you can help me, but if this is not the case, I > apologize in advance. > > my name is Khalid abbou, Moroccan, I am currently in 3rd yearengineering > student at the National Institute of Posts andTelecommunications (INPT), and > as part of my final projec

  1   2   >