Re: [openstack-dev] Gantt project

2014-08-12 Thread John Dickinson
Thanks for the info. It does seem like most OpenStack projects have some concept of a scheduler, as you mentioned. Perhaps that's expected in any distributed system. Is it expected or assumed that Gantt will become the common scheduler for all OpenStack projects? That is, is Gantt's plan

Re: [openstack-dev] [all] The future of the integrated release

2014-08-12 Thread John Dickinson
On Aug 12, 2014, at 11:08 AM, Doug Hellmann d...@doughellmann.com wrote: On Aug 12, 2014, at 1:44 PM, Dolph Mathews dolph.math...@gmail.com wrote: On Tue, Aug 12, 2014 at 12:30 AM, Joe Gordon joe.gord...@gmail.com wrote: On Fri, Aug 8, 2014 at 6:58 AM, Kyle Mestery

Re: [openstack-dev] [Swift] Can gatekeeper middleware be removed from pipeline?

2014-08-19 Thread John Dickinson
If you do not have the gatekeeper explicitly referenced in your proxy pipeline, Swift will automatically add it. --John On Aug 19, 2014, at 3:09 AM, Daisuke Morita morita.dais...@lab.ntt.co.jp wrote: Hi, Can gatekeeper middleware be removed from pipeline? This does not mean that i

Re: [openstack-dev] [all] [ptls] The Czar system, or how to scale PTLs

2014-08-22 Thread John Dickinson
I think Anne makes some excellent points about the pattern being proposed being unlikely to be commonly implemented across all the programs (or, at best, very difficult). Let's not try to formalize another best practice that works many times and force it to work every time. Here's an alternate

[openstack-dev] [Swift] 2.1.0-rc tagged

2014-08-25 Thread John Dickinson
Swift 2.1.0.rc1 has been tagged as our release candidate for 2.1.0. The plan is to let this RC soak for a week and then do the final release on Sept 1. Please check it out and report any issues that you find. Tag applied:

[openstack-dev] [Swift] Swift 2.1.0 released

2014-09-01 Thread John Dickinson
I'm happy to announce that Swift 2.1.0 has been released. This release includes several useful features that I'd like to highlight. First, Swift's data placement algorithm was slightly changed to improve adding capacity. Specifically, now when you add a new region to an existing Swift cluster,

Re: [openstack-dev] [Swift] (Non-)consistency of the Swift hash ring implementation

2014-09-07 Thread John Dickinson
To test Swift directly, I used the CLI tools that Swift provides for managing rings. I wrote the following short script: $ cat remakerings #!/bin/bash swift-ring-builder object.builder create 16 3 0 for zone in {1..4}; do for server in {200..224}; do for drive in {1..12}; do swift-ring-builder

Re: [openstack-dev] Log Rationalization -- Bring it on!

2014-09-17 Thread John Dickinson
On Sep 17, 2014, at 8:43 PM, Jay Faulkner j...@jvf.cc wrote: Comments inline. -Original Message- From: Monty Taylor [mailto:mord...@inaugust.com] Sent: Wednesday, September 17, 2014 7:34 PM To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] Log Rationalization --

Re: [openstack-dev] [release] client release deadline - Sept 18th

2014-09-17 Thread John Dickinson
I just release python-swiftclient 2.3.0 In addition to some smaller changes and bugfixes, the biggest changes are the support for Keystone v3 and a refactoring that allows for better testing and extensibility of the functionality exposed by the CLI.

Re: [openstack-dev] Thoughts on OpenStack Layers and a Big Tent model

2014-09-19 Thread John Dickinson
On Sep 19, 2014, at 5:46 AM, John Griffith john.griff...@solidfire.com wrote: On Fri, Sep 19, 2014 at 4:33 AM, Thierry Carrez thie...@openstack.org wrote: Vishvananda Ishaya wrote: Great writeup. I think there are some great concrete suggestions here. A couple more: 1. I think we

[openstack-dev] [Swift] Release of Swift 1.11.0

2013-12-12 Thread John Dickinson
I'm happy to announce that we've released Swift 1.11.0. You can find the high-level Launchpad details (including a link to the tarball) at https://launchpad.net/swift/icehouse/1.11.0. As always, you can upgrade to this release without any downtime to your users. Swift 1.11.0 is the work of 26

Re: [openstack-dev] upgrade Swift to Havana

2013-12-15 Thread John Dickinson
The basic upgrade process for all versions of Swift follow the same basic pattern: First for storage nodes: On a single canary node: 1) stop background processes 2) upgrade packages 3) restart/reload main processes 4) start background processes And if everything goes well there, perform the

Re: [openstack-dev] meeting times and rotations etc...

2013-12-19 Thread John Dickinson
Another option would be to use what we already have to our benefit. Instead of trying to provision two meeting rooms (-meeting and -meeting-alt), use the various other IRC channels that we already have for team meetings. This would allow for meetings to be at the same time, but it would free up

Re: [openstack-dev] [All] tagged commit messages

2013-12-29 Thread John Dickinson
On Dec 29, 2013, at 2:05 PM, Michael Still mi...@stillhq.com wrote: On Mon, Dec 30, 2013 at 8:12 AM, John Dickinson m...@not.mn wrote: I've seen several disconnected messages about tags in commit messages. I've seen what is possible with the DocImpact tag, and I'd like to have some more

Re: [openstack-dev] [All] tagged commit messages

2013-12-29 Thread John Dickinson
On Dec 29, 2013, at 5:24 PM, Michael Still mi...@stillhq.com wrote: On Mon, Dec 30, 2013 at 11:51 AM, John Dickinson m...@not.mn wrote: On Dec 29, 2013, at 2:05 PM, Michael Still mi...@stillhq.com wrote: [snip] Perhaps step one is to work out what tags we think are useful and at what

Re: [openstack-dev] Keystone Apache2 WSGI Fails when Token 8190 Bytes

2014-01-16 Thread John Dickinson
Yep, you should follow https://bugs.launchpad.net/keystone/+bug/1190149 and the related patches in each project. --John On Jan 16, 2014, at 10:30 PM, Miller, Mark M (EB SW Cloud - RD - Corvallis) mark.m.mil...@hp.com wrote: Hello, I have come across a bug or limitation when using an

[openstack-dev] [Swift] release 1.12.0

2014-01-28 Thread John Dickinson
Today I'm happy to announce that we have released Swift 1.12.0. As always, this is a stable release and you can upgrade to this version of Swift with no customer downtime. You can download the code for this release at https://launchpad.net/swift/icehouse/1.12.0 or bug your package provider for

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread John Dickinson
I've been keeping an eye on this thread, and it seems I actually have a few minutes to spend on a response today. To first answer the specific question, while there are some minor technical concerns about oslo logging, the bigger concerns are non-technical. Some things I'm concerned about from

Re: [openstack-dev] [nova] vmware minesweeper

2014-02-05 Thread John Dickinson
On Feb 5, 2014, at 4:04 PM, Ryan Hsu r...@vmware.com wrote: Also, I have added a section noting crucial bugs/patches that are blocking Minesweeper. Can we just put flags around them and move on? signature.asc Description: Message signed with OpenPGP using GPGMail

[openstack-dev] [Swift] meeting time updated

2014-02-06 Thread John Dickinson
Historically, the Swift team meetings have been every other week. In order to keep better track of things (and hopefully to get more specific attention on languishing reviews), we're moving to a weekly meeting schedule. New meeting time: every Wednesday at 1900UTC in #openstack-meeting The

Re: [openstack-dev] Ready to import Launchpad Answers into Ask OpenStack

2014-02-06 Thread John Dickinson
Sounds like a good plan. My only concern with the import is that the users are matched up, and it looks like that's being handled. The only reason I've wanted to keep LP Answers open is to not lose that content, and this takes care of that. Thanks for doing it, and lgtm. --John On Feb 6,

[openstack-dev] [All] Fixed recent gate issues

2014-02-14 Thread John Dickinson
As many of you surely noticed, we had some significant significant gate issues in the last day. It's fixed now, and I've got the details below. The root cause of the issue was a lack of proper testing in python- swiftclient. We've made some improvements here in the last few hours, but improving

[openstack-dev] python-swiftclient releases

2014-02-14 Thread John Dickinson
I'm pleased to announce a couple of big releases for python-swiftclient: versions 1.9.0 and 2.0.2. You can find them both on PyPI: https://pypi.python.org/pypi/python-swiftclient/2.0.2 https://pypi.python.org/pypi/python-swiftclient/1.9.0 So why the two releases? The 2.0.2 release is the result

[openstack-dev] [Swift] Swift 1.13.0 released

2014-03-03 Thread John Dickinson
I'm please to announce that OpenStack Swift 1.13 has been released. This release has some important new features (highlighted below), and it also serves as a good checkpoint before Swift's final release in the Icehouse cycle. Launchpad page for this release:

Re: [openstack-dev] [nova][swift] Importing Launchpad Answers in Ask OpenStack

2014-03-03 Thread John Dickinson
Thanks for doing this, Stef. I've closed LP answers for Swift. All new questions should go to ask.openstack.org --John On Mar 3, 2014, at 3:26 PM, Stefano Maffulli stef...@openstack.org wrote: And we're done! All questions and answers on Launchpad Answers have been imported in Ask

Re: [openstack-dev] Pecan Evaluation for Marconi

2014-03-19 Thread John Dickinson
On Mar 19, 2014, at 12:27 PM, Julien Danjou jul...@danjou.info wrote: On Wed, Mar 19 2014, Kurt Griffiths wrote: That begs the question, *why* is that unlikely to change? Because that project is Swift. If you look at the Swift code, you'll see that swob is not a replacement for either

[openstack-dev] [Swift] Swift storage policies in Icehouse

2014-03-24 Thread John Dickinson
tl;dr: Icehouse won't have storage policies; merging the work into master will be in logical chunks after Swift's contribution to the Icehouse release. Here's a quick update on what's been going on in the Swift community with storage policies. Many Swift contributors have been working on

Re: [openstack-dev] [Swift] Swift storage policies in Icehouse

2014-03-25 Thread John Dickinson
On Mar 25, 2014, at 12:11 PM, Kurt Griffiths kurt.griffi...@rackspace.com wrote: As a quick review, storage policies allow objects to be stored across a particular subset of hardware...and with a particular storage algorithm Having worked on backup software in the past, this sounds

[openstack-dev] [Swift] new core members

2014-03-27 Thread John Dickinson
I'm pleased to announce that Alistair Coles and Christian Schwede have both joined the Swift core team. They have both been very active in the Swift community, contributing both code and reviews. Both Alistair and Christian work with large-scale production Swift clusters, and I'm happy to have

[openstack-dev] [Swift] PTL candidacy

2014-03-31 Thread John Dickinson
I'm announcing my candidacy for Swift PTL. I've been involved with Swift specifically and OpenStack in general since the beginning. I'd like to continue to serve in the role as Swift PTL. Swift has grown quite a bit over the last 4 years. In this past year, we've added major new features

[openstack-dev] TC candidacy

2013-10-10 Thread John Dickinson
I'd like to announce my candidacy to the OpenStack Technical Committee. As the Swift PTL, I've been involved in the TC for a while (and the PPB before that and the POC before that). I've seen OpenStack grow the very beginning, and I'm very proud to be a part of it. As we all know, OpenStack

Re: [openstack-dev] [Swift] Porting swiftclient to Python 3?

2013-10-12 Thread John Dickinson
Co-reviewing each other's patches and discussing changes in #openstack-swift would be good ways to ensure that you are working in the same direction. --John On Oct 12, 2013, at 3:49 PM, Brian Curtin brian.cur...@rackspace.com wrote: Hi, I just had a look at the python-swiftclient reviews

[openstack-dev] [Swift] team meeting

2013-10-14 Thread John Dickinson
This week's team meeting is cancelled since most of the active contributors will all be together in Austin for the Swift hackathon during the regularly scheduled meeting time. Regular bi-weekly meetings will resume on October 30 at 1900UTC in #openstack-meeting --John signature.asc

Re: [openstack-dev] [Ceilometer][Horizon] The future or pagination

2013-11-13 Thread John Dickinson
Swift uses marker+limit for pagination when listing containers or objects (with additional support for prefix, delimiters, and end markers). This is done because the total size of the listing may be rather large, and going to a correct page based on an offset gets expensive and doesn't allow

[openstack-dev] [Swift] Goals for Icehouse

2013-11-20 Thread John Dickinson
During the past month, Swift contributors have gathered in Austin, Hong Kong, and online to discuss projects underway. There are some major efforts underway, and I hope to lay them out and tie them together here, so that we all know what the goals for the next six months are. The biggest feature

Re: [openstack-dev] [Swift] Goals for Icehouse

2013-11-20 Thread John Dickinson
Please keep those discussing in the open. #openstack-swift would be a great place to discuss what you did and figure out a general solution for others. --john On Nov 20, 2013, at 2:52 PM, Christian Schwede i...@cschwede.de wrote: Thanks John for the summary - and all contributors for their

[openstack-dev] [Swift] Pete Zaitcev added to core

2013-11-25 Thread John Dickinson
Pete Zaitcev has been involved with Swift for a long time, both by contributing patches and reviewing patches. I'm happy to announce that he's accepted the responsibility of being a core reviewer for Swift. Congrats, Pete. --John signature.asc Description: Message signed with OpenPGP using

Re: [openstack-dev] request-id in API response

2013-12-01 Thread John Dickinson
Just to add to the story, Swift uses X-Trans-Id and generates it in the outer-most catch_errors middleware. Swift's catch errors middleware is responsible for ensuring that the transaction id exists on each request, and that all errors previously uncaught, anywhere in the pipeline, are caught

Re: [openstack-dev] [Keystone] Store quotas in Keystone

2013-12-03 Thread John Dickinson
How are you proposing that this integrate with Swift's account and container quotas (especially since there may be hundreds of thousands of accounts and millions (billions?) of containers in a single Swift cluster)? A centralized lookup for quotas doesn't really seem to be a scalable solution.

Re: [openstack-dev] [Keystone] Store quotas in Keystone

2013-12-03 Thread John Dickinson
On Dec 3, 2013, at 8:05 AM, Jay Pipes jaypi...@gmail.com wrote: On 12/03/2013 10:04 AM, John Dickinson wrote: How are you proposing that this integrate with Swift's account and container quotas (especially since there may be hundreds of thousands of accounts and millions (billions

Re: [openstack-dev] request-id in API response

2013-12-05 Thread John Dickinson
On Dec 5, 2013, at 1:36 AM, Maru Newby ma...@redhat.com wrote: On Dec 3, 2013, at 12:18 AM, Joe Gordon joe.gord...@gmail.com wrote: On Sun, Dec 1, 2013 at 7:04 PM, John Dickinson m...@not.mn wrote: Just to add to the story, Swift uses X-Trans-Id and generates it in the outer-most

Re: [openstack-dev] masking X-Auth-Token in debug output - proposed consistency

2014-06-11 Thread John Dickinson
For both the security and the log line length, Swift is by default just displaying the first 16 bytes of the token. --John On Jun 11, 2014, at 12:39 PM, Morgan Fainberg morgan.fainb...@gmail.com wrote: This stems a bit further than just reduction in noise in the logs. Think of this from a

[openstack-dev] [Swift] Swift 2.0 release candidate

2014-06-22 Thread John Dickinson
Through extensive work from the entirety of the Swift dev team over the past year, storage policies have landed in Swift. Last Friday, we merged commit 1feaf6e2 which brings storage polices into master. I especially would like to publicly thank Paul Luse (Intel), Clay Gerrard (SwiftStack), and

Re: [openstack-dev] [swift] eventual consistency and lost updates

2014-06-27 Thread John Dickinson
Great questions. I'll answer inline. On Jun 27, 2014, at 2:54 AM, Eoghan Glynn egl...@redhat.com wrote: Hi Swiftsters! A basic question about swift eventual- versus strong-consistency. The context is potentially using swift as a store for metric data. Say datapoints {p1, p2, ..., p_i}

Re: [openstack-dev] [swift] add checking daemons existence in Healthcheck middleware

2014-07-07 Thread John Dickinson
In general, you're right. It's pretty important to know what's going on in the cluster. However, the checks for these background daemons shouldn't be done in the wsgi servers. Generally, we've stayed away from a lot of process monitoring in the Swift core. That it, Swift already works around

[openstack-dev] Swift 2.0.0 has been released and includes support for storage policies

2014-07-08 Thread John Dickinson
I'm happy to announce that Swift 2.0.0 has been officially released! You can get the tarball at http://tarballs.openstack.org/swift/swift-2.0.0.tar.gz. This release is a huge milestone in the history of Swift. This release includes storage policies, a set of features I've often said is the most

Re: [openstack-dev] [keystone/swift] role-based access cotrol in swift

2014-07-10 Thread John Dickinson
There are a couple of places to look to see the current dev effort in Swift around ACLs. In no particular order: * Supporting a service token in Swift https://review.openstack.org/#/c/105228/ * Adding policy engine support to Swift https://review.openstack.org/#/c/89568/ * Fixing ACLs to work

Re: [openstack-dev] [swift] statsd client opening a new socket everytime a stats is updated

2014-07-15 Thread John Dickinson
We've been chatting in IRC, but for the mailing list archives, yes! we'd love to see patches to improve this. --John On Jul 15, 2014, at 1:22 PM, Tatiana Al-Chueyr Martins tatiana.alchu...@gmail.com wrote: Hello! I'm new to both Swift and OpenStack, I hope you can help me. Considering

[openstack-dev] python-swiftclient 2.2.0 release

2014-07-22 Thread John Dickinson
I'm happy to announce that python-swiftclient 2.2.0 has been released. This release has the following significant features: * Ability to set a storage policy on container and object upload * Ability to generate Swift temporary URLs from the CLI and SDK * Added context-sensitive help to the CLI

Re: [openstack-dev] [swift] Use FQDN in Ring files instead of ip

2014-07-23 Thread John Dickinson
Using hostnames instead of IPs is, as mentioned above, something under consideration in that patch. However, note that until now, we've intentionally kept it as just IP addresses since using hostnames adds a lot of operational complexity and burden. I realize that hostnames may be preferred in

Re: [openstack-dev] [swift] Use FQDN in Ring files instead of ip

2014-07-23 Thread John Dickinson
to the node. If above understanding is true, it is better to have ability for using FQDN in Ring files in addition to ip addresses. What do you think? On Thursday, July 24, 2014 12:55 AM, John Dickinson wrote: However, note that until now, we've intentionally kept it as just IP addresses since

Re: [openstack-dev] [swift] Use FQDN in Ring files instead of ip

2014-07-23 Thread John Dickinson
of a decision, we've so-far defaulted to less code has less bugs and not yet written or merged it. --John On Jul 23, 2014, at 10:07 PM, Osanai, Hisashi osanai.hisa...@jp.fujitsu.com wrote: Thank you for the quick response. On Thursday, July 24, 2014 12:51 PM, John Dickinson wrote: you can

Re: [openstack-dev] Thoughts on the patch test failure rate and moving forward

2014-07-24 Thread John Dickinson
On Jul 24, 2014, at 3:25 PM, Sean Dague s...@dague.net wrote: On 07/24/2014 06:15 PM, Angus Salkeld wrote: On Wed, 2014-07-23 at 14:39 -0700, James E. Blair wrote: OpenStack has a substantial CI system that is core to its development process. The goals of the system are to facilitate

[openstack-dev] Paul Luse added to Swift Core

2014-07-30 Thread John Dickinson
I'm happy to share that Paul Luse has join Swift's core reviewer team. Paul has provided a ton of leadership, insight, and code during the past year. He was instrumental in getting storage policies written, and he's actively involved in the current work around erasure code support. Welcome,

Re: [openstack-dev] [all] specs.openstack.org is live

2014-08-04 Thread John Dickinson
Can you please add Swift as well? --John On Aug 4, 2014, at 9:54 AM, Andreas Jaeger a...@suse.com wrote: Great, I've updated my patch to add neutron and nova to the index page. For now read the specs using: http://specs.openstack.org/openstack/neutron-specs/

[openstack-dev] TC candidacy

2014-04-16 Thread John Dickinson
I'd like to announce my Technical Committee candidacy. I've been involved with OpenStack since it began. I'm one of the original authors of Swift, and I have been serving as PTL since the position was established. I'm employed by SwiftStack, a company building management and integration tools

Re: [openstack-dev] Voting for the TC Election is now open

2014-04-18 Thread John Dickinson
I put together links to every candidate's nomination email at https://wiki.openstack.org/wiki/Governance/TechnicalCommittee/candidates --John On Apr 18, 2014, at 8:29 AM, Anita Kuno ante...@anteaya.info wrote: On 04/18/2014 11:22 AM, Anita Kuno wrote: Voting for the TC Election is now

Re: [openstack-dev] Voting for the TC Election is now open

2014-04-18 Thread John Dickinson
I had completely missed the links Anita had put together. Use her list (ie the officially updated one). https://wiki.openstack.org/wiki/TC_Elections_April_2014#Candidates Sorry about that, Anita! --John On Apr 18, 2014, at 11:33 AM, John Dickinson m...@not.mn wrote: I put together links

[openstack-dev] [Swift] Initial summit schedule published

2014-04-22 Thread John Dickinson
I've pushed the initial schedule for the Swift summit sessions to http://junodesignsummit.sched.org. There were 21 sessions proposed for 8 available slots, so most are not able to be selected. (Thanks Cinder for taking one of our proposed ones!) Swift's sessions are split over two days. When

Re: [openstack-dev] Objects not getting distributed across the swift cluster...

2014-05-01 Thread John Dickinson
On May 1, 2014, at 10:32 AM, Shyam Prasad N nspmangal...@gmail.com wrote: Hi Chuck, Thanks for the reply. The reason for such weight distribution seems to do with the ring rebalance command. I've scripted the disk addition (and rebalance) process to the ring using a wrapper command.

Re: [openstack-dev] [neutron] explanations on the current state of config file handling

2014-05-04 Thread John Dickinson
To add some color, Swift supports both single conf files and conf.d directory-based configs. See http://docs.openstack.org/developer/swift/deployment_guide.html#general-service-configuration. The single config file pattern is quite useful for simpler configurations, but the directory-based

Re: [openstack-dev] Monitoring as a Service

2014-05-04 Thread John Dickinson
One of the advantages of the program concept within OpenStack is that separate code projects with complementary goals can be managed under the same program without needing to be the same codebase. The most obvious example across every program are the server and client projects under most

[openstack-dev] [Swift] This week's team meeting: summit prep

2014-05-05 Thread John Dickinson
This week's Swift team meeting will spend time looking at the Swift-related conference talks and summit design sessions. https://wiki.openstack.org/wiki/Meetings/Swift If you are leading a session topic or giving a conference talk, please attend this week's meeting. I want to make sure you

[openstack-dev] [all] process problem with release tagging

2014-05-05 Thread John Dickinson
tl;dr: (1) the current tag names used don't work and we need something else. (2) Swift (at least) needs to burn a release number with a new tag The current process of release is: 1) branch milestone-proposed (hereafter, m-p) from master 2) tag m-p with an RC tag (eg 1.13.1.rc1) * note that

Re: [openstack-dev] Concerns about the ballooning size of keystone tokens

2014-05-21 Thread John Dickinson
Can you explain how PKI info is compressible? I thought it was encrypted, which should mean you can't compress it right? --John On May 21, 2014, at 8:32 AM, Morgan Fainberg morgan.fainb...@gmail.com wrote: The keystone team is also looking at ways to reduce the data contained in the

Re: [openstack-dev] Concerns about the ballooning size of keystone tokens

2014-05-21 Thread John Dickinson
...@gmail.com wrote: On Wed, May 21, 2014 at 10:41 AM, John Dickinson m...@not.mn wrote: Can you explain how PKI info is compressible? I thought it was encrypted, which should mean you can't compress it right? They're not encrypted - just signed and then base64 encoded. The JSON (and especially

Re: [openstack-dev] Concerns about the ballooning size of keystone tokens

2014-05-21 Thread John Dickinson
On May 21, 2014, at 4:26 PM, Adam Young ayo...@redhat.com wrote: On 05/21/2014 03:36 PM, Kurt Griffiths wrote: Good to know, thanks for clarifying. One thing I’m still fuzzy on, however, is why we want to deprecate use of UUID tokens in the first place? I’m just trying to understand the

[openstack-dev] New release of python-swiftclient (now with py3 support)

2014-05-23 Thread John Dickinson
I'm happy to announce that python-swiftclient 2.1.0 has just been released! https://pypi.python.org/pypi/python-swiftclient/ This release includes support for Python 3.3. I want to specifically thank Tristan Cacqueray, Chmouel Boudjnah, Alex Gaynor, and Christian Schwede for working on the py3

[openstack-dev] [Swift] storage policies merge plan

2014-05-23 Thread John Dickinson
We've been working for a long time on the feature/ec branch in the swift repo. It's now done and needs to be merged into master to be generally available. Here's how the integration is going to work: 1) The feature/ec branch will be refactored into a series of dependent reviewable patches 2)

[openstack-dev] [Swift] storage policies are upon us; soft freeze in effect

2014-05-28 Thread John Dickinson
The series of patches implementing storage policies in Swift has been proposed to master. The first patch set is https://review.openstack.org/#/c/96026/. This is a major feature in Swift, and it requires a lot of work in reviewing and integrating it. In order to focus as reviewers, Swift is

[openstack-dev] [Swift] PTL candidacy

2014-09-25 Thread John Dickinson
I'm announcing my candidacy for Swift PTL. I've been involved with Swift specifically and OpenStack in general since the beginning. I'd like to continue to serve in the role as Swift PTL. In my last candidacy email[1], I talked about several things I wanted to focus on in Swift. 1) Storage

Re: [openstack-dev] TC election by the numbers

2014-10-29 Thread John Dickinson
On Oct 29, 2014, at 3:32 PM, Eoghan Glynn egl...@redhat.com wrote: Folks, I haven't seen the customary number-crunching on the recent TC election, so I quickly ran the numbers myself. Voter Turnout = The turnout rate continues to decline, in this case from 29.7% to

Re: [openstack-dev] URLs

2014-11-17 Thread John Dickinson
Adam, I'm not sure why you've marked Swift URLs as having their own scheme. It's true that Swift doesn't have the concept of admin URLs, but in general if Swift were to assume some URL path prefix, I'm not sure why it wouldn't work (for some definition of work). Other issues might be the fact

Re: [openstack-dev] [swift] [qa] which test configs does the swift team find useful

2014-11-25 Thread John Dickinson
This is great! Sean, I agree with your analysis. gate-swift-pep8 (yes) gate-swift-docs (yes) gate-swift-python27 (yes) gate-swift-tox-func (yes) check-swift-dsvm-functional (yes) check-tempest-dsvm-full(to further ensure glance/heat/cinder checking) check-grenade-dsvm (I can go either

[openstack-dev] [Swift] 1.9.0 release candidate

2013-06-26 Thread John Dickinson
The RC for Swift 1.9.0 has been cut, and baring any issues discovered, will be finalized next Tuesday. Please take some time to try it out and run through your tests. Cahngelog: https://github.com/openstack/swift/blob/milestone-proposed/CHANGELOG Launchpad milestone page:

Re: [openstack-dev] RFC: Basic definition of OpenStack Programs and first batch

2013-07-01 Thread John Dickinson
On Jul 1, 2013, at 8:03 AM, Mark McLoughlin mar...@redhat.com wrote: Hey Thierry I actually didn't notice this go by last week, the other thread got all the attention. On Wed, 2013-06-26 at 14:51 +0200, Thierry Carrez wrote: Hi everyone, Yesterday at the TC meeting we agreed that as

Re: [openstack-dev] RFC: Basic definition of OpenStack Programs and first batch

2013-07-01 Thread John Dickinson
I really like the Solution 2 proposal. On Jul 1, 2013, at 12:32 PM, Thierry Carrez thie...@openstack.org wrote: Thierry Carrez wrote: Solution (2) is to make everything a Program. Some have a goal of producing an 'integrated' piece and those must go through incubation. Something like:

Re: [openstack-dev] [Swift] failure node muting not working

2013-07-03 Thread John Dickinson
Take a look at the proxy config, starting here: https://github.com/openstack/swift/blob/master/etc/proxy-server.conf-sample#L70 The error_suppression_interval and error_suppression_limit control the window you are looking for. With the default values, 10 errors in 60 seconds will prevent the

[openstack-dev] [Swift] erasure codes, digging deeper

2013-07-17 Thread John Dickinson
Last week we wrote a blog post about introducting erasure codes into Swift. Today, I'm happy to share more technical details around this feature. We've posted an overview of our design and some of the tradeoffs in the feature at

Re: [openstack-dev] [Swift] erasure codes, digging deeper

2013-07-18 Thread John Dickinson
Boudjnah chmo...@enovance.com wrote: On Thu, Jul 18, 2013 at 12:42 AM, John Dickinson m...@not.mn wrote: * Erasure codes (vs replicas) will be set on a per-container basis I was wondering if there was any reasons why it couldn't be as per-account basis as this would allow an operator to have

Re: [openstack-dev] [Swift] erasure codes, digging deeper

2013-07-18 Thread John Dickinson
redundancy), I'm cool with that, just that it should be orthogonal to the implementation of EC. -- Chuck On Thu, Jul 18, 2013 at 12:57 PM, John Dickinson m...@not.mn mailto:m...@not.mn wrote: Are you talking about the parameters for EC or the fact that something is erasure coded

Re: [openstack-dev] [Swift] erasure codes, digging deeper

2013-07-22 Thread John Dickinson
are using. DH On Thu, Jul 18, 2013 at 9:37 PM, John Dickinson m...@not.mn wrote: Yes, and I'd imagine that the normal default would be for replicated data. Moving the granularity from a container to account-based, as Chmouel and Chuck said, is interesting too. --John On Jul 18, 2013

Re: [openstack-dev] [Swift] gate on functional tests

2013-08-06 Thread John Dickinson
They were non-voting. The change is that they are now voting. --John On Aug 5, 2013, at 9:17 PM, Chmouel Boudjnah chmo...@enovance.com wrote: On Mon, Aug 5, 2013 at 10:59 PM, John Dickinson m...@not.mn wrote: The Swift functional tests have been running as an advisory for a bit now on all

[openstack-dev] [Swift] Swift 1.9.9 RC available

2013-08-07 Thread John Dickinson
Today we have released Swift 1.9.1 (RC1). The tarball for the RC is at http://tarballs.openstack.org/swift/swift-milestone-proposed.tar.gz This release was initially prompted by a bug found by Peter Portante (https://bugs.launchpad.net/swift/+bug/1196932) and includes a patch for it. All

[openstack-dev] [Swift] Swift hackathon in October in Austin

2013-08-08 Thread John Dickinson
We (SwiftStack) are hosting a Swift Hackathon in Austin, Texas on October 15-17. We're bringing together Swift contributors to meet and hack for a few days. http://swifthackathon.eventbrite.com Our plan is to provide a few days of hacking together with just a few rules: 1) No slide decks and

[openstack-dev] [Swift] Swift 1.9.1 released

2013-08-13 Thread John Dickinson
Swift 1.9.1, as described below, has been released. Download links to the tarball are at https://launchpad.net/swift/havana/1.9.1 --John On Aug 7, 2013, at 10:21 AM, John Dickinson m...@not.mn wrote: Today we have released Swift 1.9.1 (RC1). The tarball for the RC is at http

[openstack-dev] [Swift] now with pbr

2013-08-20 Thread John Dickinson
A quick note to let everyone know that https://review.openstack.org/#/c/28892/ has merged and now means that Swift is using pbr for version numbers. This has a couple of consequences that need to be made public: 1) In order to migrate to using pbr, we consumed the 1.9.2 version. I have

[openstack-dev] [Swift] team meeting notes

2013-08-21 Thread John Dickinson
Notes from today's meeting are at http://eavesdrop.openstack.org/meetings/swift/2013/swift.2013-08-21-19.01.html --John signature.asc Description: Message signed with OpenPGP using GPGMail ___ OpenStack-dev mailing list

Re: [openstack-dev] [Infra] We've launched git.openstack.org

2013-08-23 Thread John Dickinson
Does this change affect the gerrit remote in any way? --John On Aug 23, 2013, at 2:48 PM, jebl...@openstack.org (James E. Blair) wrote: Michael Still mi...@stillhq.com writes: On Sat, Aug 24, 2013 at 4:20 AM, Elizabeth Krumbach Joseph l...@princessleia.com wrote: Hi everyone, Several

Re: [openstack-dev] [Swift] Protecting the access to memcache

2013-09-15 Thread John Dickinson
Alex, You raise two issues, so let me address them independently. First, you discuss protecting memcache for unauthorized access. Yes, this is something that every deployer of memcache (whether in conjunction with Swift or not) needs to consider. Unchecked access to memcache can allow

[openstack-dev] [Swift] PTL Candidacy

2013-09-24 Thread John Dickinson
I would like to nominate myself for PTL of Swift. I've been involved in OpenStack Swift since it started, and I'd like to share a few of the thins in-progress and where I want to see Swift go. Swift has always been a world-class storage system, proven at scale and production-ready from day one.

[openstack-dev] [Swift] python-swiftclient 1.7.0 released

2013-09-30 Thread John Dickinson
I tagged and released a new version of python-swiftclient this morning, specifically to get around some painful dependency issues (especially on older systems). Find the new version at https://pypi.python.org/pypi/python-swiftclient/1.7.0 on pypi. Below is the tag message: This release is

[openstack-dev] [all] Swift 2.2.1 rc (err c) 1 is available

2014-12-15 Thread John Dickinson
All, I'm happy to say that the Swift 2.2.1 release candidate is available. http://tarballs.openstack.org/swift/swift-2.2.1c1.tar.gz Please take a look, and if nothing is found, we'll release this as the final 2.2.1 version at the end of the week. This release includes a lot of great

[openstack-dev] Swift 2.2.1 released

2014-12-19 Thread John Dickinson
I'm happy to announce the release of Swift 2.2.1. The work of 28 contributors (including 8 first-time contributors), this release is definitely operator-centric. I recommend that you upgrade; as always you can upgrade to this release with no customer downtime. Get the release:

[openstack-dev] [Swift] Swift 2.2.2 released today

2015-02-02 Thread John Dickinson
Everyone, I'm happy to announce that today we have release Swift 2.2.2. (Yes, that's 2.2.2 on 2/2.) This release has a few very important features that came directly from production clusters. I recommend that you upgrade so you can take advantage of the new goodness. As always, you can upgrade

Re: [openstack-dev] The root-cause for IRC private channels (was Re: [all][tc] Lets keep our community open, lets fight for it)

2015-02-18 Thread John Dickinson
Story time. (For the record, the -swift channel is logged and I don't know of any private Swift IRC channels. I fully support logging every OpenStack IRC channel.) I can understand why people might be hesitant to have a publicly logged channel. About a year ago, one of the Swift core devs said

Re: [openstack-dev] [api][nova] Openstack HTTP error codes

2015-01-29 Thread John Dickinson
If you're going to make up your own extensions[1] to HTTP, why don't you use ones that are already used? http://support.microsoft.com/kb/943891 [1] ok, what's proposed isn't technically an extension, it's response body context for the response code. But response bodies are hard to modify

Re: [openstack-dev] [api][nova] Openstack HTTP error codes

2015-01-29 Thread John Dickinson
I think there are two points. First, the original requirement (in the first email on this thread) is not what's wanted: ...looking at the response body and HTTP response code an external system can’t understand what exactly went wrong. And parsing of error messages here is not the way we’d

Re: [openstack-dev] [all] Capability Discovery API

2015-03-17 Thread John Dickinson
On Mar 17, 2015, at 1:02 PM, Davis, Amos (PaaS-Core) amos.steven.da...@hp.com wrote: All, The Application EcoSystem Working Group realized during the mid-cycle meetup in Philadelphia that there is no way to get the capabilities of an Openstack cloud so that applications can measure

Re: [openstack-dev] [swift] auth migration and user data migration

2015-03-09 Thread John Dickinson
On Mar 9, 2015, at 9:46 AM, Weidong Shao weidongs...@gmail.com wrote: hi, I have a standalone swift cluster with swauth as the auth module. By standalone, I mean the cluster is not in the context of OpenStack, or keystone server. That's completely fine (and not uncommon at all).

  1   2   3   >