Re: [Openstack] Use of IANA-registered ports

2011-01-03 Thread Michael Barton
On Sun, Jan 2, 2011 at 7:57 PM, Ewan Mellor ewan.mel...@eu.citrix.com wrote: We've got some complications though: http://swift.openstack.org/howto_installmultinode.html says Auth node: ... This can be on the same node as a Proxy node and Storage nodes: Runs the swift-account-server,

Re: [Openstack] Queue Service

2011-02-14 Thread Michael Barton
On Mon, Feb 14, 2011 at 7:57 PM, Paul Voccio paul.voc...@rackspace.com wrote: Looking at the swift docs, they reference a container like so:  METHOD /v1/account/container HTTP/1.1 Yeah, this has worked out well for us. Delegated access, authentication methods that don't provide the account

Re: [Openstack] Queue Service, next steps

2011-02-18 Thread Michael Barton
On Fri, Feb 18, 2011 at 5:22 PM, Eric Day e...@oddments.org wrote: The main question right now is where to land on the spectrum of service efficiency vs ease of development (C/C++ on one end and Python on the other). It seems we're landing in the middle with Erlang. :) Maybe I'm describing a

Re: [Openstack] Queue Service, next steps

2011-02-18 Thread Michael Barton
On Fri, Feb 18, 2011 at 6:23 PM, Eric Day e...@oddments.org wrote: Perhaps I've been assuming some things, but I thought everyone understood that is what we are looking to build (fault-tolerant, horizontally scalable, ...). We're certainly not looking to build a clustered queue (like RabbitMQ)

Re: [Openstack] Entities in OpenStack Auth

2011-03-02 Thread Michael Barton
Swift Swift has the concept of accounts, users, and groups. An account contains users, and a user can belong to groups. Accounts names have an abstraction layer, so while you may login with account example.com, the account name used within swift is a UUID with a prefix. By default, a user

Re: [Openstack] State of OpenStack Auth

2011-03-02 Thread Michael Barton
On Wed, Mar 2, 2011 at 2:38 PM, Soren Hansen so...@ubuntu.com wrote: I'd like to just mention this blog post:   http://www.imperialviolet.org/2010/06/25/overclocking-ssl.html tl;dr quote:    If you stop reading now you only need to remember one thing:    SSL/TLS is not computationally

Re: [Openstack] Feature Freeze status

2011-03-31 Thread Michael Barton
I'm gonna +1 Todd. Actually, apache server has a great dev process. They have goals for releases, but people are welcome to submit patches to their mailing list any time, get comments on them, then they're merged if and when people vote them as ready. -- Mike

Re: [Openstack] Logging, 500, Debugging

2011-04-04 Thread Michael Barton
On Mon, Apr 4, 2011 at 4:50 PM, Zed A. Shaw zeds...@zedshaw.com wrote: I'm currently trying to debug some changes to the Swift proxy server and finding the logging facilities a little obtuse.  Reading through: Most tracebacks should go to the logs, but yeah, there just isn't a lot of

Re: [Openstack] Proposing an Identity Service in OpenStack (a.k.a. Auth)

2011-04-18 Thread Michael Barton
On Mon, Apr 18, 2011 at 12:15 PM, Eric Day e...@oddments.org wrote: We'll also want to decide if we need a default mechanism for OpenStack deployments, and if so, what should it be. We had a discussion previously and I think it was somewhere between token and HTTP basic w/ SSL. The reason for

Re: [Openstack] lunr reference iSCSI target driver

2011-05-02 Thread Michael Barton
of this is sort of at the proof of concept stage at the moment. -- Michael Barton ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https

Re: [Openstack] lunr reference iSCSI target driver

2011-05-02 Thread Michael Barton
On Mon, May 2, 2011 at 9:12 PM, Michael Barton mike-launch...@weirdlooking.com wrote: What I've been playing with is having a manifest that contains hashes of (4mb) chunks for the volume's backups.  When a user initiates a new backup, dm-snapshot does its thing and gives me a block device.  I

Re: [Openstack] Getting pagination right

2011-05-26 Thread Michael Barton
On Wed, May 25, 2011 at 2:40 PM, Jay Pipes jaypi...@gmail.com wrote: The pagination in Swift is not consistent. Inserts into the Swift databases in between the time of the initial query and the requesting the next page can result in rows from the original first page getting on the new second

Re: [Openstack] Issues with Packaging and a Proposal

2011-08-24 Thread Michael Barton
On Wed, Aug 24, 2011 at 3:11 PM, Soren Hansen so...@openstack.org wrote: Rackspace isn't doing their own packaging because of (lack of) Debian support. If they did, they'd have realised almost immediately that the packages actually build on Debian. They're doing it because there'll supposedly

Re: [Openstack] question about X-Timestamp header

2011-11-28 Thread Michael Barton
On Mon, Nov 28, 2011 at 9:04 PM, pf shineyear shin...@gmail.com wrote: hi all i think X-Timestamp header is come from the proxy servery to object storage node, the value is proxy server current time. if i have 2 or more proxy server run in one cluster, should i comfirm same

Re: [Openstack] why swift proxy server use poll not epoll??

2011-12-11 Thread Michael Barton
On Sun, Dec 11, 2011 at 4:08 AM, pf shineyear shin...@gmail.com wrote: hi all , can any one tell my the reson of swift proxy server http service use python eventlet poll not epoll? Sure. We had a problem where epoll failed to report a socket close event roughly one out of every bazillion

Re: [Openstack] Writes are faster than reads in Swift

2011-12-13 Thread Michael Barton
I can't explain it off the top of my head. I don't have a swift installation to play with at the moment, but it's conceivable that posix_fadvise is slower than we expect (drop_cache is called more frequently during reads than writes, iirc). That could be tested by making drop_cache a no-op in

Re: [Openstack] Writes are faster than reads in Swift

2011-12-13 Thread Michael Barton
On Tue, Dec 13, 2011 at 9:21 PM, Huang Zhiteng winsto...@gmail.com wrote: Can anyone explain why Swift doesn't want to utilize page cache _at all_? It's an artifact of the use case swift was built for - heavy on writes, and repeat reads (where a cache would help) are very rare. Having that

Re: [Openstack] Swift slow write performance

2011-12-19 Thread Michael Barton
On Mon, Dec 19, 2011 at 6:21 AM, Rustam Aliyev rus...@code.az wrote: The only thing which looks suspicious to me are these errors: Dec 18 04:01:28 ec01 object-server ERROR container update failed with 10.0.1.3:6001/d01 (saving for async update later): Timeout (3s) (txn:

Re: [Openstack] swift enforcing ssl?

2011-12-28 Thread Michael Barton
On Tue, Dec 27, 2011 at 2:11 PM, andi abes andi.a...@gmail.com wrote: Does the swift proxy enforce SSL connections if it's configured with a cert/key file? Or is it assumed that there's an external entity performing that? The Swift proxy's SSL support is probably only useful for light testing

Re: [Openstack] Swift Consistency Guarantees?

2012-01-17 Thread Michael Barton
On Tue, Jan 17, 2012 at 4:55 PM, Nikolaus Rath nikol...@rath.org wrote: Amazon S3 and Google Storage make very explicit (non-) consistency guarantees for stored objects. I'm looking for a similar documentation about OpenStack's Swift, but haven't had much success. I don't think there's any

[Openstack] gerrit account help

2012-03-09 Thread Michael Barton
Can someone help me? I think my gerrit account is boned. redbo@ubuntu:~/swift$ git review fatal: A Contributor Agreement must be completed before uploading: http://wiki.openstack.org/HowToContribute -- Mike ___ Mailing list:

Re: [Openstack] [keystone] v3 API draft (update and questions to the community)

2012-06-12 Thread Michael Barton
On Tue, Jun 12, 2012 at 3:24 AM, Gabriel Hurley gabriel.hur...@nebula.com wrote: To speak on the specific feature of pagination, the problem of 'corruption' by simultaneous writers is no excuse for not implementing it. You think Google, Facebook, Flickr, etc. etc. etc. don't have this

Re: [Openstack] [Swift] Lost of an object data file is not detected

2012-06-24 Thread Michael Barton
On Sun, Jun 24, 2012 at 9:05 PM, 山縣陽 bi.yamag...@gmail.com wrote: But if I removed the data file, no process detected it  and the data files was not recovered. Is this a bug?  or is there any way to detect a data file lost case? Nope, there's nothing that'll detect missing data files once the

Re: [Openstack] shuffle(nodes) in Swift

2012-07-05 Thread Michael Barton
On Thu, Jul 5, 2012 at 11:21 AM, Anatoly Legkodymov anat...@nexenta.com wrote: I propose removing shuffle(nodes) from proxy-server will make memory caching 3 times more efficient, without loosing in anything else. I don't know, this kind of stuff is pretty use case dependent. If you're not

Re: [Openstack] [Openstack swift][1.6.0] Regarding to swift api for Controlling a Large List of Containers

2012-08-28 Thread Michael Barton
On Tue, Aug 28, 2012 at 5:46 AM, Irene.Peng-彭怡欣-研究發展部 API like below: Curl –H ‘X-Auth-Token: Token_ID’ http://Proxy_website/Account?marker=bananalimit=2 I think you just need to put quotation marks around that URL -- the is causing the curl command to be backgrounded by the shell, and

Re: [Openstack] make swift.common.utils.streq_const_time more efficient

2012-09-13 Thread Michael Barton
That function's purpose is to compare strings without short-circuiting, to foil timing attacks against token comparisons or similar. On Thu, Sep 13, 2012 at 1:28 AM, Mike Green iasy...@gmail.com wrote: def streq_const_time(s1, s2): if len(s1) != len(s2): return False result

Re: [Openstack] General questions regarding zones and replicas

2012-10-08 Thread Michael Barton
On Mon, Oct 8, 2012 at 8:12 AM, Moritz Krinke mkri...@fotocommunity.net wrote: - I cannot change the number of replicas after creating the ring (e.g. changing it from 1 to 2) Not really. Logically it's not a difficult operation, there's just no code to do it. There was a patch a while back,

Re: [Openstack] ask for comments - Light weight Erasure code framework for swift

2012-10-17 Thread Michael Barton
Overall I've never been super enthusiastic about erasure codes for swift. Figuring out which blocks are missing then re-assembling them is a lot more difficult and expensive than what we do now. But if you can come up with a good scheme for identifying missing blocks and it doesn't double the

Re: [Openstack] [swift] how to configure NWR policy

2012-12-10 Thread Michael Barton
Does any of our documentation say NRW are directly configurable? It's not really quite that simple. N is a property of the cluster, chosen when you build the ring. W is always a simple majority of N. R is generally 1 (eventually consisten reads), but the client can request it be bumped to N (

Re: [Openstack] [Swift] Use JSON in object xattr

2013-04-06 Thread Michael Barton
On Sat, Apr 6, 2013 at 5:24 PM, Samuel Merritt s...@swiftstack.com wrote: Perhaps one of the original developers will chime in here. All I can really say is that when that decision was made, there was no inkling that portability would ever be a concern. Pickle was fast and effective.