Re: [Openstack] [SWIFT] Account reaping - gradually

2013-07-15 Thread Samuel Merritt
On 7/15/13 6:52 AM, Leandro Reox wrote: Hi guys, I was wondering if there any plans or maybe already exist a feature or a flag for the account reaping process to make it gradually. We had one case with an account with millions of files, that was plain deleted, an that triggers the deletion of

Re: [Openstack] [Swift] Try to get the final status of PUT and timeout

2013-07-12 Thread Samuel Merritt
On 7/12/13 12:34 AM, Jonathan Lu wrote: Hi, all stackers, I test the cluster and get such error msg: Jul 12 11:23:57 ubuntu-12 proxy-server ERROR with Object server 192.168.1.161:60 00/xvdb1 re: Trying to get final status of PUT to /v1/AUTH_test/test_8/e9a243cb0

Re: [Openstack] ring building absolut drive names

2013-07-10 Thread Samuel Merritt
On 7/10/13 2:25 AM, Axel Christiansen wrote: Hello List, does one has to use the real device names in ring-building, like: swift-ring-builder account.builder add z5-10.0.6.204:6002/sda4 100 Here it is sda4. Can one use the partition UUID value or the mount point? It's really a mount point,

Re: [Openstack] Configuring tempurl in Openstack Swift

2013-04-30 Thread Samuel Merritt
The tempurl key is just a metadata attribute on the account with a particular name. swiftclient already supports setting metadata on accounts (and containers and objects); no changes are needed. $ swift post -m temp-url-key:correcthorsebatterystaple On 4/30/13 10:43 AM, Shrinand Javadekar

Re: [Openstack] [Swift] Use JSON in object xattr

2013-04-06 Thread Samuel Merritt
On 4/6/13 11:13 AM, Victor Rodionov wrote: Hello, Now in Swift object server (swift.object.server.DiskFile) for serialization objects meta data used python cPickle module. So the question is why not use other portable serialization format for this, for example JSON? If you're asking why the

Re: [Openstack] Unable to start swift proxy service

2013-02-05 Thread Samuel Merritt
On 2/5/13 9:04 AM, Guillaume Hilt wrote: Hello, I installed swift on Ubuntu 12.04 AMD64 following this howto: http://docs.openstack.org/developer/swift/howto_installmultinode.html However, although the storage nodes work fine, I can't start the proxy node : Feb 5 18:00:06 srv13 proxy-server

Re: [Openstack] [OpenStack][Swift] Calculating necessary disk space with replication

2013-01-03 Thread Samuel Merritt
On 1/3/13 7:07 AM, Leander Bessa Beernaert wrote: Hello all, Could some please confirm my analysis of the ring creation in swift? I need to run a few benchmarks on a set of data (200GB) total and need it to be replicated at least 3 times. From the Swift docs [1], I understood that the

Re: [Openstack] Expanding Storage - Rebalance Extreeemely Slow (or Stalled?)

2012-10-22 Thread Samuel Merritt
On 10/22/12 9:38 AM, Emre Sokullu wrote: Hi folks, At GROU.PS, we've been an OpenStack SWIFT user for more than 1.5 years now. Currently, we hold about 18TB of data on 3 storage nodes. Since we hit 84% in utilization, we have recently decided to expand the storage with more disks. In order to

Re: [Openstack] ask for comments - Light weight Erasure code framework for swift

2012-10-17 Thread Samuel Merritt
On 10/15/12 5:36 PM, Duan, Jiangang wrote: Some of our customers are interested in Erasure code than tri-replicate to save disk space. We propose a BP Light weight Erasure code framework for swift, which can be found here https://blueprints.launchpad.net/swift/+spec/swift-ec The general idea

Re: [Openstack] shuffle(nodes) in Swift

2012-07-05 Thread Samuel Merritt
On 7/5/12 9:21 AM, Anatoly Legkodymov wrote: Good day, File proxy/server.py contains following construction several times (simplifed): nodes = ring.get_nodes() shuffle(nodes) for node in nodes: ... I found it useful for balancing from the first sight, but deeper

Re: [Openstack] [Swift] Interested in implementing swift ring builder server

2012-06-19 Thread Samuel Merritt
On 6/19/12 12:13 PM, John Dickinson wrote: It looks like Florian (at Rackspace) is working on that blueprint. He just assigned it to himself. I'm happy to hear that you have some extra devs for swift work. I'd love to help coordinate some swift goals with you. Off the top of my head, here