Re: [Openstack] Download file from swift extremely slow

2017-01-10 Thread Christian Schwede
Hello Steve, On 09.01.2017 23:27, Steve Martinelli wrote: > Thanks for the hint Clay, we merged > https://review.openstack.org/#/c/417892/ - expect this issue to be > fixed in OpenStackClient 3.7.0. unfortunately the fix didn't help - the issue is still there. I left a comment in the bugreport,

Re: [openstack-dev] [TripleO] Fixing Swift rings when upscaling/replacing nodes in TripleO deployments

2017-01-05 Thread Christian Schwede
rcloud operational by > definition, so I think this is probably OK? > > Steve >> >> -Original Message- >> From: Christian Schwede [mailto:cschw...@redhat.com] >> Sent: Thursday, January 05, 2017 6:14 AM >> To: OpenStack Development Mailing List <openstac

[openstack-dev] [TripleO] Fixing Swift rings when upscaling/replacing nodes in TripleO deployments

2017-01-05 Thread Christian Schwede
Hello everyone, there was an earlier discussion on $subject last year [1] regarding a bug when upscaling or replacing nodes in TripleO [2]. Shortly summarized: Swift rings are built on each node separately, and if adding or replacing nodes (or disks) this will break the rings because they are no

Re: [openstack-dev] [Heat][TripleO] How to run mistral workflows via templates

2016-12-16 Thread Christian Schwede
> we're trying to address in TripleO a couple of use cases for which we'd > like to trigger a Mistral workflow from a Heat template. > > One example where this would be useful is the creation of the Swift > rings, which need some data related to the Heat stack (like the list of > Swift nodes and

[openstack-dev] [tripleo] Requesting FFE for improved Swift deployments

2016-08-29 Thread Christian Schwede
Hello, kindly asking for a FFE for a required setting to improve Swift-based TripleO deployments: https://review.openstack.org/#/c/358643/ This is required to land the last patch in a series of TripleO-doc patches: https://review.openstack.org/#/c/293311/

Re: [openstack-dev] [TripleO] Improving Swift deployments with TripleO

2016-08-22 Thread Christian Schwede
On 04.08.16 15:39, Giulio Fidente wrote: > On 08/04/2016 01:26 PM, Christian Schwede wrote: >> On 04.08.16 10:27, Giulio Fidente wrote: >>> On 08/02/2016 09:36 PM, Christian Schwede wrote: >>>> Hello everyone, >>> >>> thanks Christian, >>

Re: [openstack-dev] [TripleO] Improving Swift deployments with TripleO

2016-08-04 Thread Christian Schwede
On 04.08.16 10:27, Giulio Fidente wrote: > On 08/02/2016 09:36 PM, Christian Schwede wrote: >> Hello everyone, > > thanks Christian, > >> I'd like to improve the Swift deployments done by TripleO. There are a >> few problems today when deployed with the current

Re: [openstack-dev] [TripleO] Improving Swift deployments with TripleO

2016-08-03 Thread Christian Schwede
Thanks Steven for your feedback! Please see my answers inline. On 02.08.16 23:46, Steven Hardy wrote: > On Tue, Aug 02, 2016 at 09:36:45PM +0200, Christian Schwede wrote: >> Hello everyone, >> >> I'd like to improve the Swift deployments done by TripleO. There are a >&

[openstack-dev] [TripleO] Improving Swift deployments with TripleO

2016-08-02 Thread Christian Schwede
s! Thanks, Christian -- Christian Schwede _ Red Hat GmbH Technopark II, Haus C, Werner-von-Siemens-Ring 11-15, 85630 Grasbrunn, Handelsregister: Amtsgericht Muenchen HRB 153243 Geschaeftsfuehrer: Mark Hegarty, Charlie Peters, Michael

Re: [Openstack] Ring rebuild, multiple copies of ringbuilder file, wasRe: swift ringbuilder and disk size/capacity relationship

2016-04-28 Thread Christian Schwede
z and maybe *.builder as well), and then use something like this: ansible -a "src=rings/ dest=/etc/swift" -m copy -i inventory all That takes care of distributing your files to all nodes (you might need a few more options for authentication, but that's basically it). -- Christian -- Christ

Re: [Openstack-operators] 100% CPU and hangs if syslog is restarted

2015-05-28 Thread Christian Schwede
On 28.05.15 18:56, George Shuklin wrote: Today we've discover a very serious bug in juno: https://bugs.launchpad.net/nova/+bug/1459726 In short: if you're using syslog, and restart rsyslog, all APIs processes will eventually stuck with 100% CPU usage without doing anything. Is anyone

Re: [Openstack] Slowness of Swift

2015-05-08 Thread Christian Schwede
Hello, On 08.05.15 12:15, Tarak Mukherjee wrote: We have an use-case where we upload large object (2GB - 4GB) via form post. What we are observing is , it's taking 2 - 3hrs to get the upload completed . Our Setup is consist of Haproxy = Swift-Proxy = Storage Node . any chance to test an

Re: [Openstack] Savana/Swift large object copy error

2015-05-06 Thread Christian Schwede
Hello Ross, On 05.05.15 21:54, Ross Lillie wrote: My understanding is that Swift should automagically split files greater that 5G into multiple segments grouped under a metafile but this appears to not be working. This was working under the Havana release (Ubuntu) using the Swift File System

Re: [Openstack] [Swift] tmp directory causing Swift slowdown

2015-05-01 Thread Christian Schwede
On 01.05.15 20:33, Samuel Merritt wrote: On 5/1/15 7:55 AM, Uwe Sauter wrote: Am 01.05.2015 um 02:21 schrieb Samuel Merritt: It seems like 1430268763.41931.data would be in the same allocation group as objects/757/a94/bd77129a1cae9e32381776e322efca94, and bd77129a1cae9e32381776e322efca94

Re: [openstack-dev] [swift] On Object placement

2015-02-19 Thread Christian Schwede
Hello Jonathan, On 18.02.15 18:13, Halterman, Jonathan wrote: 1. Swift should allow authorized services to place a given number of object replicas onto a particular rack, and onto separate racks. This is already possible if you use zones and regions in your ring files. For example, if you

Re: [openstack-dev] [swift] On Object placement

2015-02-18 Thread Christian Schwede
Hello Jonathan, On 17.02.15 22:17, Halterman, Jonathan wrote: Various services desire the ability to control the location of data placed in Swift in order to minimize network saturation when moving data to compute, or in the case of services like Hadoop, to ensure that compute can be moved to

Re: [Openstack] [Swift] Browser-based Health Visualization

2015-01-27 Thread Christian Schwede
Hello Adam, Swift is able to send metrics to a statsd server, and thus you can create your own metric dashboard using graphite-web. I would add collectd for some basic server metrics (like cpu, memory, load, network traffic) as well. It requires a little bit of work, but it gives you a very

[OpenStack-Infra] Software Factory Openstack Infra Collaboration

2015-01-14 Thread Christian Schwede
Hello all, we built an internal development platform called Software Factory and opened it up under an Apache License on Github. While we essentially use the same tools as the openstack-infra team, like Gerrit, Zuul, Jenkins; our deployment is quite different with eDeploy and Heat for

Re: [Openstack] [swift] [ceph-backend]

2014-12-23 Thread Christian Schwede
On 23.12.14 03:08, Mark Kirkwood wrote: I've been taking a look at this (https://github.com/stackforge/swift-ceph-backend and forks etc). Looks good. 1/ Async updates There's a comment in rados_server.py about not handling these. What exactly is the issue? (I note in Juno we need to add a

Re: [Openstack] (Juno) Multiple rings Swift

2014-12-23 Thread Christian Schwede
On 22.12.14 21:00, Amit Anand wrote: Thanks Christian I think thats exactly what I needed - I will try and make 2 new rings and see how that works. You wouldnt per chance know how I would limit the replicas, ie 2 in the Paris region and 1 at HQ? I only want one replica to goto the HQ region...

Re: [Openstack] (Juno) Multiple rings Swift

2014-12-23 Thread Christian Schwede
However, make sure the weights in your regions/zones are equally distributed to ensure replicas are equally distributed as well. Please not that you should avoid to run a Swift cluster close to 100% capacity. Christian On Tue, Dec 23, 2014 at 1:43 PM, Christian Schwede christian.schw

Re: [Openstack] (Juno) Multiple rings Swift

2014-12-22 Thread Christian Schwede
On 22.12.14 19:11, Amit Anand wrote: Now I want to try and do the following below: http://techs.enovance.com/7094/openstack-swift-2-0-introducing-storage-policies So pretty much have a Paris and Montreal center as described - I want to add a third datacenter to each as replication. So it

Re: [openstack-dev] [swift] LTFS integration with OpenStack Swift for scenario like - Data Archival as a Service .

2014-11-17 Thread Christian Schwede
On 14.11.14 20:43, Tim Bell wrote: It would need to be tiered (i.e. migrate whole collections rather than files) and a local catalog would be needed to map containers to tapes. Timeouts would be an issue since we are often waiting hours for recall (to ensure that multiple recalls for the same

Re: [Openstack] [swift] openstack swift PUT object question

2014-10-10 Thread Christian Schwede
On Fri, Oct 10, 2014 at 7:44 AM, dboyzhong dboyzh...@163.com mailto:dboyzh...@163.com wrote: Hi. when i put a object(1K) to swift cluster, the performance is so bad, QPS only 16. and i found the function: _finalize_put in file Diskfile.py cost too much time . mainly caused by the fsync()

Re: [Openstack] swift shows double port

2014-07-30 Thread Christian Schwede
Hi Remo, most likely the exception message itself is wrong (the shown double port), but it got fixed a while ago: https://github.com/openstack/python-swiftclient/commit/2e1a5b7e28211b0b2e2f7a2f961d7fcbd7e8abe3 Can you access the proxy server logs to see what's going on there? Christian Am

Re: [Openstack] openstack swift django browser

2014-04-03 Thread Christian Schwede
Hi, Am 03.04.14 13:30, schrieb Ankit Deshwal: Hello everyone sir i am able to upload or download through swift CLI. After changing that file i am able to access newly created account through browser. But why i have to put . admin after every user..??? The .admin is simply a group

Re: [Openstack] Problem accessing newly created Swift Account on Django Browser.

2014-04-01 Thread Christian Schwede
Hi, are you abled to up-/download with the new user using the CLI? The pasted commands are not sufficient to create a user in Swift if you're using tempauth, keystoneauth or swauth. Assuming you're using tempauth you have to add the accounts/users to /etc/swift/proxy-server.conf.

Re: [Openstack] Django-Swift-Browser

2014-03-31 Thread Christian Schwede
Hi, yes, you can use swiftbrowser to access Swift using tempauth. I use a local Swift all in one installation for testing as well. Christian Am 31.03.14 13:24, schrieb Ashish Dobhal: Hey everyone I have the following queries regarding openstack swift.Please help. 1.Can I use the swift

Re: [Openstack] Pip Error In Swift Installation (Swift All in One tutorial for a single node)

2014-03-28 Thread Christian Schwede
: Thanks Sir, i also want to know when to make the update.Before the swift installation or before running sudo pip install -r swift/test-requirements.txt*_ command. On Wed, Mar 26, 2014 at 12:47 PM, Christian Schwede christian.schw...@enovance.com

Re: [Openstack] problem in log in django swiftbrowser

2014-03-03 Thread Christian Schwede
Hello Pragya, please collect the static files in step 5 from the Readme: python manage.py collectstatic If you didn't changed ALLOWED_HOSTS and run swiftbrowser with Debug = False (default) you also need to run the development server with the --insecure option (step 6 in the Readme). python

Re: [Openstack] problem in installing django-swiftbrowser

2014-02-24 Thread Christian Schwede
Hello Pragya, 5. root@pragya-VirtualBox:~/Django-1.6.2# python runtests.py and get the following error: ERROR 1: python: can't open file 'runtests.py': [Errno 2] No such file or directory you're still in the Django-1.6.2 directory, you need to change to the directoy django-swiftbrowser to

Re: [Openstack] problem in installing django-swiftbrowser

2014-02-18 Thread Christian Schwede
Hello, Am 19.02.14 06:48, schrieb pragya jain: 6. root@pragya-VirtualBox:~/django-swiftbrowser/setuptools-2.2# sudo python ./setup.py install 7. root@pragya-VirtualBox:~/django-swiftbrowser# python runtests.py and I got the following error : Traceback (most recent call last): File

Re: [openstack-dev] [Swift] domain-level quotas

2014-01-22 Thread Christian Schwede
Hi Matthieu, Am 22.01.14 20:02, schrieb Matthieu Huin: The idea is to have a middleware checking a domain's current usage against a limit set in the configuration before allowing an upload. The domain id can be extracted from the token, then used to query keystone for a list of projects

Re: [Openstack] Q: Switft OwnCloud

2013-12-17 Thread Christian Schwede
Am 17.12.13 06:14, schrieb Frans Thamura: or is there alternative to use swift as file sharing in office and on internet There is also an alternative webclient, you can find it here: https://github.com/cschwede/django-swiftbrowser Christian ___

Re: [openstack-dev] [Swift] Increase Swift ring partition power

2013-12-03 Thread Christian Schwede
Am 02.12.13 17:10, schrieb Gregory Holt: On Dec 2, 2013, at 9:48 AM, Christian Schwede christian.schw...@enovance.com wrote: That sounds great! Is someone already working on this (I know about the ongoing DiskFile refactoring) or even a blueprint available? There is https

[openstack-dev] [Swift] Increase Swift ring partition power

2013-12-02 Thread Christian Schwede
Hello together, I'd like to discuss a way to increase the partition power of an existing Swift cluster. This is most likely interesting for smaller clusters that are growing beyond their original planed size. As discussed earlier [1] a rehashing is required after changing the partition power to

Re: [openstack-dev] [Swift] Increase Swift ring partition power

2013-12-02 Thread Christian Schwede
Am 02.12.13 15:47, schrieb Gregory Holt: Achieving this transparently is part of the ongoing plans, starting with things like the DiskFile refactoring and SSync. The idea is to isolate the direct disk access from other servers/tools, something that (for instance) RSync has today. Once the

Re: [openstack-dev] [Swift] Goals for Icehouse

2013-11-20 Thread Christian Schwede
Thanks John for the summary - and all contributors for their work! Others are looking in to how to grow clusters (changing the partition power) I'm interested who else is also working on this - I successfully increased partition power of several (smaller) clusters and would like to discuss

Re: [openstack-dev] [Swift] erasure codes, digging deeper

2013-07-18 Thread Christian Schwede
A solution to this might be to set the default policy as a configuration setting in the proxy. If you want a replicated swift cluster just allow this policy in the proxy and set it to default. The same for EC cluster, just set the allowed policy to EC. If you want both (and let your users decide