Re: [Openstack] Issue in debugging OpenStack Swift

2013-07-24 Thread Muhammad Kazim
@lists.launchpad.net *Subject:* Re: [Openstack] Issue in debugging OpenStack Swift ** ** Worked perfectly in the first attempt. Thanks a lot for the help. :) On Tue, Jul 23, 2013 at 10:41 AM, Gareth academicgar...@gmail.com wrote: the key reason it here: https://github.com/openstack

[Openstack] swift proxys and dedecated ceilometer

2013-07-24 Thread Axel Christiansen
Dear List, i am trying to figure out what ceilometer components nedds to bo installed an what nodes. I have 2 swift-proxy-hosts and 1 ceiloemeter-host These are the packages debian7 respectively the grizzly repo offers: ceilometer-agent-central - OpenStack efficient metering counters system

Re: [Openstack] swift proxys and dedecated ceilometer

2013-07-24 Thread Julien Danjou
On Wed, Jul 24 2013, Axel Christiansen wrote: Hi Axel, If you want to only meter Swift, you just need: ceilometer-agent-central ceilometer-collector And to retrieve your data: ceilometer-api -- Julien Danjou /* Free Software hacker * freelance consultant http://julien.danjou.info */

Re: [Openstack] swift proxys and dedecated ceilometer

2013-07-24 Thread Axel Christiansen
Hi Julien, thx a lot for the real quick help. Yes, only swift. These meters: storage.objects storage.objects.size storage.objects.containers storage.objects.incoming.bytes storage.objects.outgoing.bytes To be sure, the ceilometer-agent-central and ceilometer-collector do go on the proxys.

Re: [Openstack] swift proxys and dedecated ceilometer

2013-07-24 Thread Julien Danjou
On Wed, Jul 24 2013, Axel Christiansen wrote: To be sure, the ceilometer-agent-central and ceilometer-collector do go on the proxys. And just the ceilometer-api ist for the dedecated ceilometer-host? No, they all can go to your dedicated host. Ceilometer agent central access Swift via its API

Re: [Openstack] Issue in debugging OpenStack Swift

2013-07-23 Thread Muhammad Kazim
Worked perfectly in the first attempt. Thanks a lot for the help. :) On Tue, Jul 23, 2013 at 10:41 AM, Gareth academicgar...@gmail.com wrote: the key reason it here: https://github.com/openstack/swift/blob/master/swift/common/utils.py#L1047 you have many ways to stop flush IO; I prefer add

Re: [Openstack] Issue in debugging OpenStack Swift

2013-07-23 Thread Luse, Paul E
-bounces+paul.e.luse=intel@lists.launchpad.net] On Behalf Of Muhammad Kazim Sent: Tuesday, July 23, 2013 12:33 AM To: Gareth Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] Issue in debugging OpenStack Swift Worked perfectly in the first attempt. Thanks a lot for the help. :) On Tue, Jul

Re: [Openstack] Issue in debugging OpenStack Swift

2013-07-22 Thread Gareth
the key reason it here: https://github.com/openstack/swift/blob/master/swift/common/utils.py#L1047 you have many ways to stop flush IO; I prefer add a line stdio_files = [] after line 1037 On Sun, Jul 21, 2013 at 1:58 AM, Muhammad Kazim kazima...@gmail.com wrote: Hi all, I wanted to debug

[Openstack] Issue in debugging OpenStack Swift

2013-07-20 Thread Muhammad Kazim
Hi all, I wanted to debug Swift source code. I have a Devstack setup running on my machine that i have configured to only run keystone, mysql and swift. I have used pdb to debug source code. I was able to debug python-swiftclient, middleware (common), and proxy-server code. However, when i try

[Openstack] [Swift] Is it possible to use tempauth and tempurl together?

2013-07-17 Thread Jonathan Lu
Hi, all stackers, Can I use the tempauth and tempurl at the same time? I will set a long tempauth timeout time for internal service and a short tempurl timeout for the ohters? My proxy-server.conf is quite easy: [pipeline:main] pipeline = healthcheck cache tempurl tempauth

Re: [Openstack] [Swift] Is it possible to use tempauth and tempurl together?

2013-07-17 Thread Clay Gerrard
Yes tempurl and and tempauth are tessted together, your pipeline looks good. allow_overrides = false in the tempauth section could cause this, but it's default is true. Are you creating the tempurl's with bin/swift-temp-url ??? clayg@swift:~$ swift post -m temp-url-key:asdf clayg@swift:~$

Re: [Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage

2013-07-17 Thread Gabe Wong
- From: Chmouel Boudjnah chmo...@enovance.com Sent: Tuesday, July 16, 2013 2:45am To: Gabe Wong gabri...@ngasi.com Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage On Wed, Jul 10, 2013 at 4:14 PM, Gabe Wong gabri

Re: [Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage

2013-07-17 Thread Chmouel Boudjnah
/RelatedProjects, but got no response. Regards This is a document inside openstack swift : https://github.com/openstack/swift/blob/master/doc/source/associated_projects.rst you just need to submit a review updating the document in the source tree and this will get reviewed : https

Re: [Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage

2013-07-16 Thread Chmouel Boudjnah
On Wed, Jul 10, 2013 at 4:14 PM, Gabe Wong gabri...@ngasi.com wrote: Lots of work has been done to Caimito. In addition to bug fixes: - Faster request handling. - Better handling of files with spaces and other characters. Thanks to everyone who have contributed. Of course the community's

[Openstack] Swift proxy logs

2013-07-16 Thread CHABANI Mohamed El Hadi
Hi guys, I've a problem with The Swift proxy log, i can't find it in /var/log/syslog (only for replicators, updaters...) neither in /var/log/upstart. and in the proxy-server.conf also there is no parameter to specify the log path (i took the one by default in

Re: [Openstack] Swift proxy logs

2013-07-16 Thread Chuck Thier
Hello, If you followed the rsyslog instructions in the SAIO, then the proxy logs will be in /var/log/swift/proxy.log and proxy.error. If not, then it will be either in /var/log/syslog or /var/log/messages, depending on your server distro. -- Chuck On Tue, Jul 16, 2013 at 4:57 AM, CHABANI

Re: [Openstack] Swift proxy logs

2013-07-16 Thread CHABANI Mohamed El Hadi
Yes, i followed the instructions in the SAIO, and i've either proxy.log, proxy.error or /message !! except the /syslog in which there is logs but no signs for proxy activities (even i do authentication, or upload/download) !! 2013/7/16 Chuck Thier cth...@gmail.com Hello, If you followed the

[Openstack] [SWIFT] Account reaping - gradually

2013-07-15 Thread Leandro Reox
Hi guys, I was wondering if there any plans or maybe already exist a feature or a flag for the account reaping process to make it gradually. We had one case with an account with millions of files, that was plain deleted, an that triggers the deletion of every object, then containers to finally

Re: [Openstack] [SWIFT] Account reaping - gradually

2013-07-15 Thread Samuel Merritt
On 7/15/13 6:52 AM, Leandro Reox wrote: Hi guys, I was wondering if there any plans or maybe already exist a feature or a flag for the account reaping process to make it gradually. We had one case with an account with millions of files, that was plain deleted, an that triggers the deletion of

[Openstack] [Swift] Try to get the final status of PUT and timeout

2013-07-12 Thread Jonathan Lu
Hi, all stackers, I test the cluster and get such error msg: Jul 12 11:23:57 ubuntu-12 proxy-server ERROR with Object server 192.168.1.161:60 00/xvdb1 re: Trying to get final status of PUT to /v1/AUTH_test/test_8/e9a243cb0 462406a9ca10b590ed42a5f: Timeout (10s)

[Openstack] swift storage, getting it working

2013-07-12 Thread Axel Christiansen
Hello List, i got stock getting a swift store running. the base components, a proxy some storage nodes are prepared. The keystone service is up and seems working ok. Authentication works. wehn trying to create a container this happens: swift -v -s -V 2.0 -A http://10.42.44.206:5000/v2.0 -U

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Jonathan Lu
Hi, I once met such problem because I forget to change the own of the directory of the mounted device to swift:swift. On 2013/7/12 16:44, Axel Christiansen wrote: Hello List, i got stock getting a swift store running. the base components, a proxy some storage nodes are prepared. The

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Kuo Hugo
Agree with Jonathan +1 Change the owner of disk mount point to the relevant user which you set in /etc/swift/*. +Hugo Kuo+ h...@swiftstack.com tonyt...@gmail.com +886 935004793 2013/7/12 Jonathan Lu jojokur...@gmail.com Hi, I once met such problem because I forget to change the own of

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Axel Christiansen
Thank you. That looks all right. Switching to user swift on a storage node, cd-ing to a mountpoint (/srv/node/sdb1/) and creating a file works. I checked the mount points and rights twice. Here is a little larger snippet from the log server: http://paste.openstack.org/show/40222/ someone

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Axel Christiansen
Hello. my issue is solved. What did i do wrong, got wrong from google ;) I mixed up the default ports for the ring building. The proxy-server option allow_account_management = true and account_autocreate = true where set to false. All the best. Axel Am 12.07.13 12:50, schrieb Axel

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Kuo Hugo
Hi Alex , Did you re-check the drives information in the ring? Would you like to show it? +Hugo Kuo+ h...@swiftstack.com tonyt...@gmail.com +886 935004793 2013/7/12 Axel Christiansen axel.christian...@softreset.de Hello. my issue is solved. What did i do wrong, got wrong from google ;)

Re: [Openstack] swift storage, getting it working

2013-07-12 Thread Axel Christiansen
Hi Hugo, as i mentioned, my ring was wrong. At least i beleve using the wrong ports for the ring services(account, container, object) breaks the ring, right? Thats what broke my setup, i beleve. Axel Am 12.07.13 14:09, schrieb Kuo Hugo: Hi Alex , Did you re-check the drives information

Re: [Openstack] [Swift] Try to get the final status of PUT and timeout

2013-07-12 Thread Samuel Merritt
On 7/12/13 12:34 AM, Jonathan Lu wrote: Hi, all stackers, I test the cluster and get such error msg: Jul 12 11:23:57 ubuntu-12 proxy-server ERROR with Object server 192.168.1.161:60 00/xvdb1 re: Trying to get final status of PUT to /v1/AUTH_test/test_8/e9a243cb0

Re: [Openstack] [Swift] Try to get the final status of PUT and timeout

2013-07-12 Thread Peter Portante
Can you use the transaction ID in the object server log that is in error to correlate with the proxy server logs to see how the proxy server responded for that REST API request? On Fri, Jul 12, 2013 at 12:46 PM, Samuel Merritt s...@swiftstack.com wrote: On 7/12/13 12:34 AM, Jonathan Lu wrote:

Re: [Openstack] [Swift] Breakpoint resume with tempurl

2013-07-11 Thread John Dickinson
Swift supports Range requests, so you are able to make a GET request with the Range header starting with the first byte you didn't fetch the first time. --John On Jul 10, 2013, at 8:10 PM, Jonathan Lu jojokur...@gmail.com wrote: Hi, all stackers, I have realized downloading large

[Openstack] Swift tempurl

2013-07-10 Thread Morten Møller Riis
I'm having trouble getting tempurl to work. I set the X-Account-Meta-Temp-Url-Key metadata on the account. And a GET request shows it's set correctly. I've enabled it on the proxy server in /etc/swift/proxy-server.conf: [DEFAULT] bind_port = 8080 workers = 8 user = swift [pipeline:main]

[Openstack] [ANN] Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage

2013-07-10 Thread Gabe Wong
Re: Caimito 0.11 - WebDAV frontend for OpenStack Swift Cloud Storage Hi all, Lots of work has been done to Caimito. In addition to bug fixes: - Faster request handling. - Better handling of files with spaces and other characters. Thanks to everyone who have contributed. Of course

Re: [Openstack] Swift tempurl

2013-07-10 Thread Shrinand Javadekar
I had a similar problem. See [1]. The fix was to add delay_auth_decision = 1 in the proxy-server.conf [filter:authtoken] ... delay_auth_decision = 1 -Shri [1] https://answers.launchpad.net/swift/+question/225614 On Wed, Jul 10, 2013 at 4:43 AM, Morten Møller Riis m...@gigahost.dk wrote: I've

Re: [Openstack] Swift tempurl

2013-07-10 Thread Morten Møller Riis
I use swauth, and thus authtoken is not present in my pipeline. This might be why I'm seeing the problem actually. Mvh / Best regards Morten Møller Riis Gigahost ApS m...@gigahost.dk On Jul 11, 2013, at 4:04 AM, Shrinand Javadekar shrin...@maginatics.com wrote: I had a similar problem. See

Re: [Openstack] Swift tempurl

2013-07-10 Thread Morten Møller Riis
This turned out to be a known issue with swath. I upgraded to a newer version and the problem was resolved :) Mvh / Best regards Morten Møller Riis Gigahost ApS m...@gigahost.dk On Jul 11, 2013, at 10:52 AM, Morten Møller Riis m...@gigahost.dk wrote: I use swauth, and thus authtoken is not

[Openstack] [Swift] Breakpoint resume with tempurl

2013-07-10 Thread Jonathan Lu
Hi, all stackers, I have realized downloading large object with tempurl middle-wareand want to support break-point resume. Has anyone got the experience of fulfilling break-point resume with tempurl in Swift? Thanks, Jonathan Lu ___ Mailing

Re: [Openstack] [SWIFT] raising network traffic on the storage node

2013-07-09 Thread Robert van Leeuwen
If the replication traffic is responsible for this raising network traffic for only 1.200.000 objects, how much traffic I can expect if I have 100.000.000 objects stored? The average size of my mailobjects are 120 kB. It's planned to use all 12 hard drive slots of my DELL R720xd with 4 TB

Re: [Openstack] [SWIFT] raising network traffic on the storage node

2013-07-09 Thread Klaus Schürmann
Nachricht- Von: Openstack [mailto:openstack-bounces+klaus.schuermann=mediabeam@lists.launchpad.net] Im Auftrag von Robert van Leeuwen Gesendet: Dienstag, 9. Juli 2013 09:09 An: openstack@lists.launchpad.net Betreff: Re: [Openstack] [SWIFT] raising network traffic on the storage node

Re: [Openstack] [SWIFT] raising network traffic o the storage node

2013-07-08 Thread Klaus Schürmann
Portante [mailto:peter.a.porta...@gmail.com] Gesendet: Montag, 8. Juli 2013 16:04 An: Klaus Schürmann Cc: openstack@lists.launchpad.net Betreff: Re: [Openstack] [SWIFT] raising network traffic o the storage node Can you zoom in past the spike, most recent 2 or three weeks and see how it looks? My

[Openstack] swift

2013-07-08 Thread Peter Cheung
Hi AllHow you guy admin swift? by command line or by www.swiftstack.com admin portal? Thanksfrom Peter ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net

Re: [Openstack] swift

2013-07-08 Thread Pete Zaitcev
On Mon, 8 Jul 2013 23:59:40 +0800 Peter Cheung mcheun...@hotmail.com wrote: Hi AllHow you guy admin swift? by command line or by www.swiftstack.com admin portal? Sounds like a great question for the ops list

Re: [Openstack] [SWIFT] raising network traffic o the storage node

2013-07-08 Thread Pete Zaitcev
On Mon, 8 Jul 2013 13:50:38 + Klaus Schürmann klaus.schuerm...@mediabeam.com wrote: I use a swift storage as a mail-store. Now I have about 1.000.000 objects stored in the cluster. Traffic Storagenode: http://www.schuermann.net/temp/storagenode.png Traffic Proxyserver:

Re: [Openstack] [SWIFT] raising network traffic on the storage node

2013-07-08 Thread Klaus Schürmann
2013 19:22 An: Klaus Schürmann Cc: openstack@lists.launchpad.net Betreff: Re: [Openstack] [SWIFT] raising network traffic o the storage node On Mon, 8 Jul 2013 13:50:38 + Klaus Schürmann klaus.schuerm...@mediabeam.com wrote: I use a swift storage as a mail-store. Now I have about 1.000.000

Re: [Openstack] Swift Client

2013-07-05 Thread Kuo Hugo
--- I ever used --- 1) CyberDuck 2) Owncloud (What's the problem in your test?) 3) Gladinet client 4) SwiftStack Web Console 5) Most of AWS S3 client tools, but you need to enable Swift3 middleware support 6) OpenStack DashBoard 7) Maldivica gateway -- I never use but should work -- 8) SME Hope

Re: [Openstack] Swift Client

2013-07-05 Thread CHABANI Mohamed El Hadi
Hi Hugo, I didn't use Owncloud, i tried before Cyberduck and had a problem such 'unrecongnized SSL message' ! My purpose is just to test ! i'm using a SAIO installation, with an Ubuntu 12.04, with tempauth middleware exactly according to :

Re: [Openstack] Swift Client

2013-07-05 Thread CHABANI Mohamed El Hadi
To use Cyberduck of course. I thing i should also use a different middleware instead of Tempauth, how can i replace it by devauth or swauth ? 2013/7/5 CHABANI Mohamed El Hadi chabani.mohamed.h...@gmail.com Hi Hugo, I didn't use Owncloud, i tried before Cyberduck and had a problem such

Re: [Openstack] Swift Client

2013-07-05 Thread Jonathan Lu
Hi, Maybe you need the latest snapshot build, which you can download on the Cyberduck website https://trac.cyberduck.ch/wiki/help/en/howto/openstack, Connect without SSL section. If that still not work, you can check the config file. If the url of auth is /auth/v1.0, then you should

Re: [Openstack] Swift Client

2013-07-05 Thread CHABANI Mohamed El Hadi
Okey thank's, i will check this approach. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp

Re: [Openstack] [Swift] Updating best practices for XFS inode size

2013-07-04 Thread Chmouel Boudjnah
On Mon, Jul 1, 2013 at 9:02 AM, Robert van Leeuwen robert.vanleeu...@spilgames.com wrote: I would like to thank the XFS folks at Redhat for letting us know about the improvements in XFS, and the XFS team in general for the great work they have done. Thanks for the heads up. Do you, or any

[Openstack] Swift Client

2013-07-04 Thread CHABANI Mohamed El Hadi
Hi people, I want to use my Swift all in One with a graphical client, to put / retrieve objects. i heard that we can use Cyberduck (but there is problem of port) or Owncloud as Swift client but didn't find good references. If any person could help me or suggest other clients, it would be really

[Openstack] OpenStack Swift Functional Testing (API Compatibility)

2013-07-03 Thread Shailendra Singh (Product Engineering Services - Mumbai)
We are trying to verify the compatibility of API for a Openstack Swift (swift-1.8.0-1; python-swiftclient-1.2.0-1) Implementation Using Swift functional tests suite. Looking for information how to configure execute; What are benchmarks; and how to pass swift functional tests to check

Re: [Openstack] [Swift] Updating best practices for XFS inode size

2013-07-01 Thread Robert van Leeuwen
If you are using recent Linux Kernels, using the default inode size no longer has any impact to write (PUT) performance through swift. I would like to thank the XFS folks at Redhat for letting us know about the improvements in XFS, and the XFS team in general for the great work they have

[Openstack] Swift objects permissions

2013-07-01 Thread CHABANI Mohamed El Hadi
Hi people, I'm trying to show a picture in my browser from a swift cluser (SAIO), when i do '*http://myadressip:8080/v1/AUTH_test/test/myfiles/test.jpeg*' i get *This server could not verify that you are authorized to access the document you requested.* I set also the Read ACL = .r:* Should i

Re: [Openstack] Swift objects permissions

2013-07-01 Thread Hua ZZ Zhang
Subject +zhuadl=cn.ibm.co [Openstack] Swift objects m@lists.launchpad permissions .net

Re: [Openstack] Swift objects permissions

2013-07-01 Thread CHABANI Mohamed El Hadi
@lists.launchpad.net, cc Subject [Openstack] Swift objects permissions Hi people, I'm trying to show a picture in my browser from a swift cluser (SAIO), when i do '*http://myadressip:8080/v1/AUTH_test/test/myfiles/test.jpeg*http://myadressip:8080/v1/AUTH_test/test/myfiles/test.jpeg

[Openstack] [Swift] Updating best practices for XFS inode size

2013-06-28 Thread Chuck Thier
Swift stores object metadata in the xattrs of the file on disk and XFS stores xattrs in the inodes. When swift was first developed, there were performance issues with using the default inode size in XFS, and led to us recommending to change the inode size when creating XFS filesystems. In the

Re: [Openstack] Swift / Keystone authentication

2013-06-27 Thread CHABANI Mohamed El Hadi
*Subject:* Re: [Openstack] Swift / Keystone authentication ** ** *Mark Miller : *Until yesterday the container.recon didn't exist at all, this morning when rectifying a mistake in the keystone.conf, the keystone service started and these files (account.recon, container and object.recon

Re: [Openstack] Swift / Keystone authentication

2013-06-26 Thread CHABANI Mohamed El Hadi
[mailto:chabani.mohamed.h...@gmail.com] Sent: Tuesday, June 25, 2013 8:46 AM To: Miller, Mark M (EB SW Cloud - RD - Corvallis) Cc: Виль Суркин; openstack@lists.launchpad.net Subject: Re: [Openstack] Swift / Keystone authentication Yes you are right

[Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
Hi, I'm trying to install Swift from this Guidehttp://docs.openstack.org/trunk//openstack-object-storage/admin/content/ch_installing-openstack-object-storage.html, and for the authentication service (Keystone) i'm a bit lost, should i install Keystone as a full-fledged service with the MySql

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Виль Суркин
You should authenticate in keystone service, not in swift-proxy. Keystone's Public API usually binds to TCP port 5000. -- Виль Суркин вторник, 25 июня 2013 г. в 18:38, CHABANI Mohamed El Hadi написал: Hi, I'm trying to install Swift from this Guide

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
When i tried with port : 5000 and even 35357 i got : *Authorization Failed: [Errno 111] Connection refused* These 2 ports are not open i guess, should i open them manually ? (the keystone service is start/running) 2013/6/25 Виль Суркин vill@gmail.com You should authenticate in keystone

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Remo Mattei
Hi, can you do a netstat -ant and see what it says? Also I would check the logs, /var/log and look for any errors? If you are using Redhat base (Fedora, CentOS etc, you may have to open up the iptables since by default it does not have those ports open). My 2 cents. Remo On Jun 25, 2013,

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Виль Суркин
Did you create services and endpoints in keystone? If yes, how you can do this? =) -- Виль Суркин вторник, 25 июня 2013 г. в 18:48, CHABANI Mohamed El Hadi написал: When i tried with port : 5000 and even 35357 i got : Authorization Failed: [Errno 111] Connection refused These 2 ports

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
*Remo Mattei* : when i cheched with netstat -an : the port 5000 is not open either the port 35357, i don't know why ! and no i'm on Ubuntu 12.04, they are supposed to be open when the keystone run no ?! *Виль Суркин :* No i didn't add any additional configurations, i'm looking now how to add the

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
*Remo Mattei* : wich log file ? because in keystone.log there is nothing ! 2013/6/25 Remo Mattei r...@mattei.org Hi, can you do a netstat -ant and see what it says? Also I would check the logs, /var/log and look for any errors? If you are using Redhat base (Fedora, CentOS etc, you may have

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Miller, Mark M (EB SW Cloud - RD - Corvallis)
Mattei Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] Swift / Keystone authentication Remo Mattei : wich log file ? because in keystone.log there is nothing ! 2013/6/25 Remo Mattei r...@mattei.orgmailto:r...@mattei.org Hi, can you do a netstat -ant and see what it says? Also I would

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Miller, Mark M (EB SW Cloud - RD - Corvallis)
Subject: Re: [Openstack] Swift / Keystone authentication Remo Mattei : wich log file ? because in keystone.log there is nothing ! 2013/6/25 Remo Mattei r...@mattei.orgmailto:r...@mattei.org Hi, can you do a netstat -ant and see what it says? Also I would check the logs, /var/log and look

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
Of *CHABANI Mohamed El Hadi *Sent:* Tuesday, June 25, 2013 7:48 AM *To:* Виль Суркин *Cc:* openstack@lists.launchpad.net *Subject:* Re: [Openstack] Swift / Keystone authentication ** ** When i tried with port : 5000 and even 35357 i got : *Authorization Failed: [Errno 111] Connection

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Miller, Mark M (EB SW Cloud - RD - Corvallis)
@lists.launchpad.net Subject: Re: [Openstack] Swift / Keystone authentication When i tried with port : 5000 and even 35357 i got : Authorization Failed: [Errno 111] Connection refused These 2 ports are not open i guess, should i open them manually ? (the keystone service is start/running) 2013/6/25

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread CHABANI Mohamed El Hadi
: [Openstack] Swift / Keystone authentication ** ** Yes you are right :) ! When trying *'service keystone status'* i get : *keystone stop/waiting*..however when i do *service keystone start*, it shows* 'keystone start/running, process 32462'* i'm missing something here ? because

Re: [Openstack] [Swift] Load Average node storage

2013-06-25 Thread Brent Roskos
I wouldn't think 3 replica's across 1 zone is a viable configuration. Given you are starting with 4 servers, you should really have 4 zones. Then all 3 copies of an object can still go somewhere even when aone server is down. When you add more servers, just add them in groups of 4 to keep it

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread tudor
: Виль Суркин; openstack@lists.launchpad.net [8] SUBJECT: Re: [Openstack] Swift / Keystone authentication Yes you are right :) ! When trying 'SERVICE KEYSTONE STATUS' i get : KEYSTONE STOP/WAITING..however when i do SERVICE KEYSTONE START, it shows 'KEYSTONE START/RUNNING, PROCESS 32462

Re: [Openstack] Swift / Keystone authentication

2013-06-25 Thread Jamie Lennox
Subject: Re: [Openstack] Swift / Keystone authentication Yes you are right :) ! When trying 'service keystone status' i get : keystone stop/waiting..however when i do service keystone start, it shows 'keystone

Re: [Openstack] [Swift] Load Average node storage

2013-06-24 Thread Robert van Leeuwen
load average: 24.06, 24.02, 24.00 There is something, can i do to reduce the load? is it normal? I guess it depends on what is causing the load. (are there processes eating all cpu cycles?) What we see is that the object-auditor and object-replicator can cause quite a bit of load because

[Openstack] [OpenStack][Swift][Keystone] Authentication Fails

2013-06-24 Thread Trevor Roberts Jr
Hello Team, I am unable to login to Swift using the Keystone integration. Here is sample output when I try to get swift status: vagrant@swift:~$ swift -A http://172.16.0.201:5000/v2.0 -U service:swift -K swift stat Auth GET failed: http://172.16.0.201:5000/v2.0 200 OK I tried adding TempAuth

[Openstack] Swift cleaning tenant after deletion on Keystone

2013-06-20 Thread Heiko Krämer
Heyho guys, I've a short question because I can't find anything in the docs. Will Swift cleanup himself if I delete a tenant on Keystone ? Or do I need to ensure that all files and all buckets/containers are deleted on Swift before the tenant will be deleted on Keystone? Greetings and thx

Re: [Openstack] Swift cleaning tenant after deletion on Keystone

2013-06-20 Thread Kuo Hugo
Hi Heiko, All objects won't be deleted if the tenant been deleted in Keystone. Hugo +Hugo Kuo+ h...@swiftstack.com tonyt...@gmail.com +886 935004793 2013/6/20 Heiko Krämer i...@honeybutcher.de Heyho guys, I've a short question because I can't find anything in the docs. Will Swift

Re: [Openstack] Swift cleaning tenant after deletion on Keystone

2013-06-20 Thread Heiko Krämer
Hey Hugo, ok, thx for your quick answer! Greetings Heiko On 20.06.2013 11:56, Kuo Hugo wrote: Hi Heiko, All objects won't be deleted if the tenant been deleted in Keystone. Hugo +Hugo Kuo+ h...@swiftstack.com mailto:h...@swiftstack.com tonyt...@gmail.com mailto:tonyt...@gmail.com

Re: [Openstack] Swift cleaning tenant after deletion on Keystone

2013-06-20 Thread Brent Roskos
The account-reaper generally takes care of this. Have you seen this? http://docs.openstack.org/developer/swift/overview_reaper.html Regards, Brent On Thu, Jun 20, 2013 at 6:06 AM, Heiko Krämer i...@honeybutcher.de wrote: Hey Hugo, ok, thx for your quick answer! Greetings Heiko On

[Openstack] [Swift] Load Average node storage

2013-06-20 Thread Jose Augusto de Sousa
Dears, i finished installation and configuration of my swift cluster. After all, i used a region with 1 zone and 4 node storage. each node-storage with 24 disks and 32GB ram, in 10Gb network. i notice the load always in 3 of 4 hosts. load average: 24.06, 24.02, 24.00 top - 20:24:29 up 8

Re: [Openstack] Swift Object Storage authentication

2013-06-19 Thread Kuo Hugo
Hi CHABANI , Would you please show me the proxy-server.conf ? You can paste on http://paste.openstack.org/ or gist. Cheers +Hugo Kuo+ h...@swiftstack.com tonyt...@gmail.com +886 935004793 2013/6/19 CHABANI Mohamed El Hadi chabani.mohamed.h...@gmail.com Hi all, I'm trying to install

Re: [Openstack] Swift Object Storage authentication

2013-06-19 Thread CHABANI Mohamed El Hadi
Hi Hugo, Here is my proxy-sever.conf http://paste.openstack.org/show/38944/ (i've already attached a pic in the first mail :) ) Thanks 2013/6/19 Kuo Hugo tonyt...@gmail.com Hi CHABANI , Would you please show me the proxy-server.conf ? You can paste on http://paste.openstack.org/ or

Re: [Openstack] Swift Object Storage authentication

2013-06-19 Thread CHABANI Mohamed El Hadi
During the installation of Swift, i didn't touch any Keystone configuration, so do you think that i should install Keystone separately according to : http://docs.openstack.org/grizzly/openstack-compute/install/apt/content/install-keystone.html? and configure Swift to work with it ? 2013/6/19 Kuo

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-18 Thread ZHOU Yuan
Jonathan, we happen to use SN similar with yours and I could share you some performance testing data here: 1. 100 container with 1 objects(base) The performance is quite good and can hit HW bottleneck 2. 10kcontainer with 100M objects The performance is not so good, which dropped 80%

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-18 Thread ZHOU Yuan
Jonathan, Yes we have 10,000 containers and we're using COSBench to do the tests. Sincerely, Yuan On Wed, Jun 19, 2013 at 9:24 AM, Jonathan Lu jojokur...@gmail.com wrote: Hi, Zhou, BTW, in test case 2, the number of container is 10,000 or just 10? Jonathan Lu On 2013/6/18 19:18,

[Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
Hi, all, I'm facing the issue about the performance degradation, and once I glanced that changing the value in /proc/sys/vm/vfs_cache_pressure will do a favour. Can anyone explain to me whether and why it is useful? I have scanned the Deployment Guide of OpenStack Swift http

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Hugo
will do a favour. Can anyone explain to me whether and why it is useful? I have scanned the Deployment Guide of OpenStack Swift but cannot find anything about such tuning. Thanks, Jonathan Lu ___ Mailing list: https://launchpad.net

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Peter Portante
glanced that changing the value in /proc/sys/vm/vfs_cache_pressure will do a favour. Can anyone explain to me whether and why it is useful? I have scanned the Deployment Guide of OpenStack Swift but cannot find anything about such tuning. Thanks, Jonathan Lu

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Robert van Leeuwen
I'm facing the issue about the performance degradation, and once I glanced that changing the value in /proc/sys /vm/vfs_cache_pressure will do a favour. Can anyone explain to me whether and why it is useful? Hi, When this is set to a lower value the kernel will try to keep the inode/dentry

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
On 2013/6/17 18:59, Robert van Leeuwen wrote: I'm facing the issue about the performance degradation, and once I glanced that changing the value in /proc/sys /vm/vfs_cache_pressure will do a favour. Can anyone explain to me whether and why it is useful? Hi, When this is set to a lower value

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Huang Zhiteng
On Tue, Jun 18, 2013 at 10:42 AM, Jonathan Lu jojokur...@gmail.com wrote: On 2013/6/17 18:59, Robert van Leeuwen wrote: I'm facing the issue about the performance degradation, and once I glanced that changing the value in /proc/sys /vm/vfs_cache_pressure will do a favour. Can anyone explain

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Kuo Hugo
Hi Jonathan , How did you perform delete all the objects in the storage ? Those deleted objects still consume inodes in tombstone status until the reclaim time. Would you mind to compare the result of $ sudo cat /proc/slabinfo | grep xfs , before/after set the vfs_cache_pressure

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
Hi Hugo, I know the tombstone mechanism. In my opinion after the reclaim time, the object of xxx.tombstone will be deleted at all. Is that right? Maybe I misunderstand the doc :( ... We try to colddown the swift system ( just wait for the reclaiming) and test, but the result is not

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Kuo Hugo
Hi Huang, Storage nodes will run out of memory for caching inode eventually right? Have you ever measure the upper limit of caching capability of your storage nodes? Hi Jonathan, The default reclaiming time is 7 days. Did you wait for 7 days or just change the setting to 1 min in conf file ?

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
Hi, Huang Thanks for you explanation. Does it mean that the storage cluster of specific processing ability will be slower and slower with more and more objects? Is there any test about the rate of the decline or is there any lower limit? For example, my environment is: Swift

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Huang Zhiteng
On Tue, Jun 18, 2013 at 12:35 PM, Jonathan Lu jojokur...@gmail.com wrote: Hi, Huang Thanks for you explanation. Does it mean that the storage cluster of specific processing ability will be slower and slower with more and more objects? Is there any test about the rate of the decline or is

Re: [Openstack] [Swift] Cache pressure tuning

2013-06-17 Thread Jonathan Lu
Hi, Huang Thanks a lot. I will try this test. One more question: In the 3 following situation, will the base line performance be quite different? 1. only 1 sontaienr with 10m objects; 2. 100,000 objects per container at 100 containers 3. 1,000 objects per

Re: [Openstack] [OpenStack] SWIFT Object Store spanning multiple data centers

2013-06-16 Thread John Dickinson
The global clusters feature is Swift is very new and just now being finished up. We are finishing up the last part of it and will have it completed in our next release (tentatively scheduled for June 27). The last part is the affinity write (ie don't write to a WAN region). The regions concept

Re: [Openstack] [OpenStack] SWIFT Object Store spanning multiple data centers

2013-06-16 Thread Balamurugan V G
Thanks John for the quick response and update. I followed the guide at http://docs.openstack.org/grizzly/openstack-compute/install/apt/content/ch_installing-openstack-object-storage.html and I am using Grizzly on Ubuntu 12.04LTS. Two replicas in A and one replica in B is what I intended so looks

Re: [Openstack] [Swift] Upgrade Swift from ver1.4 to ver1.8

2013-06-10 Thread John Dickinson
recommend paying close attention to Swift's changelog: https://github.com/openstack/swift/blob/master/CHANGELOG. There are several things described in there that you should pay attention to (eg changing config defaults and some format changes). Everything has an upgrade path, so, although you may elect

  1   2   3   4   5   6   7   8   9   >