Re: [ceph-users] Having problem to start Radosgw

- Original Message - From: B L super.itera...@gmail.com To: ceph-users@lists.ceph.com Sent: Friday, February 13, 2015 11:55:22 PM Subject: [ceph-users] Having problem to start Radosgw Hi all, I’m having a problem to start radosgw, giving me error that I can’t diagnose: $

Re: [ceph-users] Having problem to start Radosgw

- Original Message - From: B L super.itera...@gmail.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Saturday, February 14, 2015 11:03:42 AM Subject: Re: [ceph-users] Having problem to start Radosgw Hello Yehyda, The strace command you referred

Re: [ceph-users] Shadow files

- Original Message - From: Ben b@benjackson.email To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Craig Lewis cle...@centraldesktop.com, ceph-users ceph-us...@ceph.com Sent: Tuesday, March 17, 2015 7:28:28 PM Subject: Re: [ceph-users] Shadow files None of this helps with trying

Re: [ceph-users] RadosGW Direct Upload Limitation

- Original Message - From: Craig Lewis cle...@centraldesktop.com To: Gregory Farnum g...@gregs42.com Cc: ceph-users@lists.ceph.com Sent: Monday, March 16, 2015 11:48:15 AM Subject: Re: [ceph-users] RadosGW Direct Upload Limitation Maybe, but I'm not sure if Yehuda would

Re: [ceph-users] FastCGI and RadosGW issue?

- Original Message - From: Potato Farmer potato_far...@outlook.com To: ceph-users@lists.ceph.com Sent: Thursday, March 19, 2015 12:26:41 PM Subject: [ceph-users] FastCGI and RadosGW issue? Hi, I am running into an issue uploading to a bucket over an s3 connection to

Re: [ceph-users] Shadow files

- Original Message - From: Abhishek L abhishek.lekshma...@gmail.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Ben b@benjackson.email, ceph-users ceph-us...@ceph.com Sent: Wednesday, March 18, 2015 10:54:37 AM Subject: Re: [ceph-users] Shadow files Yehuda Sadeh-Weinraub

Re: [ceph-users] S3 RadosGW - Create bucket OP

- Original Message - From: Steffen Winther ceph.u...@siimnet.dk To: ceph-users@lists.ceph.com Sent: Monday, March 9, 2015 12:43:58 AM Subject: Re: [ceph-users] S3 RadosGW - Create bucket OP Steffen W Sørensen stefws@... writes: Response: HTTP/1.1 200 OK Date: Fri, 06 Mar

Re: [ceph-users] S3 RadosGW - Create bucket OP

- Original Message - From: Steffen Winther ceph.u...@siimnet.dk To: ceph-users@lists.ceph.com Sent: Monday, March 9, 2015 1:25:43 PM Subject: Re: [ceph-users] S3 RadosGW - Create bucket OP Yehuda Sadeh-Weinraub yehuda@... writes: If you're using apache, then it filters out

Re: [ceph-users] rgw admin api - users

The metadata api can do it: GET /admin/metadata/user Yehuda - Original Message - From: Joshua Weaver joshua.wea...@ctl.io To: ceph-us...@ceph.com Sent: Thursday, March 5, 2015 1:43:33 PM Subject: [ceph-users] rgw admin api - users According to the docs at

Re: [ceph-users] not existing key from s3 list

- Original Message - From: Dominik Mostowiec dominikmostow...@gmail.com To: ceph-users@lists.ceph.com Sent: Friday, March 13, 2015 4:50:18 PM Subject: [ceph-users] not existing key from s3 list Hi, I found a strange problem with not existing file in s3. Object exists in list #

Re: [ceph-users] Shadow files

- Original Message - From: Ben b@benjackson.email To: ceph-us...@ceph.com Sent: Wednesday, March 11, 2015 8:46:25 PM Subject: Re: [ceph-users] Shadow files Anyone got any info on this? Is it safe to delete shadow files? It depends. Shadow files are badly named objects that

Re: [ceph-users] S3 RadosGW - Create bucket OP

- Original Message - From: Steffen Winther ceph.u...@siimnet.dk To: ceph-users@lists.ceph.com Sent: Tuesday, March 10, 2015 12:06:38 AM Subject: Re: [ceph-users] S3 RadosGW - Create bucket OP Yehuda Sadeh-Weinraub yehuda@... writes: According to the api specified here http

Re: [ceph-users] Auth URL not found when using object gateway

- Original Message - From: Greg Meier greg.me...@nyriad.com To: ceph-users@lists.ceph.com Sent: Tuesday, March 24, 2015 4:24:16 PM Subject: [ceph-users] Auth URL not found when using object gateway Hi, I'm having trouble setting up an object gateway on an existing cluster. The

Re: [ceph-users] Radosgw authorization failed

- Original Message - From: Neville neville.tay...@hotmail.co.uk To: ceph-users@lists.ceph.com Sent: Wednesday, March 25, 2015 8:16:39 AM Subject: [ceph-users] Radosgw authorization failed Hi all, I'm testing backup product which supports Amazon S3 as target for Archive storage

Re: [ceph-users] Radosgw authorization failed

- Original Message - From: Neville neville.tay...@hotmail.co.uk To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Monday, March 30, 2015 6:49:29 AM Subject: Re: [ceph-users] Radosgw authorization failed Date: Wed, 25 Mar 2015 11:43:44 -0400 From

Re: [ceph-users] RadosGW S3ResponseError: 405 Method Not Allowed

- Original Message - From: Steffen W Sørensen ste...@me.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Friday, February 27, 2015 9:39:46 AM Subject: Re: [ceph-users] RadosGW S3ResponseError: 405 Method Not Allowed On 27/02/2015, at 17.20, Yehuda

Re: [ceph-users] RadosGW S3ResponseError: 405 Method Not Allowed

- Original Message - From: Steffen W Sørensen ste...@me.com To: ceph-users@lists.ceph.com Sent: Friday, February 27, 2015 6:40:01 AM Subject: [ceph-users] RadosGW S3ResponseError: 405 Method Not Allowed Hi, Newbie to RadosGW+Ceph, but learning... Got a running Ceph Cluster

Re: [ceph-users] Hammer sharded radosgw bucket indexes question

- Original Message - From: Ben Hines bhi...@gmail.com To: ceph-users ceph-users@lists.ceph.com Sent: Wednesday, March 4, 2015 1:03:16 PM Subject: [ceph-users] Hammer sharded radosgw bucket indexes question Hi, These questions were asked previously but perhaps lost: We have

Re: [ceph-users] Understand RadosGW logs

- Original Message - From: Daniel Schneller daniel.schnel...@centerdevice.com To: ceph-users@lists.ceph.com Sent: Tuesday, March 3, 2015 2:54:13 AM Subject: [ceph-users] Understand RadosGW logs Hi! After realizing the problem with log rotation (see

Re: [ceph-users] RadosGW - multiple dns names

- Original Message - From: Shinji Nakamoto shinji.nakam...@mgo.com To: ceph-us...@ceph.com Sent: Friday, February 20, 2015 3:58:39 PM Subject: [ceph-users] RadosGW - multiple dns names We have multiple interfaces on our Rados gateway node, each of which is assigned to one of our

Re: [ceph-users] mixed ceph versions

- Original Message - From: Gregory Farnum g...@gregs42.com To: Tom Deneau tom.den...@amd.com Cc: ceph-users@lists.ceph.com Sent: Wednesday, February 25, 2015 3:20:07 PM Subject: Re: [ceph-users] mixed ceph versions On Wed, Feb 25, 2015 at 3:11 PM, Deneau, Tom tom.den...@amd.com

Re: [ceph-users] RADOS Gateway quota management

Great, I opened issue # 11323. Thanks, Yehuda - Original Message - From: Sergey Arkhipov sarkhi...@asdco.ru To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Friday, April 3, 2015 1:00:02 AM Subject: Re: [ceph-users] RADOS Gateway quota management

Re: [ceph-users] Purpose of the s3gw.fcgi script?

- Original Message - From: Francois Lafont flafdiv...@free.fr To: ceph-users@lists.ceph.com Sent: Monday, April 13, 2015 5:17:47 PM Subject: Re: [ceph-users] Purpose of the s3gw.fcgi script? Hi, Yehuda Sadeh-Weinraub wrote: You're not missing anything. The script was only

Re: [ceph-users] Swift and Ceph

Sounds like you're hitting a known issue that was fixed a while back (although might not be fixed on the specific version you're running). Can you try creating a second subuser for the same user, see if that one works? Yehuda - Original Message - From: alistair whittle

Re: [ceph-users] Shadow Files

These ones: http://tracker.ceph.com/issues/10295 http://tracker.ceph.com/issues/11447 - Original Message - From: Ben Jackson b@benjackson.email To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users ceph-us...@ceph.com Sent: Friday, April 24, 2015 3:06:02 PM Subject: Re: [ceph

Re: [ceph-users] Shadow Files

What version are you running? There are two different issues that we were fixing this week, and we should have that upstream pretty soon. Yehuda - Original Message - From: Ben b@benjackson.email To: ceph-users ceph-us...@ceph.com Cc: Yehuda Sadeh-Weinraub yeh...@redhat.com Sent

Re: [ceph-users] Shadow Files

Yeah, that's definitely something that we'd address soon. Yehuda - Original Message - From: Ben b@benjackson.email To: Ben Hines bhi...@gmail.com, Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users ceph-us...@ceph.com Sent: Friday, April 24, 2015 5:14:11 PM Subject: Re: [ceph

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

- Original Message - From: Sean seapasu...@uchicago.edu To: ceph-users@lists.ceph.com Sent: Tuesday, April 28, 2015 2:52:35 PM Subject: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation Hey yall! I have a weird issue and I am not

Re: [ceph-users] Shadow Files

It will get to the ceph mainline eventually. We're still reviewing and testing the fix, and there's more work to be done on the cleanup tool. Yehuda - Original Message - From: Ben b@benjackson.email To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users ceph-us...@ceph.com Sent

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

- Original Message - From: Sean seapasu...@uchicago.edu To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Friday, May 1, 2015 6:47:09 PM Subject: Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation Hey

Re: [ceph-users] Shadow Files

, it does not schedule a job on the radosgw process. Please let me know of any issue you find. Thanks, Yehuda - Original Message - From: Ben Hines bhi...@gmail.com To: Ben b@benjackson.email Cc: Yehuda Sadeh-Weinraub yeh...@redhat.com, ceph-users ceph-us...@ceph.com Sent: Thursday, April

Re: [ceph-users] RGW - Can't download complete object

- Original Message - From: Sean seapasu...@uchicago.edu To: ceph-users@lists.ceph.com Sent: Thursday, May 7, 2015 3:35:14 PM Subject: [ceph-users] RGW - Can't download complete object I have another thread goign on about truncation of objects and I believe this is a separate but

Re: [ceph-users] Shadow Files

Alba ascanio.al...@gmail.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Ben b@benjackson.email, ceph-users ceph-us...@ceph.com Sent: Tuesday, May 5, 2015 10:14:38 AM Subject: Re: [ceph-users] Shadow Files Unfortunately it immediately aborted (running against a 0.80.9 Ceph). Does Ceph

Re: [ceph-users] Shadow Files

- Original Message - From: Daniel Hoffman daniel.hoff...@13andrew.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Ben b@benjackson.email, ceph-users ceph-us...@ceph.com Sent: Sunday, May 10, 2015 5:03:22 PM Subject: Re: [ceph-users] Shadow Files Any updates on when

Re: [ceph-users] Shadow Files

It's the wip-rgw-orphans branch. - Original Message - From: Daniel Hoffman daniel.hoff...@13andrew.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Ben b@benjackson.email, David Zafman dzaf...@redhat.com, ceph-users ceph-us...@ceph.com Sent: Monday, May 11, 2015 4:30:11 PM

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

- Original Message - From: Sean seapasu...@uchicago.edu To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Tuesday, May 5, 2015 12:14:19 PM Subject: Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

Re: [ceph-users] civetweb lockups

- Original Message - From: Daniel Hoffman daniel.hoff...@13andrew.com To: ceph-users ceph-us...@ceph.com Sent: Sunday, May 10, 2015 10:54:21 PM Subject: [ceph-users] civetweb lockups Hi All. We have a wierd issue where civetweb just locks up, it just fails to respond to HTTP and

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

Hi, Thank you for a very thorough investigation. See my comments below: - Original Message - From: Mark Murphy murphyma...@uchicago.edu To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Sean Sullivan seapasu...@uchicago.edu, ceph-users@lists.ceph.com Sent: Tuesday, May 12, 2015 10:50

Re: [ceph-users] RGW - Can't download complete object

to take a look at the code. Could such a sequence happen with the client that you're using to upload? Yehuda - Original Message - From: Sean Sullivan seapasu...@uchicago.edu To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Wednesday, May 13, 2015 2:07:22

Re: [ceph-users] RGW - Can't download complete object

test for any regressions. Thanks, Yehuda - Original Message - From: Yehuda Sadeh-Weinraub yeh...@redhat.com To: Sean Sullivan seapasu...@uchicago.edu Cc: ceph-users@lists.ceph.com Sent: Wednesday, May 13, 2015 2:33:07 PM Subject: Re: [ceph-users] RGW - Can't download complete object

Re: [ceph-users] Civet RadosGW S3 not storing complete obects; civetweb logs stop after rotation

I opened issue #11604, and have a fix for the issue. I updated our test suite to cover the specific issue that you were hitting. We'll backport the fix to both hammer and firefly soon. Thanks! Yehuda - Original Message - From: Yehuda Sadeh-Weinraub yeh...@redhat.com To: Mark Murphy

Re: [ceph-users] RGW - Can't download complete object

...@uchicago.edu To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Wednesday, May 13, 2015 7:22:10 PM Subject: Re: [ceph-users] RGW - Can't download complete object Thank you so much Yahuda! I look forward to testing these. Is there a way for me to pull this code

Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket

- Original Message - From: Francois Lafont flafdiv...@free.fr To: ceph-users@lists.ceph.com Sent: Sunday, April 12, 2015 8:47:40 PM Subject: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket Hi, On a testing cluster, I have a radosgw on Firefly

Re: [ceph-users] Purpose of the s3gw.fcgi script?

You're not missing anything. The script was only needed when we used the process manager of the fastcgi module, but it has been very long since we stopped using it. Yehuda - Original Message - From: Greg Meier greg.me...@nyriad.com To: ceph-users@lists.ceph.com Sent: Saturday, April

Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket

- Original Message - From: Francois Lafont flafdiv...@free.fr To: ceph-users@lists.ceph.com Sent: Monday, April 13, 2015 7:11:49 PM Subject: Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket Hi, Yehuda Sadeh-Weinraub wrote: The 405

Re: [ceph-users] RADOS Gateway quota management

- Original Message - From: Sergey Arkhipov sarkhi...@asdco.ru To: ceph-users@lists.ceph.com Sent: Monday, March 30, 2015 2:55:33 AM Subject: [ceph-users] RADOS Gateway quota management Hi, Currently I am trying to figure out how to work with RADOS Gateway (ceph 0.87) limits and

Re: [ceph-users] Radosgw authorization failed

- Original Message - From: Neville neville.tay...@hotmail.co.uk To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-users@lists.ceph.com Sent: Wednesday, April 1, 2015 11:45:09 AM Subject: Re: [ceph-users] Radosgw authorization failed On 31 Mar 2015, at 11:38, Neville

Re: [ceph-users] radosgw crash within libfcgi

- Original Message - From: GuangYang yguan...@outlook.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-de...@vger.kernel.org, ceph-users@lists.ceph.com Sent: Wednesday, June 24, 2015 2:12:23 PM Subject: RE: radosgw crash within libfcgi

Re: [ceph-users] radosgw crash within libfcgi

) process_request() returned ret dendl; } - FCGX_Finish_r(fcgx); - delete req; } Maybe this is a problem on the specific libfcgi version that you're using? - Original Message - From: Yehuda Sadeh-Weinraub yeh...@redhat.com To: GuangYang yguan...@outlook.com Cc: ceph-de

Re: [ceph-users] radosgw crash within libfcgi

- Original Message - From: GuangYang yguan...@outlook.com To: ceph-de...@vger.kernel.org, ceph-users@lists.ceph.com, yeh...@redhat.com Sent: Wednesday, June 24, 2015 10:09:58 AM Subject: radosgw crash within libfcgi Hello Cephers, Recently we have several radosgw daemon crashes

Re: [ceph-users] radosgw get quota

On Thu, Oct 29, 2015 at 11:29 AM, Derek Yarnell wrote: > Sorry, the information is in the headers. So I think the valid question > to follow up is why is this information in the headers and not the body > of the request. I think this is a bug, but maybe I am not aware of a

Re: [ceph-users] Missing bucket

On Fri, Nov 13, 2015 at 12:53 PM, Łukasz Jagiełło wrote: > Hi all, > > Recently I've noticed a problem with one of our buckets: > > I cannot list or stats on a bucket: > #v+ > root@ceph-s1:~# radosgw-admin bucket stats --bucket=problematic_bucket > error getting bucket

Re: [ceph-users] Missing bucket

On Fri, Nov 13, 2015 at 1:37 PM, Łukasz Jagiełło wrote: >> >> > Recently I've noticed a problem with one of our buckets: >> >> > >> >> > I cannot list or stats on a bucket: >> >> > #v+ >> >> > root@ceph-s1:~# radosgw-admin bucket stats >> >> >

Re: [ceph-users] Missing bucket

On Fri, Nov 13, 2015 at 1:14 PM, Łukasz Jagiełło <jagiello.luk...@gmail.com> wrote: > On Fri, Nov 13, 2015 at 1:07 PM, Yehuda Sadeh-Weinraub <yeh...@redhat.com> > wrote: >> >> > Recently I've noticed a problem with one of our buckets: >> > >&g

Re: [ceph-users] radosgw keystone accepted roles not matching

On Thu, Oct 15, 2015 at 8:34 AM, Mike Lowe wrote: > I’m having some trouble with radosgw and keystone integration, I always get > the following error: > > user does not hold a matching role; required roles: Member,user,_member_,admin > > Despite my token clearly having

Re: [ceph-users] How to setup Ceph radosgw to support multi-tenancy?

On Thu, Oct 8, 2015 at 1:55 PM, Christian Sarrasin wrote: > After discovering this excellent blog post [1], I thought that taking > advantage of users' "default_placement" feature would be a preferable way to > achieve my multi-tenancy requirements (see previous post).

Re: [ceph-users] How to setup Ceph radosgw to support multi-tenancy?

ot;name": "default-placement", > "tags": []}, > { "name": "placement-user2", > "tags": []}], > "default_placement": "default-placement&quo

Re: [ceph-users] S3：Permissions of access-key

On Fri, Aug 28, 2015 at 2:17 AM, Zhengqiankun zheng.qian...@h3c.com wrote: hi,Yehuda: I have a question and hope that you can help me answer it. Different subuser of swift can set specific permissions, but why not set specific permission for access-key of s3? Probably because no

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

As long as you're 100% sure that the prefix is only being used for the specific bucket that was previously removed, then it is safe to remove these objects. But please do double check and make sure that there's no other bucket that matches this prefix somehow. Yehuda On Mon, Aug 31, 2015 at 2:42

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

files that start with > "default.8873277.32" > > default.8873277.32__shadow_.OkYjjANx6-qJOrjvdqdaHev-LHSvPhZ_15 > default.8873277.32__shadow_.a2qU3qodRf_E5b9pFTsKHHuX2RUC12g_2 > > > > On Mon, Aug 31, 2015 at 2:51 PM, Yehuda Sadeh-Weinraub > <yeh...@redhat.com&g

Re: [ceph-users] Still have orphaned rgw shadow files, ceph 0.94.3

index itself look like, or if they are > in the .rgw.buckets pool. > > > On Mon, Aug 31, 2015 at 3:23 PM, Yehuda Sadeh-Weinraub > <yeh...@redhat.com> wrote: >> Make sure you use the underscore also, e.g., "default.8873277.32_". >> Otherwise you could potentia

Re: [ceph-users] Troubleshooting rgw bucket list

get: >> name=.be-east.rgw+.bucket.meta.aws-cmis-prod:be-east.5436.1 : hit >> 2015-09-01 17:14:53.008675 7fccb17ca700 1 -- 10.11.4.105:0/1109243 --> >> 10.11.4.105:6801/39085 -- osd_op(client.55506.0:435874 >> ... >> .dir.be-east.5436.1 [call rgw.bucket_list] 26.7d78fc84 >>

Re: [ceph-users] Troubleshooting rgw bucket list

Can you bump up debug (debug rgw = 20, debug ms = 1), and see if the operations (bucket listing and bucket check) go into some kind of infinite loop? Yehuda On Tue, Sep 1, 2015 at 1:16 AM, Sam Wouters wrote: > Hi, I've started the bucket --check --fix on friday evening and it's

Re: [ceph-users] How to observed civetweb.

You can increase the civetweb logs by adding 'debug civetweb = 10' in your ceph.conf. The output will go into the rgw logs. Yehuda On Tue, Sep 8, 2015 at 2:24 AM, Vickie ch wrote: > Dear cephers, >Just upgrade radosgw from apache to civetweb. > It's really simple to

Re: [ceph-users] radosgw and keystone version 3 domains

At the moment radosgw just doesn't support v3 (so it seems). I created issue #13303. If anyone wants to pick this up (or provide some information as to what it would require to support that) it would be great. Thanks, Yehuda On Wed, Sep 30, 2015 at 3:32 AM, Robert Duncan

Re: [ceph-users] radosgw Storage policies

On Mon, Sep 28, 2015 at 4:00 AM, Luis Periquito wrote: > Hi All, > > I was hearing the ceph talk about radosgw and Yehuda talks about storage > policies. I started looking for it in the documentation, on how to > implement/use and couldn't much information: >

Re: [ceph-users] Rados gateway / no socket server point defined

On Thu, Sep 24, 2015 at 8:59 AM, Mikaël Guichard wrote: > Hi, > > I encounter this error : > >> /usr/bin/radosgw -d --keyring /etc/ceph/ceph.client.radosgw.keyring -n >> client.radosgw.myhost > 2015-09-24 17:41:18.223206 7f427f074880 0 ceph version 0.94.3 >

Re: [ceph-users] s3cmd --disable-multipart

On Thu, Dec 10, 2015 at 11:10 AM, Deneau, Tom wrote: > If using s3cmd to radosgw and using s3cmd's --disable-multipart option, is > there any limit to the size of the object that can be stored thru radosgw? > rgw limits plain uploads to 5GB > Also, is there a recommendation

Re: [ceph-users] about federated gateway

On Sun, Dec 13, 2015 at 7:27 AM, 孙方臣 wrote: > Hi, All, > > I'm setting up federated gateway. One is master zone, the other is slave > zone. Radosgw-agent is running in slave zone. I have encountered some > problems, can anybody help answering this: > > 1. When put a object

Re: [ceph-users] rgw pool names

On Fri, Jun 10, 2016 at 11:44 AM, Deneau, Tom wrote: > When I start radosgw, I create the pool .rgw.buckets manually to control > whether it is replicated or erasure coded and I let the other pools be > created automatically. > > However, I have noticed that sometimes the

Re: [ceph-users] rgw s3website issue

On Sun, May 29, 2016 at 4:47 AM, Gaurav Bafna wrote: > Hi Cephers, > > I am unable to create bucket hosting a webstite in my vstart cluster. > > When I do this in boto : > > website_bucket.configure_website('index.html','error.html') > > I get : > >

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

On Thu, Jan 14, 2016 at 10:51 PM, seapasu...@uchicago.edu wrote: > It looks like the gateway is experiencing a similar race condition to what > we reported before. > > The rados object has a size of 0 bytes but the bucket index shows the object > listed and the object

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

": "", > "ns": "", > "object": > "2015\/01\/01\/PAKC\/NWS_NEXRAD_NXL2DP_PAKC_2015010111_20150101115959.tar", > "instance": "" > }, > &qu

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

gRgHUJbhm_TZPXJTZUPXLT2.1_1 > default.384153.1__multipart_2015/01/01/KABR/NWS_NEXRAD_NXL2DP_KABR_2015010113_20150101135959.tar.2~wksHvto9gRgHUJbhm_TZPXJTZUPXLT2.1 > > > > > On 1/15/16 12:05 PM, Yehuda Sadeh-Weinraub wrote: >> >> On Fri, Jan 15, 2016 at 9:36 AM, s

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

1\u", >>>>> "tag": "_cWrvEa914Gy1AeyzIhRlUdp1wJnek3E\u", >>>>> "manifest": { >>>>> "objs": [], >>>>> "obj_size": 7147520, >>>>> "explicit_objs": "false", >>>>>

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

1_20150101115959.tar' > .rgw.buckets/default.384153.1_2015/01/01/PAKC/NWS_NEXRAD_NXL2DP_PAKC_2015010111_20150101115959.tar > mtime 2015-11-04 15:29:30.00, size 0 > > Sorry again for the confusion. > > > > On 1/15/16 3:58 PM, Yehuda Sadeh-Weinraub wrote: >> >> Ah, I see. Misread t

Re: [ceph-users] v10.0.2 released

On Thu, Jan 14, 2016 at 7:37 AM, Sage Weil wrote: > This development release includes a raft of changes and improvements for > Jewel. Key additions include CephFS scrub/repair improvements, an AIX and > Solaris port of librados, many librbd journaling additions and fixes, >

Re: [ceph-users] radosgw anonymous write

On Tue, Feb 9, 2016 at 5:15 AM, Jacek Jarosiewicz wrote: > Hi list, > > My setup is: ceph 0.94.5, ubuntu 14.04, tengine (patched nginx). > > I'm trying to migrate from our old file storage (MogileFS) to the new ceph > radosgw. The problem is that the old storage had no

Re: [ceph-users] RGW: oddity when creating users via admin api

On Wed, Jan 27, 2016 at 4:20 PM, seapasu...@uchicago.edu wrote: > So when I create a new user with the admin api. If the user already exists > it just generates a new keypair for that user. Shouldn't the admin api > report that the user already exists? I ask because I can

Re: [ceph-users] RGW :: bucket quota not enforced below 1

On Wed, Jan 27, 2016 at 4:18 PM, seapasu...@uchicago.edu wrote: > if you set a RGW user to have abucket quota of 0 buckets you can still > create buckets. The only way I have found to prevent a user from being able > to create buckets is to set the op_mask to read. 1.) it

Re: [ceph-users] 411 Content-Length required error

On Wed, Jan 27, 2016 at 3:31 PM, John Hogenmiller wrote: > I did end up switching to civetweb and I also found that rgw content length > compat, which I set to true. I am still getting the 411 Length required > issue. > > I have had more discussions with our testing team,

Re: [ceph-users] Problem create user RGW

try running: $ radosgw-admin --name client.rgw.servergw001 metadata list user Yehuda On Wed, Feb 24, 2016 at 8:41 AM, Andrea Annoè wrote: > I don’t see any user create in RGW > > > > sudo radosgw-admin metadata list user > > [ > > ] > > > > > > sudo radosgw-admin user

Re: [ceph-users] radosgw flush_read_list(): d->client_c->handle_data() returned -5

On Wed, Feb 24, 2016 at 5:48 PM, Ben Hines wrote: > Any idea what is going on here? I get these intermittently, especially with > very large file. > > The client is doing RANGE requests on this >51 GB file, incrementally > fetching later chunks. > > 2016-02-24 16:30:59.669561

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

> >> The head object of a multipart object has 0 size, so it's expected. >> What's missing is the tail of the object. I don't assume you have any >> logs from when the object was uploaded? >> >> Yehuda >> >> On Fri, Jan 15, 2016 at 2:12 PM, seapasu...@uchicago.edu >> <seapasu...@uchi

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

On Thu, Jan 21, 2016 at 4:02 PM, seapasu...@uchicago.edu wrote: > I haven't been able to reproduce the issue on my end but I do not fully > understand how the bug exists or why it is happening. I was finally given > the code they are using to upload the files:: > >

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

On Wed, Jan 20, 2016 at 10:43 AM, seapasu...@uchicago.edu <seapasu...@uchicago.edu> wrote: > > > On 1/19/16 4:00 PM, Yehuda Sadeh-Weinraub wrote: >> >> On Fri, Jan 15, 2016 at 5:04 PM, seapasu...@uchicago.edu >> <seapasu...@uchicago.edu> wrote: >>>

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

asu...@uchicago.edu> wrote: > I'm working on getting the code they used and trying different timeouts in > my multipart upload code. Right now I have not created any new 404 keys > though :-( > > > On 1/20/16 3:44 PM, Yehuda Sadeh-Weinraub wrote: >> >> We'll need to c

Re: [ceph-users] RGW -- 404 on keys in bucket.list() thousands of multipart ids listed as well.

happening going forward? I mean > ideally this should never be possible, right? Even with a complete object > that is 0 bytes it should be downloaded as 0 bytes and have a different > md5sum and not report as 7mb? > > > > On 1/20/16 1:30 PM, Yehuda Sadeh-Weinraub wrote: >>

Re: [ceph-users] How-to doc: hosting a static website on radosgw

On Tue, Jan 26, 2016 at 2:37 PM, Florian Haas wrote: > On Tue, Jan 26, 2016 at 8:56 PM, Wido den Hollander wrote: >> On 01/26/2016 08:29 PM, Florian Haas wrote: >>> Hi everyone, >>> >>> we recently worked a bit on running a full static website just on >>>

Re: [ceph-users] Idea for speedup RadosGW for buckets with many objects.

On Wed, Feb 17, 2016 at 12:51 PM, Krzysztof Księżyk wrote: > Hi, > > I'm experiencing problem with poor performance of RadosGW while operating on > bucket with many object. That's known issue with LevelDB and can be > partially resolved using shrading but I have one more idea.

Re: [ceph-users] rgw bucket deletion woes

On Tue, Mar 15, 2016 at 11:36 PM, Pavan Rallabhandi wrote: > Hi, > > I find this to be discussed here before, but couldn¹t find any solution > hence the mail. In RGW, for a bucket holding objects in the range of ~ > millions, one can find it to take for ever to

Re: [ceph-users] Problem: silently corrupted RadosGW objects caused by slow requests

On Thu, Feb 25, 2016 at 7:17 AM, Ritter Sławomir wrote: > Hi, > > > > We have two CEPH clusters running on Dumpling 0.67.11 and some of our > "multipart objects" are incompleted. It seems that some slow requests could > cause corruption of related S3 objects. Moveover

Re: [ceph-users] Problem: silently corrupted RadosGW objects caused by slow requests

On Fri, Mar 4, 2016 at 7:26 AM, Ritter Sławomir wrote: >> From: Robin H. Johnson [mailto:robb...@gentoo.org] >> Sent: Friday, March 04, 2016 12:40 AM >> To: Ritter Sławomir >> Cc: ceph-us...@ceph.com; ceph-devel >> Subject: Re: [ceph-users] Problem: silently corrupted

Re: [ceph-users] Can Jewel read Hammer radosgw buckets?

(sorry for resubmission, adding ceph-users) On Mon, Apr 25, 2016 at 9:47 AM, Richard Chan wrote: > Hi Yehuda > > I created a test 3xVM setup with Hammer and one radosgw on the (separate) > admin node; creating one user and buckets. > > I upgraded the VMs to jewel

Re: [ceph-users] Can Jewel read Hammer radosgw buckets?

I managed to reproduce the issue, and there seem to be multiple problems. Specifically we have an issue when upgrading a default cluster that hasn't had a zone (and region) explicitly configured before. There is another bug that I found (http://tracker.ceph.com/issues/15597) that makes things even

Re: [ceph-users] Can Jewel read Hammer radosgw buckets?

On Sat, Apr 23, 2016 at 6:22 AM, Richard Chan wrote: > Hi Cephers, > > I upgraded to Jewel and noted the is massive radosgw multisite rework > in the release notes. > > Can Jewel radosgw be configured to present existing Hammer buckets? > On a test system, jewel

Re: [ceph-users] RadosGW not start after upgrade to Jewel

On Tue, Apr 26, 2016 at 6:50 AM, Abhishek Lekshmanan wrote: > > Ansgar Jazdzewski writes: > >> Hi, >> >> After plaing with the setup i got some output that looks wrong >> >> # radosgw-admin zone get >> >> "placement_pools": [ >> { >> "key":

Re: [ceph-users] radosgw hammer -> jewel upgrade (default zone & region config)

On Fri, May 20, 2016 at 9:03 AM, Jonathan D. Proulx wrote: > Hi All, > > I saw the previous thread on this related to > http://tracker.ceph.com/issues/15597 > > and Yehuda's fix script > https://raw.githubusercontent.com/yehudasa/ceph/wip-fix-default-zone/src/fix-zone > >

Re: [ceph-users] RadosGW - Problems running the S3 and SWIFT API at the same time

On Thu, May 12, 2016 at 12:29 AM, Saverio Proto wrote: >> While I'm usually not fond of blaming the client application, this is >> really the swift command line tool issue. It tries to be smart by >> comparing the md5sum of the object's content with the object's etag, >> and

Re: [ceph-users] RadosGW - Problems running the S3 and SWIFT API at the same time

While I'm usually not fond of blaming the client application, this is really the swift command line tool issue. It tries to be smart by comparing the md5sum of the object's content with the object's etag, and it breaks with multipart objects. Multipart objects is calculated differently (md5sum of

  1   2   >