Re: rgw: sticky user quota data on bucket removal

On Wed, Dec 23, 2015 at 3:53 PM, Paul Von-Stamwitz wrote: > Hi, > > We're testing user quotas on Hammer with civetweb and we're running into an > issue with user stats. > > If the user/admin removes a bucket using -force/-purge-objects options with >

Re: rgw subuser create and admin api

On Thu, Dec 17, 2015 at 9:04 AM, Derek Yarnell wrote: > I am having an issue with the 'radosgw-admin subuser create' command > doing something different than the '/{admin}/user?subuser=json' > admin API. I want to leverage subusers in S3 which looks to be possible > in my

Re: rgw subuser create and admin api

On Thu, Dec 17, 2015 at 12:06 PM, Derek Yarnell <de...@umiacs.umd.edu> wrote: > On 12/17/15 2:36 PM, Yehuda Sadeh-Weinraub wrote: >> Try 'section=user=cephtests' > > Doesn't seem to work either. > > # radosgw-admin metadata get user:cephtest > { > &

Re: rgw subuser create and admin api

On Thu, Dec 17, 2015 at 11:05 AM, Derek Yarnell <de...@umiacs.umd.edu> wrote: > On 12/17/15 1:09 PM, Yehuda Sadeh-Weinraub wrote: >>> Bug? Design? >> >> Somewhat a bug. The whole subusers that use s3 was unintentional, so >> when creating the subuser api, w

Re: rgw subuser create and admin api

On Thu, Dec 17, 2015 at 2:44 PM, Derek Yarnell <de...@umiacs.umd.edu> wrote: > On 12/17/15 3:15 PM, Yehuda Sadeh-Weinraub wrote: >> >> Right. Reading the code again: >> >> Try: >> GET /admin/metadata/user=cephtest > > Thanks this is very helpful

Re: cmake

On Wed, Dec 16, 2015 at 9:33 AM, Sage Weil wrote: > The work to transition to cmake has stalled somewhat. I've tried to use > it a few times but keep running into issues that make it unusable for me. > Not having make check is a big one, but I think the hackery required to >

rgw: new multisite update

Orit, Casey and I have been working for quite a while now on a new multi-site framework that will replace the current sync-agent system. There are many improvements that we are working on, and we think it will be worth the wait (and effort!). First and foremost, the main complain that we hear

Re: ack vs commit

On Thu, Dec 3, 2015 at 5:39 PM, Gregory Farnum wrote: > On Thu, Dec 3, 2015 at 4:54 PM, Sage Weil wrote: >> From the beginning Ceph has had two kinds of acks for rados write/update >> operations: ack (indicating the operation is accepted, serialized, and >>

Re: RGW multi-tenancy APIs overview

On Tue, Nov 17, 2015 at 3:47 PM, Pete Zaitcev <zait...@redhat.com> wrote: > On Mon, 9 Nov 2015 21:36:47 -0800 > Yehuda Sadeh-Weinraub <yeh...@redhat.com> wrote: > > We discussed this a bit on RGW team meeting in BJ, and there were some > developments, so for the sake of

Re: RGW multi-tenancy APIs overview

On Mon, Nov 9, 2015 at 9:10 PM, Pete Zaitcev wrote: > With ticket 5073 getting close to complete, we're getting the APIs mostly Great! thanks for all the work you've done to get this closer to completion. > nailed down. Most of them come down to selection a syntax separator

Re: Symbolic links like feature on radosgw

On Mon, Nov 2, 2015 at 9:20 PM, Guang Yang wrote: > Hi Yehuda, > We have a user requirement that needs symbolic link like feature on radosgw > - two object ids pointing to the same object (ideally it could cross bucket, > but same bucket is fine). > > The closest feature on

Re: rgw and the next firefly release v0.80.11

Yes. On Fri, Oct 23, 2015 at 1:10 PM, Loic Dachary wrote: > Hi Yehuda, > > The next firefly release as found at > https://github.com/ceph/ceph/tree/firefly passed the rgw suite > (http://tracker.ceph.com/issues/11644#note-111). Do you think the firefly > branch is ready for

Re: newstore direction

On Tue, Oct 20, 2015 at 11:31 AM, Ric Wheeler wrote: > On 10/19/2015 03:49 PM, Sage Weil wrote: >> >> The current design is based on two simple ideas: >> >> 1) a key/value interface is better way to manage all of our internal >> metadata (object metadata, attrs, layout,

Re: rgw and the next hammer release v0.94.4

Yeah, it should be fine. On Mon, Oct 12, 2015 at 3:56 PM, Loic Dachary wrote: > Hi, > > After todays private discussion and the merge of > https://github.com/ceph/ceph/pull/6161, I will assume the current hammer > branch (7f485ed5aa620fe982561663bf64356b7e2c38f2) is ready for

Re: full cluster/pool handling

On Thu, Sep 24, 2015 at 5:30 AM, Sage Weil wrote: > Xuan Liu recently pointed out that there is a problem with our handling > for full clusters/pools: we don't allow any writes when full, > including delete operations. > > While fixing a separate full issue I ended up making

Re: full cluster/pool handling

On Thu, Sep 24, 2015 at 7:50 AM, Sage Weil <sw...@redhat.com> wrote: > On Thu, 24 Sep 2015, Yehuda Sadeh-Weinraub wrote: >> On Thu, Sep 24, 2015 at 5:30 AM, Sage Weil <sw...@redhat.com> wrote: >> > Xuan Liu recently pointed out that there is a problem with our handlin

Re: nginx for rgw fcgi frontend

On Thu, Sep 17, 2015 at 11:38 PM, Zhou, Yuan wrote: > Hi Yehuda, > > I was trying to do some tests on nginx over rgw and ran into some issue on > the PUT side: > > $ swift upload con ceph_fuse.cc > Object PUT failed: http://localhost/swift/v1/con/ceph_fuse.cc 411 Length >

Re: rgw: the swift key remains after removing a subuser

On Tue, Sep 15, 2015 at 11:49 PM, Xusangdi wrote: > I resend this email because I found that somehow the one from ceph-devel > could not be opened normally. Just wanna make sure you received it, thank you. > > > Hi Yehuda, > > I believe you noticed this issue

Re: [rgw] Multi-tenancy support in radosgw

On Fri, Sep 11, 2015 at 3:24 PM, Radoslaw Zarzynski wrote: > Hello, > > It's a well-known trait of radosgw that an user cannot create new > bucket with a given name if the name is already occupied by other > user's bucket (request to do that will be rejected with 409

Re: S3：Permissions of access-key

On Fri, Aug 28, 2015 at 2:17 AM, Zhengqiankun zheng.qian...@h3c.com wrote: hi,Yehuda: I have a question and hope that you can help me answer it. Different subuser of swift can set specific permissions, but why not set specific permission for access-key of s3? Probably because no

Re: infernalis feature freeze

Can you send a pull request so that I can review it? Thanks, Yehuda On Tue, Aug 18, 2015 at 3:52 PM, Robin H. Johnson robb...@gentoo.org wrote: On Wed, Aug 12, 2015 at 02:20:11PM -0700, Sage Weil wrote: The infernalis feature freeze is coming up Real Soon Now. How soon is RSN? I'm

async execution framework for rgw

I mentioned it briefly in another email, but here's a more detailed overview. As part of my current work on the new rgw multi site synchronization I needed to create new asynchronous execution infrastructure. The whole work started originally as I was tackling async connection handling with curl

Re: RGWUserInfo encode/decode

On Thu, Aug 13, 2015 at 11:50 AM, Pete Zaitcev zait...@redhat.com wrote: Hi, I stumpbled upon a code like this in src/rgw/rgw_common.h: struct RGWUserInfo { mapstring, RGWAccessKey swift_keys; // not one swift_key, a whole map void decode(bufferlist::iterator bl) { string

Re: Async reads, sync writes, op thread model discussion

Already mentioned it on irc, adding to ceph-devel for the sake of completeness. I did some infrastructure work for rgw and it seems (at least to me) that it could at least be partially useful here. Basically it's an async execution framework that utilizes coroutines. It's comprised of aio

Re: radosgw - stuck ops

: ysade...@redhat.com To: sw...@redhat.com CC: yguan...@outlook.com; sj...@redhat.com; yeh...@redhat.com; ceph-devel@vger.kernel.org On Tue, Aug 4, 2015 at 10:03 AM, Sage Weil sw...@redhat.com wrote: On Tue, 4 Aug 2015, Yehuda Sadeh-Weinraub wrote: On Tue, Aug 4, 2015 at 9:55 AM, Sage Weil sw

Re: rgw and the next hammer release v0.94.3

On Tue, Aug 4, 2015 at 3:41 AM, Loic Dachary l...@dachary.org wrote: Hi Yehuda, The next hammer release as found at https://github.com/ceph/ceph/tree/hammer passed the rgw suite (http://tracker.ceph.com/issues/11990#rgw and http://tracker.ceph.com/issues/12502#note-6). Do you think the

Re: Civetweb and mg_set_http_status

at the ceph root: git submodule init; git submodule update Let me know if it fails to work. On Tue, Aug 4, 2015 at 4:11 PM, Pete Zaitcev zait...@redhat.com wrote: I did a git pull today and now the build breaks like this: CXX rgw/libcivetweb_la-rgw_civetweb.lo rgw/rgw_civetweb.cc: In

Re: radosgw - stuck ops

. Yehuda On Tue, Aug 4, 2015 at 8:41 AM, Yehuda Sadeh-Weinraub ysade...@redhat.com wrote: On Mon, Aug 3, 2015 at 6:53 PM, GuangYang yguan...@outlook.com wrote: Hi Yehuda, Recently with our pre-production clusters (with radosgw), we had an outage that all radosgw worker threads got stuck

Re: radosgw - stuck ops

On Tue, Aug 4, 2015 at 9:55 AM, Sage Weil sw...@redhat.com wrote: On Tue, 4 Aug 2015, Yehuda Sadeh-Weinraub wrote: On Mon, Aug 3, 2015 at 6:53 PM, GuangYang yguan...@outlook.com wrote: Hi Yehuda, Recently with our pre-production clusters (with radosgw), we had an outage

Re: radosgw - stuck ops

On Tue, Aug 4, 2015 at 10:03 AM, Sage Weil sw...@redhat.com wrote: On Tue, 4 Aug 2015, Yehuda Sadeh-Weinraub wrote: On Tue, Aug 4, 2015 at 9:55 AM, Sage Weil sw...@redhat.com wrote: One solution that I can think of is to determine before the read/write whether the pg we're about to access

Re: RGW S3 Website hosting, non-clean code for early review

- Original Message - From: Yehuda Sadeh-Weinraub yeh...@redhat.com To: Robin H. Johnson robb...@gentoo.org Cc: ceph-devel@vger.kernel.org, Jonathan LaCour jonathan.lac...@dreamhost.com Sent: Tuesday, June 23, 2015 4:07:44 PM Subject: Re: RGW S3 Website hosting, non-clean code

Re: RGW object versioning status

- Original Message - From: Yuan Zhou yuan.z...@intel.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Ceph Devel ceph-devel@vger.kernel.org Sent: Thursday, July 16, 2015 9:06:29 PM Subject: RGW object versioning status Hi Yehuda, I see there's a wiki page on RGW object

Re: s3test firefly failing

Doesn't ring a bell. There should be a config file it uses to determine where to connect to. - Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Tuesday, July 14, 2015 12:53:40 AM Subject:

Re: head object read with range get on RGW

- Original Message - From: Yuan Zhou yuan.z...@intel.com To: Ceph Devel ceph-devel@vger.kernel.org, Yehuda Sadeh-Weinraub yeh...@redhat.com Sent: Monday, July 13, 2015 4:46:20 AM Subject: head object read with range get on RGW Hi Yehuda, I trace the code and the read op seems

Re: rgw - Object Lifecycle Management

We discussed this, and it's relatively high in our priority, but we need to get the new multi site done first. At the moment there is some background work that is being done by the community to support swift object expiration (see PR #4739). The bigger S3-like lifecycle management is yet to

Re: radosgw crash within libfcgi

- Original Message - From: GuangYang yguan...@outlook.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-devel@vger.kernel.org, ceph-us...@lists.ceph.com Sent: Wednesday, June 24, 2015 2:12:23 PM Subject: RE: radosgw crash within libfcgi

Re: radosgw crash within libfcgi

) process_request() returned ret dendl; } - FCGX_Finish_r(fcgx); - delete req; } Maybe this is a problem on the specific libfcgi version that you're using? - Original Message - From: Yehuda Sadeh-Weinraub yeh...@redhat.com To: GuangYang yguan...@outlook.com Cc: ceph-devel

Re: radosgw crash within libfcgi

- Original Message - From: GuangYang yguan...@outlook.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-devel@vger.kernel.org, ceph-us...@lists.ceph.com Sent: Wednesday, June 24, 2015 1:53:20 PM Subject: RE: radosgw crash within libfcgi Thanks Yehuda for the response

Re: RGW S3 Website hosting, non-clean code for early review

- Original Message - From: Robin H. Johnson robb...@gentoo.org To: ceph-devel@vger.kernel.org Cc: Jonathan LaCour jonathan.lac...@dreamhost.com Sent: Tuesday, June 23, 2015 2:33:25 AM Subject: RGW S3 Website hosting, non-clean code for early review Hi, As an extension of

Re: RGW S3 Website hosting, non-clean code for early review

- Original Message - From: Robin H. Johnson robb...@gentoo.org To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-devel@vger.kernel.org, Jonathan LaCour jonathan.lac...@dreamhost.com Sent: Tuesday, June 23, 2015 4:04:49 PM Subject: Re: RGW S3 Website hosting, non-clean code

Re: Rados multi-object transaction use cases

- Original Message - From: Samuel Just sj...@redhat.com To: ceph-devel ceph-devel@vger.kernel.org Sent: Friday, June 12, 2015 3:15:02 PM Subject: Rados multi-object transaction use cases In the Infernalis CDS, we had a session on RADOS multi-object transactions. I'd like to

Re: Bucket name restrictions in RGW

Whatever we end up doing, we need to make it configurable, and also keep backward compatibility, so that buckets that were created prior to such a change will still remain accessible. Some setups would not need this limitation and will find it too restricting so I'm not sure that it's really

Re: Multipart Upload : Limit on no of parts

- Original Message - From: Abhishek Dixit dixita...@gmail.com To: ceph-devel ceph-devel@vger.kernel.org Sent: Thursday, June 11, 2015 8:28:14 AM Subject: Multipart Upload : Limit on no of parts Hi, I was looking into limit imposed on no of uploads for multipart upload. The way

Re: Duplicate bucket creation Response in RGW

...@gmail.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-devel ceph-devel@vger.kernel.org Sent: Thursday, June 11, 2015 4:30:08 AM Subject: Re: Duplicate bucket creation Response in RGW Hi Yehuda, Following were my findings after I have created two buckets my-bucket-test-in-main in US

Re: Duplicate bucket creation Response in RGW

- Original Message - From: Kyle Bader kyle.ba...@gmail.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Harshal Gupta harshal.gupta...@gmail.com, ceph-devel ceph-devel@vger.kernel.org Sent: Thursday, June 11, 2015 2:22:56 PM Subject: Re: Duplicate bucket creation Response

Re: Duplicate bucket creation Response in RGW

iirc we return 409 in case you're trying to recreate the bucket in a different region. I don't see why we should return it if the user tries to create it in the same region it exists in. Amazon does not return 409 if a bucket is recreated on their main region (where it already exists), so I'm

Re: rgw static-website hosting design WIP: how S3-like should we be with endpoint types?

- Original Message - From: Robin H. Johnson robb...@gentoo.org To: Ceph Development ceph-devel@vger.kernel.org Cc: jonathan lacour jonathan.lac...@dreamhost.com Sent: Monday, June 8, 2015 8:52:21 PM Subject: rgw static-website hosting design WIP: how S3-like should we be with

new rgw multi-site design

We discussed revamping the rgw multi site feature. This includes both simplifying the whole configuration process, and reimplementing the whole process. Also, it will support active-active zone configuration, so multiple zones within the same zonegroup (formerly known as 'region') will be

Re: rgw release notes for hammer v0.94.2 (issue 11570)

I updated the release notes and sent a pull request. Thanks, Yehuda - Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Wednesday, May 27, 2015 2:35:35 PM Subject: rgw release notes for

Re: rgw and the next firefly release v0.80.10

Yes. Thanks, Yehuda - Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org, Xinxin Shu xinxin@intel.com Sent: Friday, May 22, 2015 1:00:32 PM Subject: rgw and the next firefly release v0.80.10

Re: [PATCH] Swift: Set Content-Length when requesting/checking Keystone tokens

This looks good. Can you send a pull request to the ceph github repository? Thanks, Yehuda - Original Message - From: Herve Rousseau hrous...@cern.ch To: ceph-devel@vger.kernel.org Cc: Hervé Rousseau hrous...@cern.ch Sent: Saturday, April 25, 2015 9:38:58 AM Subject: [PATCH] Swift:

Re: [rgw][Swift API] Reusing WSGI middleware of Swift

- Original Message - From: Radoslaw Zarzynski rzarzyn...@mirantis.com To: Ceph Development ceph-devel@vger.kernel.org Sent: Wednesday, April 15, 2015 8:31:22 AM Subject: [rgw][Swift API] Reusing WSGI middleware of Swift Hello Guys, Swift -- besides implementing the OpenStack

Re: radosgw and the next giant release v0.87.2

- Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org, Abhishek L abhishek.lekshma...@gmail.com Sent: Wednesday, April 15, 2015 2:43:12 AM Subject: radosgw and the next giant release v0.87.2

Re: RGW rados handles

- Original Message - From: Pavan Rallabhandi pavan.rallabha...@sandisk.com To: Ceph Development ceph-devel@vger.kernel.org Cc: yeh...@redhat.com Sent: Tuesday, April 7, 2015 7:03:37 AM Subject: RGW rados handles Hi, As part of characterizing RGW read performance, have observed

Re: RGW : Transaction Id in response?

- Original Message - From: Abhishek Dixit dixita...@gmail.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com, ZHOU Yuan dunk...@gmail.com Cc: ceph-devel ceph-devel@vger.kernel.org Sent: Monday, March 16, 2015 11:31:55 PM Subject: Re: RGW : Transaction Id in response? On Sat, Feb

Re: Firefly v0.80.10 backports (rgw)

- Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Monday, March 16, 2015 2:28:09 PM Subject: Firefly v0.80.10 backports (rgw) Hi Yehuda, A few issues related to rgw were backported

Re: rgw and the next firefly release

- Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Tuesday, March 3, 2015 6:57:32 AM Subject: Re: rgw and the next firefly release Hi Yehuda, The rgw suite came back green

Re: can PR 3834 apply to Hammer?

Yeah, applied it now. Thanks, Yehuda - Original Message - From: Matt W. Benjamin m...@cohortfs.com To: ceph-devel ceph-devel@vger.kernel.org Sent: Tuesday, March 3, 2015 11:03:35 AM Subject: can PR 3834 apply to Hammer? This was just CMake build fixes. Matt -- Matt Benjamin

Re: rgw and the next firefly release

- Original Message - From: Yehuda Sadeh-Weinraub yeh...@redhat.com To: Loic Dachary l...@dachary.org Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Saturday, February 28, 2015 8:55:42 AM Subject: Re: rgw and the next firefly release - Original Message - From

Re: rgw and the next firefly release

- Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Monday, March 2, 2015 8:44:22 AM Subject: Re: rgw and the next firefly release Hi Yehuda, On 02/03/2015 17:08, Yehuda

Re: rgw and the next firefly release

- Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Saturday, February 28, 2015 2:44:07 AM Subject: rgw and the next firefly release Hi Yehuda, The rados teuthology suite for the next

Re: s3-tests development

- Original Message - From: Andrew Gaul and...@gaul.org To: ceph-devel@vger.kernel.org Sent: Thursday, February 26, 2015 6:37:35 PM Subject: s3-tests development Hello cephalopods, I use s3-tests to test S3Proxy[1], Apache jclouds, and an internal project. While s3-tests has good

Re: ceph versions

- Original Message - From: Loic Dachary l...@dachary.org To: Ilya Dryomov idryo...@gmail.com Cc: Yehuda Sadeh-Weinraub yeh...@redhat.com, Sage Weil sw...@redhat.com, ceph-devel@vger.kernel.org Sent: Friday, February 27, 2015 5:55:32 AM Subject: Re: ceph versions On 27/02

Re: RGW : Transaction Id in response?

- Original Message - From: Abhishek Dixit dixita...@gmail.com To: ceph-devel ceph-devel@vger.kernel.org Sent: Wednesday, February 25, 2015 8:35:40 PM Subject: RGW : Transaction Id in response? Hi, I was doing comparison of Open Stack Swift response headers and Ceph RGW

Re: ceph versions

- Original Message - From: Loic Dachary l...@dachary.org To: Sage Weil sw...@redhat.com, ceph-devel@vger.kernel.org Sent: Thursday, February 26, 2015 3:38:31 PM Subject: Re: ceph versions Hi Sage, I prefer Option D because it's self explanatory. We could also drop the names. I

Re: ceph:rgw issue #10698

- Original Message - From: Valery Tschopp valery.tsch...@switch.ch To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: ceph-devel ceph-devel@vger.kernel.org Sent: Wednesday, February 18, 2015 12:32:47 AM Subject: Re: ceph:rgw issue #10698 Hi Yehuda, Would it be possible to have

Re: ceph:rgw issue #10698

- Original Message - From: Valery Tschopp valery.tsch...@switch.ch To: yeh...@redhat.com, ceph-devel ceph-devel@vger.kernel.org Sent: Tuesday, February 17, 2015 4:07:26 AM Subject: ceph:rgw issue #10698 Hello Yehuda, The issue http://tracker.ceph.com/issues/10698 rgw: not

Re: using radosgw with mod_proxy_fcgi

- Original Message - From: Tom Deneau tom.den...@amd.com To: ceph-devel@vger.kernel.org Sent: Wednesday, February 11, 2015 4:21:46 PM Subject: using radosgw with mod_proxy_fcgi I am a Ceph novice and have the rados and rbd setups working and would like to use the radosgw stack.

Re: rgw and the next giant release

- Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Tuesday, February 10, 2015 7:05:24 AM Subject: rgw and the next giant release Hi Yehuda, The rgw teuthology suite for the next

Re: Bucket lifecycle (object expiration)

- Original Message - From: Sage Weil s...@newdream.net To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Monday, February 9, 2015 3:42:40 AM Subject: Re: Bucket lifecycle (object expiration) On Fri, 6 Feb 2015, Yehuda Sadeh-Weinraub

Re: Bucket lifecycle (object expiration)

- Original Message - From: Gregory Farnum g...@gregs42.com To: Yehuda Sadeh-Weinraub yeh...@redhat.com Cc: Sage Weil s...@newdream.net, Ceph Development ceph-devel@vger.kernel.org Sent: Monday, February 9, 2015 7:48:43 AM Subject: Re: Bucket lifecycle (object expiration) On Mon

Bucket lifecycle (object expiration)

I have been recently looking at implementing object expiration in rgw. First, a brief description of the feature: S3 provides mechanisms to expire objects, and/or to transition them into different storage class. The feature works at the bucket level. Rules can be set as to which objects will

Re: civetweb upstream

- Original Message - From: Ken Dreyer kdre...@redhat.com To: ceph-devel@vger.kernel.org Sent: Friday, February 6, 2015 7:28:46 AM Subject: civetweb upstream Hi folks, It looks like Ceph has its own fork of the upstream civetweb project. What was the reason for forking at the

Re: rgw and the next dumpling release

- Original Message - From: Loic Dachary l...@dachary.org To: Yehuda Sadeh yeh...@redhat.com Cc: Ceph Development ceph-devel@vger.kernel.org Sent: Thursday, February 5, 2015 2:38:29 PM Subject: rgw and the next dumpling release Hi Yehuda, The rados teuthology suite for the next

Re: rgw: bytes sent/received excludes headers

Hi, It is my impression that bytes_sent and bytes_received do not include headers. We got a request from a customer who wants to include them (I know... greedy.) Is there a way to calculate the amount of header information that was transferred? There's no easy way to do it from the

Re: parent xattrs on file objects

On Tue, Oct 16, 2012 at 2:35 PM, Sage Weil s...@inktank.com wrote: On Tue, 16 Oct 2012, Gregory Farnum wrote: On Tue, Oct 16, 2012 at 2:17 PM, Sage Weil s...@inktank.com wrote: Hey- One of the design goals of the ceph fs was to keep metadata separate from data. This means, among other

Re: [PATCH, v2 06/11] rbd: add read_only rbd map option

Reviewed-by: Yehuda Sadeh yeh...@inktank.com On Thu, Sep 6, 2012 at 8:36 AM, Alex Elder el...@inktank.com wrote: Add the ability to map an rbd image read-only, by specifying either read_only or ro as an option on the rbd command line. Also allow the inverse to be explicitly specified using

Re: RBD kernel: Weird messages about connect authorization failure or socket closed

On Wed, Aug 29, 2012 at 8:04 AM, Sylvain Munaut s.mun...@whatever-company.com wrote: Hi, In the OSD log I see thos auth: could not find secret_id=0 ... Any idea ? Because obviously it succeeds a couple of millisecond later. 2012-08-29 13:47:17.873583 7f981ae9d700 0 --

Re: outstanding branches

On Thu, Jul 12, 2012 at 9:16 AM, Sage Weil s...@inktank.com wrote: These branches need some attention: - wip-mon-mkfs Avoid doing rm -rf (literally) during ceph-mon --mkfs. Do it in vstart.sh and mkcephfs instead. - wip-omap-comparison Eleanor is using this. It should probbaly just go

Re: [PATCH 02/16] rbd: drop a useless local variable

Reviewed-by: Yehuda Sadeh yeh...@inktank.com On Wed, Jul 11, 2012 at 7:00 AM, Alex Elder el...@inktank.com wrote: In rbd_req_sync_notify_ack(), a local variable was needlessly being used to hold a null pointer. Just pass NULL instead. Signed-off-by: Alex Elder el...@inktank.com ---

Re: Ceph questions regarding auth and return on PUT from radosgw

On Mon, Jun 11, 2012 at 5:32 AM, John Axel Eriksson j...@insane.se wrote: Also, when PUTting something through radosgw, does ceph/rgw return as soon as all data has been received or does it return when it has ensured N replicas? (I've seen quite a delay after all data has been sent before my

Re: higher level library for storing large(r) RADOS objects

On Wed, May 2, 2012 at 11:07 PM, Wido den Hollander w...@widodh.nl wrote: Hi, I've been talking to Josh today and we've been talking a bit about storing large objects in RADOS. One of the problem I currently see with using RADOS is storing really large objects. RADOS objects are stored on

Re: Release/branch naming; input requested

On Thu, Apr 26, 2012 at 5:09 PM, Tommi Virtanen tommi.virta...@dreamhost.com wrote: Ceph is maturing as a product. This brings us new challenges. Up to this point, we've been putting out a new release every 2-3 weeks, and only rarely updating an old release. Update releases like 0.42.2 are

Re: [PATCH 1/6] rbd: protect read of snapshot sequence number

On Wed, Apr 18, 2012 at 7:40 AM, Alex Elder el...@dreamhost.com wrote: This is updated whenever a snapshot is added or deleted, and the snapc pointer is changed with every refresh of the header. Signed-off-by: Josh Durgin josh.dur...@dreamhost.com Reviewed-by: Alex Elder el...@dreamhost.com

Re: [PATCH 2/6] rbd: store snapshot id instead of index

On Wed, Apr 18, 2012 at 7:41 AM, Alex Elder el...@dreamhost.com wrote: When a device was open at a snapshot, and snapshots were deleted or added, data from the wrong snapshot could be read. Instead of assuming the snap context is constant, store the actual snap id when the device is

Re: [PATCH 3/6] rbd: remove conditional snapid parameters

On Wed, Apr 18, 2012 at 7:41 AM, Alex Elder el...@dreamhost.com wrote: The snapid parameters passed to rbd_do_op() and rbd_req_sync_op() are now always either a valid snapid or an explicit CEPH_NOSNAP. [el...@dreamhost.com: Rephrased the description] Signed-off-by: Josh Durgin

Re: [PATCH 4/6] rbd: fix snapshot size type

On Wed, Apr 18, 2012 at 7:41 AM, Alex Elder el...@dreamhost.com wrote: Snapshot sizes should be the same type as regular image sizes. This only affects their displayed size in sysfs, not the reported size of an actual block device sizes. Signed-off-by: Josh Durgin josh.dur...@dreamhost.com

Re: [PATCH 5/6] rbd: rename __rbd_update_snaps to __rbd_refresh_header

On Wed, Apr 18, 2012 at 7:41 AM, Alex Elder el...@dreamhost.com wrote: This function rereads the entire header and handles any changes in it, not just changes in snapshots. Signed-off-by: Josh Durgin josh.dur...@dreamhost.com Reviewed-by: Alex Elder el...@dreamhost.com ---  

Re: [PATCH 6/6] rbd: correct sysfs snap attribute documentation

On Wed, Apr 18, 2012 at 7:41 AM, Alex Elder el...@dreamhost.com wrote: Each attribute is prefixed with snap_. Signed-off-by: Josh Durgin josh.dur...@dreamhost.com Reviewed-by: Alex Elder el...@dreamhost.com ---  Documentation/ABI/testing/sysfs-bus-rbd |    4 ++--  1 file changed, 2

Re: Question about IoCtx::aio_exec semantics

On Thu, Apr 19, 2012 at 12:04 PM, Noah Watkins jayh...@cs.ucsc.edu wrote: I've had a lot of success using rados_exec(), but I need to graduate the implementation to use IoCtx::aio_exec for increased concurrency. I'm a little confused about how aio_exec should be used: Here is aio_exec:  

Re: librados aio completion

On Mon, Apr 16, 2012 at 2:20 PM, Greg Farnum gregory.far...@dreamhost.com wrote: On Monday, April 16, 2012 at 2:07 PM, Sage Weil wrote: On Mon, 16 Apr 2012, Greg Farnum wrote: Or set the bool to true, then do the callback, then signal? That's sort of what I was getting at with

Re: librados aio completion

On Sun, Apr 15, 2012 at 9:44 PM, Sage Weil s...@newdream.net wrote: We just switched the completion callbacks so that they are called asynchronously from another thread.  This makes the locking less weird for certain callers and lets you call back into librados in your callback safely. This

Re: Make libcephfs return error when unmounted?

On Wed, Apr 11, 2012 at 3:13 PM, Greg Farnum gregory.far...@dreamhost.com wrote: On Wednesday, April 11, 2012 at 2:59 PM, Noah Watkins wrote: On Apr 11, 2012, at 11:22 AM, Yehuda Sadeh Weinraub wrote: Also need to check that cmount is initialized. I'd add a helper: Client

Re: ceph build error on leveldb

On Thu, Apr 5, 2012 at 10:58 AM, Feiyi Wang fwa...@gmail.com wrote: hi all I am new to ceph and is trying to give it a spin for testing: on both master or stable branch, the configure script gives the WARNING (CentOS 6) config.status: executing depfiles commands config.status: executing

Re: v0.44 released

Note that there are also high level synchronous api calls that were added to librados that mirror the Object*Operation ones. Yehuda On Wed, Mar 21, 2012 at 9:39 AM, Samuel Just sam.j...@dreamhost.com wrote: Hi, The relevant api functions are the omap_* methods of ObjectWriteOperation and

Re: RadosGW problems with copy in s3

On Tue, Mar 6, 2012 at 2:08 AM, Sławomir Skowron szi...@gmail.com wrote: All logs from osd.24, osd.62, and osd.36 with osd debug =20 and filestore debug = 20 from 2012-03-06 10:25 and more. http://217.144.195.170/ceph/osd.24.log.tar.gz   (348MB) - machine 1 - rack1

Re: RadosGW problems with copy in s3

On Mon, Mar 5, 2012 at 2:23 AM, Sławomir Skowron slawomir.skow...@gmail.com wrote: 2012/3/1 Sławomir Skowron slawomir.skow...@gmail.com: 2012/2/29 Yehuda Sadeh Weinraub yehuda.sa...@dreamhost.com: On Wed, Feb 29, 2012 at 5:06 AM, Sławomir Skowron slawomir.skow...@gmail.com wrote: Ok, it's

Re: RadosGW problems with copy in s3

On Wed, Feb 29, 2012 at 5:06 AM, Sławomir Skowron slawomir.skow...@gmail.com wrote: Ok, it's intentional. We are checking meta info about files, then, checking md5 of file content. In parallel, updating object that have change, and then archiving this objects in another key, and last thing

Re: [PATCH] rbd: fix module sysfs setup/teardown code

On Tue, Feb 28, 2012 at 8:00 PM, Alex Elder el...@dreamhost.com wrote: Once rbd_bus_type is registered, it allows an add operation via the /sys/bus/rbd/add bus attribute, and adding a new rbd device that way establishes a connection between the device and rbd_root_dev. But rbd_root_dev is not

Re: [PATCH 2/5] rbd: rework calculation of new rbd id's

On Tue, Feb 28, 2012 at 7:40 PM, Alex Elder el...@dreamhost.com wrote: In order to select a new unique identifier for an added rbd device, the list of all existing ones is searched and a value one greater than the highest id is used. The list search can be avoided by using an atomic variable

  1   2   3   >