Re: OSD-Based Object Stubs

2015-05-27 Thread Gregory Farnum
On Wed, May 27, 2015 at 1:39 AM, Marcel Lauhoff wrote: > Hi, > > I wrote a prototype for an OSD-based object stub feature. An object stub > being an object with it's data moved /elsewhere/. I hope to get some > feedback, especially whether I'm on the right path here and if it > is a feature you ar

Re: RFC: progress bars

2015-05-27 Thread Gregory Farnum
Thread necromancy! (Is it still necromancy if it's been waiting in my inbox the whole time?) On Tue, Apr 7, 2015 at 5:54 AM, John Spray wrote: > Hi all, > > [this is a re-send of a mail from yesterday that didn't make it, probably > due to an attachment] > > It has always annoyed me that we don't

Re: RBD mirroring design draft

2015-05-27 Thread Gregory Farnum
On Tue, May 12, 2015 at 5:42 PM, Josh Durgin wrote: > We've talked about this a bit at ceph developer summits, but haven't > gone through several parts of the design thoroughly. I'd like to post > this to a wider audience and get feedback on this draft of a design. > > The journal parts are more d

Re: Chinese Language List

2015-05-27 Thread kefu chai
On Wed, May 27, 2015 at 3:36 AM, Patrick McGarry wrote: > Due to popular demand we are expanding the Ceph lists to include a > Chinese-language list to allow for direct communications for all of > our friends in China. > > ceph...@lists.ceph.com > > It was decided that there are many fragmented di

Re: preparing v0.80.11

2015-05-27 Thread Wido den Hollander
On 05/26/2015 10:28 PM, Nathan Cutler wrote: > Hi Loic: > > The first round of 0.80.11 backports, including all trivial backports > (where "trivial" is defined as those I was able to do by myself without > help), is now ready for integration testing in the "firefly-backports" > branch of the SUSE

Interested in ceph OSD encryption and key management

2015-05-27 Thread Andrew Bartlett
David Disseldorp was good enough to point me at this proposal for ceph OSD key management: https://wiki.ceph.com/Planning/Blueprints/Infernalis/osd%3A_simple_ceph-mon_dm-crypt_key_management I'm really interested in improving ceph on-disk encryption, and am really glad folks are taking this beyond

Re: MDS auth caps for cephfs

2015-05-27 Thread Gregory Farnum
On Wed, May 27, 2015 at 5:37 PM, Sage Weil wrote: > On Wed, 27 May 2015, Gregory Farnum wrote: >> On Wed, May 27, 2015 at 4:59 PM, Sage Weil wrote: >> > On Wed, 27 May 2015, Gregory Farnum wrote: >> >> On Wed, May 27, 2015 at 4:07 PM, Sage Weil wrote: >> >> > On Wed, 27 May 2015, Gregory Farnum

Re: MDS auth caps for cephfs

2015-05-27 Thread Sage Weil
On Wed, 27 May 2015, Gregory Farnum wrote: > On Wed, May 27, 2015 at 4:59 PM, Sage Weil wrote: > > On Wed, 27 May 2015, Gregory Farnum wrote: > >> On Wed, May 27, 2015 at 4:07 PM, Sage Weil wrote: > >> > On Wed, 27 May 2015, Gregory Farnum wrote: > >> >> On Wed, May 27, 2015 at 3:21 PM, Sage Weil

Re: MDS auth caps for cephfs

2015-05-27 Thread Gregory Farnum
On Wed, May 27, 2015 at 4:59 PM, Sage Weil wrote: > On Wed, 27 May 2015, Gregory Farnum wrote: >> On Wed, May 27, 2015 at 4:07 PM, Sage Weil wrote: >> > On Wed, 27 May 2015, Gregory Farnum wrote: >> >> On Wed, May 27, 2015 at 3:21 PM, Sage Weil wrote: >> >> > On Wed, 27 May 2015, Gregory Farnum

Re: MDS auth caps for cephfs

2015-05-27 Thread Sage Weil
On Wed, 27 May 2015, Gregory Farnum wrote: > On Wed, May 27, 2015 at 4:07 PM, Sage Weil wrote: > > On Wed, 27 May 2015, Gregory Farnum wrote: > >> On Wed, May 27, 2015 at 3:21 PM, Sage Weil wrote: > >> > On Wed, 27 May 2015, Gregory Farnum wrote: > >> >> > I was just talking to Simo about the lon

Re: MDS auth caps for cephfs

2015-05-27 Thread Gregory Farnum
On Wed, May 27, 2015 at 4:07 PM, Sage Weil wrote: > On Wed, 27 May 2015, Gregory Farnum wrote: >> On Wed, May 27, 2015 at 3:21 PM, Sage Weil wrote: >> > On Wed, 27 May 2015, Gregory Farnum wrote: >> >> > I was just talking to Simo about the longer-term kerberos auth goals to >> >> > make sure we

Re: MDS auth caps for cephfs

2015-05-27 Thread Sage Weil
On Wed, 27 May 2015, Gregory Farnum wrote: > On Wed, May 27, 2015 at 3:21 PM, Sage Weil wrote: > > On Wed, 27 May 2015, Gregory Farnum wrote: > >> > I was just talking to Simo about the longer-term kerberos auth goals to > >> > make sure we don't do something stupid here that we regret later. His

Re: Memory Allocators and Ceph

2015-05-27 Thread Mark Nelson
On 05/27/2015 04:00 PM, Robert LeBlanc wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On Wed, May 27, 2015 at 2:06 PM, Mark Nelson wrote: Compiling Ceph entirely with jemalloc overall had a negative performance impact. This may be due to dynamically linking to RocksDB instead of the

Re: MDS auth caps for cephfs

2015-05-27 Thread Gregory Farnum
On Wed, May 27, 2015 at 3:21 PM, Sage Weil wrote: > On Wed, 27 May 2015, Gregory Farnum wrote: >> > I was just talking to Simo about the longer-term kerberos auth goals to >> > make sure we don't do something stupid here that we regret later. His >> > feedback boils down to: >> > >> > 1) Don't b

Re: MDS auth caps for cephfs

2015-05-27 Thread Sage Weil
On Wed, 27 May 2015, Gregory Farnum wrote: > > I was just talking to Simo about the longer-term kerberos auth goals to > > make sure we don't do something stupid here that we regret later. His > > feedback boils down to: > > > > 1) Don't bother with root squash since it doesn't buy you much, and

Re: MDS auth caps for cephfs

2015-05-27 Thread Gregory Farnum
On Wed, May 27, 2015 at 2:44 PM, Sage Weil wrote: > On Tue, 26 May 2015, Gregory Farnum wrote: >> >> >> Basically I'm still stuck on how any of this lets us lock a user into >> >> >> a subtree while letting them do what they want within it. I'm not sure >> >> >> how/if NFS solves that problem... >

Re: MDS auth caps for cephfs

2015-05-27 Thread Sage Weil
On Tue, 26 May 2015, Gregory Farnum wrote: > >> >> Basically I'm still stuck on how any of this lets us lock a user into > >> >> a subtree while letting them do what they want within it. I'm not sure > >> >> how/if NFS solves that problem... > >> > > >> > That's easy: > >> > > >> > # lock client i

rgw release notes for hammer v0.94.2 (issue 11570)

2015-05-27 Thread Loic Dachary
Hi Yehuda, Reading http://tracker.ceph.com/issues/11570#note-6 it looks like it would be good to include something in the release notes for hammer v0.94.2. Would you mind updating http://ceph.com/docs/master/release-notes/#hammer-draft if you think it's relevant ? Note that we're still conduc

Re: hammer branch for v0.94.2 ready for QE

2015-05-27 Thread Gregory Farnum
On Wed, May 27, 2015 at 2:12 PM, Yuri Weinstein wrote: > QE validation status. > > All detailed information is summarized in http://tracker.ceph.com/issues/11492 > > Team leads pls review for do "go"-"no-go" decision. > > Issues to be considered: > > rados - passed ~2.8K jobs, listed issues (#1166

Re: hammer branch for v0.94.2 ready for QE

2015-05-27 Thread Loic Dachary
On 27/05/2015 23:12, Yuri Weinstein wrote: > QE validation status. > > All detailed information is summarized in http://tracker.ceph.com/issues/11492 > > Team leads pls review for do "go"-"no-go" decision. > > Issues to be considered: > > rados - passed ~2.8K jobs, listed issues (#11660, #116

Re: Some thoughts regarding the new store

2015-05-27 Thread Sage Weil
On Wed, 27 May 2015, Haomai Wang wrote: > On Wed, May 27, 2015 at 4:41 PM, Li Wang wrote: > > I have just noticed the new store development, and had a > > look at the idea behind it (http://www.spinics.net/lists/ceph- > > devel/msg22712.html), so my understanding, we wanna avoid the > > double-wri

Re: hammer branch for v0.94.2 ready for QE

2015-05-27 Thread Yuri Weinstein
QE validation status. All detailed information is summarized in http://tracker.ceph.com/issues/11492 Team leads pls review for do "go"-"no-go" decision. Issues to be considered: rados - passed ~2.8K jobs, listed issues (#11660, #11661) are not blockers (NOTE: we also agreed to use the "0/7th"

Re: Memory Allocators and Ceph

2015-05-27 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On Wed, May 27, 2015 at 2:06 PM, Mark Nelson wrote: >> Compiling Ceph entirely with jemalloc overall had a negative >> performance impact. This may be due to dynamically linking to RocksDB >> instead of the default static linking. > > > Is it possi

Re: Memory Allocators and Ceph

2015-05-27 Thread Mark Nelson
On 05/27/2015 12:40 PM, Robert LeBlanc wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 With all the talk of tcmalloc and jemalloc, I decided to do some testing og the different memory allocating technologies between KVM and Ceph. These tests were done a pre-production system so I've tried

Re: [ceph-users] Memory Allocators and Ceph

2015-05-27 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 The workload is on average, 17KB per read request and 13KB per write request with 73% read abd 27% write. This is a web hosting workload. - Robert LeBlanc GPG Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1 On Wed, M

Re: [ceph-users] Memory Allocators and Ceph

2015-05-27 Thread Haomai Wang
On Thu, May 28, 2015 at 1:40 AM, Robert LeBlanc wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > With all the talk of tcmalloc and jemalloc, I decided to do some > testing og the different memory allocating technologies between KVM > and Ceph. These tests were done a pre-production s

Memory Allocators and Ceph

2015-05-27 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 With all the talk of tcmalloc and jemalloc, I decided to do some testing og the different memory allocating technologies between KVM and Ceph. These tests were done a pre-production system so I've tried to remove some the variance with many runs and

Re: OSD-Based Object Stubs

2015-05-27 Thread Robert LeBlanc
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 At first I thought this was to allow the OSDs to stub the location of the real data after a CRUSH map change so that it didn't have to relocate the data right away (or at all) and reduce the number of map changes. Then I realized it was for cold sto

Re: cephfs task: Extend file layout ceph_file_layout to specify a namespace id

2015-05-27 Thread Sage Weil
On Tue, 12 May 2015, Gregory Farnum wrote: > On Tue, May 12, 2015 at 10:42 AM, Goldwyn Rodrigues wrote: > > Hi, > > > > The task mentioned in $SUBJECT is a part of the multi-tenancy cephfs > > project. Has someone taken the task as yet? If not, I am interested in > > working on the task. > > We'v

05/27/2015 Weekly Ceph Performance Meeting IS ON!

2015-05-27 Thread Mark Nelson
8AM PST as usual! Discussion topics include: Xiaoxi's newstore latency tests, Andrea's microbenchmark results, Cache tiering. Please feel free to add your own! Here's the links: Etherpad URL: http://pad.ceph.com/p/performance_weekly To join the Meeting: https://bluejeans.com/268261044 To j

Re: ceph-osd: microbenchmark for 4k read operations

2015-05-27 Thread Mark Nelson
On 05/20/2015 11:13 AM, Andreas Bluemle wrote: Hi, as discussed on todays performance meeting: find attached the spreadsheet which I had shown during the meeting. @Sam: your are right concerning the make_blist part: this probably is expensive due to message signing being turned on. For the osd

Ceph Tech Talk Online Today at 1p EDT

2015-05-27 Thread Patrick McGarry
Just as a reminder, our monthly Ceph Tech Talk will be happening today (instead of its usual time on a Thurs) at 1p EDT (a little over 3 hours from now). Florian from Hastexo will be discussing placement groups which is especially important if you are planning a cluster or looking to expand. Whil

Re: Some thoughts regarding the new store

2015-05-27 Thread Mark Nelson
On 05/27/2015 04:46 AM, Haomai Wang wrote: On Wed, May 27, 2015 at 4:41 PM, Li Wang wrote: I have just noticed the new store development, and had a look at the idea behind it (http://www.spinics.net/lists/ceph- devel/msg22712.html), so my understanding, we wanna avoid the double-write penalty

Re: Some thoughts regarding the new store

2015-05-27 Thread Haomai Wang
On Wed, May 27, 2015 at 4:41 PM, Li Wang wrote: > I have just noticed the new store development, and had a > look at the idea behind it (http://www.spinics.net/lists/ceph- > devel/msg22712.html), so my understanding, we wanna avoid the > double-write penalty of WRITE_AHEAD_LOGGING journal mechanis

Re: OSD-Based Object Stubs

2015-05-27 Thread Haomai Wang
I guess it should be something like sam designed in CDS(https://wiki.ceph.com/Planning/Blueprints/Infernalis/osd%3A_Tiering_II_(Warm-%3ECold)) On Wed, May 27, 2015 at 4:39 PM, Marcel Lauhoff wrote: > Hi, > > I wrote a prototype for an OSD-based object stub feature. An object stub > being an objec

OSD-Based Object Stubs

2015-05-27 Thread Marcel Lauhoff
Hi, I wrote a prototype for an OSD-based object stub feature. An object stub being an object with it's data moved /elsewhere/. I hope to get some feedback, especially whether I'm on the right path here and if it is a feature you are interested in. Code is in my "osd-stubs" branch: https://gith

Some thoughts regarding the new store

2015-05-27 Thread Li Wang
I have just noticed the new store development, and had a look at the idea behind it (http://www.spinics.net/lists/ceph- devel/msg22712.html), so my understanding, we wanna avoid the double-write penalty of WRITE_AHEAD_LOGGING journal mechanism, the straightforward thought is to optimize CREATE, AP