Re: cephfs survey results

2014-11-04 Thread Sage Weil
On Tue, 4 Nov 2014, Blair Bethwaite wrote: On 4 November 2014 01:50, Sage Weil s...@newdream.net wrote: In the Ceph session at the OpenStack summit someone asked what the CephFS survey results looked like. Thanks Sage, that was me! Here's the link:

[PATCH 2/2] libceph: message signature support

2014-11-04 Thread Yan, Zheng
Signed-off-by: Yan, Zheng z...@redhat.com --- fs/ceph/mds_client.c | 16 +++ include/linux/ceph/auth.h | 26 + include/linux/ceph/ceph_features.h | 1 + include/linux/ceph/messenger.h | 9 +- include/linux/ceph/msgr.h | 8 ++

[PATCH 1/2] libceph: store session key in cephx authorizer

2014-11-04 Thread Yan, Zheng
Session key is required when calculating message signature. Save the session key in authorizer, this avoid lookup ticket handler for each message Signed-off-by: Yan, Zheng z...@redhat.com --- net/ceph/auth_x.c | 18 +++--- net/ceph/auth_x.h | 1 + 2 files changed, 12 insertions(+),

Re: The Async messenger benchmark with latest master

2014-11-04 Thread Haomai Wang
OK, I will solve it if free. It's a problem when one connection want to replace existing connection for the same endpoint. Thank you! On Tue, Nov 4, 2014 at 10:41 AM, Alexandre DERUMIER aderum...@odiso.com wrote: could you run ceph -w --debug-ms=10/10 ? Here the output. (monitor ips are

[PATCH 2/7] ceph: remove unused `map_waiters` from osdc client

2014-11-04 Thread John Spray
This is initialized but never used. Signed-off-by: John Spray john.sp...@redhat.com --- include/linux/ceph/osd_client.h | 1 - net/ceph/osd_client.c | 1 - 2 files changed, 2 deletions(-) diff --git a/include/linux/ceph/osd_client.h b/include/linux/ceph/osd_client.h index

[PATCH 1/7] ceph: update ceph_msg_header structure

2014-11-04 Thread John Spray
2 bytes of what was reserved space is now used by userspace for the compat_version field. Signed-off-by: John Spray john.sp...@redhat.com --- include/linux/ceph/msgr.h | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/include/linux/ceph/msgr.h b/include/linux/ceph/msgr.h

[PATCH 7/7] ceph: include osd epoch barrier in debugfs

2014-11-04 Thread John Spray
This is useful in our automated testing, so that we can verify that the barrier is propagating correctly between servers and clients. Signed-off-by: John Spray john.sp...@redhat.com --- fs/ceph/debugfs.c | 3 +++ 1 file changed, 3 insertions(+) diff --git a/fs/ceph/debugfs.c b/fs/ceph/debugfs.c

[PATCH 5/7] ceph: update CAPRELEASE message format

2014-11-04 Thread John Spray
Version 2 includes the new osd epoch barrier field. This allows clients to inform servers that their released caps may not be used until a particular OSD map epoch. Signed-off-by: John Spray john.sp...@redhat.com --- fs/ceph/mds_client.c | 13 + fs/ceph/mds_client.h | 8 ++-- 2

[PATCH 3/7] ceph: add ceph_osdc_cancel_writes

2014-11-04 Thread John Spray
To allow us to abort writes in ENOSPC conditions, instead of having them block indefinitely. Signed-off-by: John Spray john.sp...@redhat.com --- include/linux/ceph/osd_client.h | 8 + net/ceph/osd_client.c | 67 + 2 files changed, 75

[PATCH 4/7] ceph: handle full condition by cancelling ops

2014-11-04 Thread John Spray
While cancelling, we store the OSD epoch at time of cancellation, this will be used later in CAPRELEASE messages. Signed-off-by: John Spray john.sp...@redhat.com --- fs/ceph/mds_client.c | 21 + fs/ceph/mds_client.h | 1 + 2 files changed, 22 insertions(+) diff --git

Re: [PATCH 3/7] ceph: add ceph_osdc_cancel_writes

2014-11-04 Thread Ilya Dryomov
On Tue, Nov 4, 2014 at 5:34 PM, John Spray john.sp...@redhat.com wrote: To allow us to abort writes in ENOSPC conditions, instead of having them block indefinitely. I just saw the word cancel, and as we've had trouble in this area in libceph in the past, a couple nit-pickings. First, in my

Re: 11/4/2014 Weekly Ceph Performance Meeting IS ON!

2014-11-04 Thread Alexandre DERUMIER
Hi Mark, Is it today ? (11/4/2014 from you mail subject) or tommorow (2014-11-05 in etherpad) - Mail original - De: Mark Nelson mark.nel...@inktank.com À: ceph-devel@vger.kernel.org Envoyé: Mardi 4 Novembre 2014 16:16:32 Objet: 11/4/2014 Weekly Ceph Performance Meeting IS ON! Hi

Re: 11/4/2014 Weekly Ceph Performance Meeting IS ON!

2014-11-04 Thread Mark Nelson
Hi Alex, Doh! Sorry everyone, Alex is right! 11/5/2014! I will resend and fix. Mark On 11/04/2014 09:21 AM, Alexandre DERUMIER wrote: Hi Mark, Is it today ? (11/4/2014 from you mail subject) or tommorow (2014-11-05 in etherpad) - Mail original - De: Mark Nelson

FIXED: 11/5/2014 Weekly Ceph Performance Meeting IS ON!

2014-11-04 Thread Mark Nelson
Hi All, Got the date wrong the first time. 11/5/2014 is correct! 8AM PST as usual. We are going to try a little experiment and leave the Agenda blank for you guys to fill in. If you are planning on attending and have something you want to discuss, please add it! We've also added a

Re: [ceph-users] cephfs survey results

2014-11-04 Thread Mariusz Gronczewski
On Tue, 4 Nov 2014 10:36:07 +1100, Blair Bethwaite blair.bethwa...@gmail.com wrote: TBH I'm a bit surprised by a couple of these and hope maybe you guys will apply a certain amount of filtering on this... fsck and quotas were there for me, but multimds and snapshots are what I'd consider

Re: [ceph-users] cephfs survey results

2014-11-04 Thread Scottix
Agreed Multi-MDS is a nice to have but not required for full production use. TBH stability and recovery will win any IT person dealing with filesystems. On Tue, Nov 4, 2014 at 7:33 AM, Mariusz Gronczewski mariusz.gronczew...@efigence.com wrote: On Tue, 4 Nov 2014 10:36:07 +1100, Blair Bethwaite

Re: cephfs survey results

2014-11-04 Thread Patrick Hahn
On Mon, Nov 3, 2014 at 6:36 PM, Blair Bethwaite blair.bethwa...@gmail.com wrote: On 4 November 2014 01:50, Sage Weil s...@newdream.net wrote: In the Ceph session at the OpenStack summit someone asked what the CephFS survey results looked like. Thanks Sage, that was me! Here's the link:

Re: cephfs survey results

2014-11-04 Thread Mark Kirkwood
On 04/11/14 22:02, Sage Weil wrote: On Tue, 4 Nov 2014, Blair Bethwaite wrote: On 4 November 2014 01:50, Sage Weil s...@newdream.net wrote: In the Ceph session at the OpenStack summit someone asked what the CephFS survey results looked like. Thanks Sage, that was me! Here's the link:

Consul

2014-11-04 Thread Loic Dachary
Hi Ceph, While at the OpenStack summit Dan Bode spoke highly of Consul ( https://consul.io/intro/index.html ). Its scope is new to me. Each individual feature is familiar but I'm not entirely sure if combining them into a single software is necessary. And I wonder how it could relate to Ceph.

ceph.devel

2014-11-04 Thread jianpeng
subject all ceph-dev maillist -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Consul

2014-11-04 Thread Hunter Nield
I concur with Dan on Consul. It's a great tool. We use Consul in our Ceph environments but only as a layer above an installed Ceph installation. Health checks (for the mons/osds processes and ceph health) and service discovery (for the apps/services that run in Docker containers on top). We've

Question about Transaction::get_data_alignment

2014-11-04 Thread Dong Yuan
Hi Sage, I am now working with the BP osd: update Transaction encoding, but the Transaction::get_data_alignment make me confused. This method give the alignment which is used by FileJournal to do better buffer build. It calculate the alignment by largest_data_off and get_data_offset() while the