Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-18 Thread Jeff Layton
On Mon, 2019-02-18 at 17:02 +0100, Paul Emmerich wrote: > > > I've benchmarked a ~15% performance difference in IOPS between cache > > > expiration time of 0 and 10 when running fio on a single file from a > > > single client. > > > > > > > > > > NFS iops? I'd guess more READ ops in particular?

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-18 Thread Paul Emmerich
> > > > I've benchmarked a ~15% performance difference in IOPS between cache > > expiration time of 0 and 10 when running fio on a single file from a > > single client. > > > > > > NFS iops? I'd guess more READ ops in particular? Is that with a > FSAL_CEPH backend? Yes. But that take that with a

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-18 Thread Jeff Layton
On Mon, 2019-02-18 at 16:40 +0100, Paul Emmerich wrote: > > A call into libcephfs from ganesha to retrieve cached attributes is > > mostly just in-memory copies within the same process, so any performance > > overhead there is pretty minimal. If we need to go to the network to get > > the

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-18 Thread Paul Emmerich
> > A call into libcephfs from ganesha to retrieve cached attributes is > mostly just in-memory copies within the same process, so any performance > overhead there is pretty minimal. If we need to go to the network to get > the attributes, then that was a case where the cache should have been >

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-15 Thread Jeff Layton
On Fri, 2019-02-15 at 15:34 +0800, Marvin Zhang wrote: > Thanks Jeff. > If I set Attr_Expiration_Time as zero in conf , deos it mean timeout > is zero? If so, every client will see the change immediately. Will it > decrease the performance hardly? > I seems that GlusterFS FSAL use UPCALL to

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-14 Thread Marvin Zhang
Thanks Jeff. If I set Attr_Expiration_Time as zero in conf , deos it mean timeout is zero? If so, every client will see the change immediately. Will it decrease the performance hardly? I seems that GlusterFS FSAL use UPCALL to invalidate the cache. How about the CephFS FSAL? On Thu, Feb 14, 2019

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-14 Thread Jeff Layton
On Thu, 2019-02-14 at 20:57 +0800, Marvin Zhang wrote: > Here is the copy from https://tools.ietf.org/html/rfc7530#page-40 > Will Client query 'change' attribute every time before reading to know > if the data has been changed? > >

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-14 Thread Marvin Zhang
Here is the copy from https://tools.ietf.org/html/rfc7530#page-40 Will Client query 'change' attribute every time before reading to know if the data has been changed? +-+++-+---+ | Name| ID | Data Type | Acc | Defined in

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-14 Thread Jeff Layton
On Thu, 2019-02-14 at 19:49 +0800, Marvin Zhang wrote: > Hi Jeff, > Another question is about Client Caching when disabling delegation. > I set breakpoint on nfs4_op_read, which is OP_READ process function in > nfs-ganesha. Then I read a file, I found that it will hit only once on > the first

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-14 Thread Marvin Zhang
Hi Jeff, Another question is about Client Caching when disabling delegation. I set breakpoint on nfs4_op_read, which is OP_READ process function in nfs-ganesha. Then I read a file, I found that it will hit only once on the first time, which means latter reading operation on this file will not

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-14 Thread Jeff Layton
On Thu, 2019-02-14 at 10:35 +0800, Marvin Zhang wrote: > On Thu, Feb 14, 2019 at 8:09 AM Jeff Layton wrote: > > > Hi, > > > As http://docs.ceph.com/docs/master/cephfs/nfs/ says, it's OK to > > > config active/passive NFS-Ganesha to use CephFs. My question is if we > > > can use active/active

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-13 Thread Marvin Zhang
On Thu, Feb 14, 2019 at 8:09 AM Jeff Layton wrote: > > > Hi, > > As http://docs.ceph.com/docs/master/cephfs/nfs/ says, it's OK to > > config active/passive NFS-Ganesha to use CephFs. My question is if we > > can use active/active nfs-ganesha for CephFS. > > (Apologies if you get two copies of

Re: [ceph-users] Fwd: NAS solution for CephFS

2019-02-13 Thread Jeff Layton
> Hi, > As http://docs.ceph.com/docs/master/cephfs/nfs/ says, it's OK to > config active/passive NFS-Ganesha to use CephFs. My question is if we > can use active/active nfs-ganesha for CephFS. (Apologies if you get two copies of this. I sent an earlier one from the wrong account and it got stuck