Re: [Gluster-devel] How use Gluster/NFS

2016-04-29 Thread Rick Macklem
Abhishek Paliwal wrote: > Hi Team, > > I want to use gluster NFS and export this gluster volume using 'mount -t nfs > -o acl' command. > > i have done the following changes: > 1. Enable the NFS using nfs.disable off > 2. Enable the ACL using nfs.acl on > 3. RPCbind is also running > 4. Kernel NFS

Re: [Gluster-devel] pNFS server for FreeBSD using GlusterFS

2016-04-25 Thread Rick Macklem
- Original Message - > CCing ganesha list > > On 22/04/16 04:18, Rick Macklem wrote: > > Jiffin Tony Thottan wrote: > >> > >> On 21/04/16 04:43, Rick Macklem wrote: > >>> Hi, > >>> > >>> Just to let you know, I did fin

Re: [Gluster-devel] pNFS server for FreeBSD using GlusterFS

2016-04-21 Thread Rick Macklem
Jiffin Tony Thottan wrote: > > > On 21/04/16 04:43, Rick Macklem wrote: > > Hi, > > > > Just to let you know, I did find the email responses to my > > queries some months ago helpful and I now have a pNFS server > > for FreeBSD using the GlusterFS port at

[Gluster-devel] pNFS server for FreeBSD using GlusterFS

2016-04-20 Thread Rick Macklem
Hi, Just to let you know, I did find the email responses to my queries some months ago helpful and I now have a pNFS server for FreeBSD using the GlusterFS port at the alpha test stage. So far I have not made any changes to GlusterFS except the little poll() patch that was already discussed on thi

Re: [Gluster-devel] rm -r problem on FreeBSD port

2016-01-27 Thread Rick Macklem
gt; > > > > Sorry this isn't particularily useful, but it's all I have, rick > > The system on which you are getting the errors, is it a vm which I can > > access? So that I can try few more extra tests? > > > > > > > - Original Message

Re: [Gluster-devel] rm -r problem on FreeBSD port

2016-01-27 Thread Rick Macklem
but it's all I have, rick > The system on which you are getting the errors, is it a vm which I can > access? So that I can try few more extra tests? > > > > - Original Message - > > From: "Rick Macklem" > > To: "Sakshi Bansal" > &g

Re: [Gluster-devel] rm -r problem on FreeBSD port

2016-01-26 Thread Rick Macklem
ceed (reply 0) and the getdirentries() find entries in the directories. (I'd guess that means that the "lookup" done in the "unlink" succeeds?) It does seem that unmount/remount of the fuse mount has some effect on what is returned. Sorry this isn't particularily

Re: [Gluster-devel] rm -r problem on FreeBSD port

2016-01-20 Thread Rick Macklem
Sakshi Bansal wrote: > The directory deletion is failing with ENOTEMPTY since not all the files > inside it have been deleted. Looks like lookup is not listing all the files. > It is possible that cluster.lookup-optimize could be the culprit here. When > did you turn this option 'on'? Was it during

Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2016-01-19 Thread Rick Macklem
> > freebsd...@freebsd.org, xhernan...@datalab.es, j...@ixsystems.com > > Sent: Tuesday, January 19, 2016 3:35:07 PM > > Subject: Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of > > CPU usage > > > > >>>>> On Tue, 19 Jan 2016 01:01:19 -0500

Re: [Gluster-devel] rm -r problem on FreeBSD port

2016-01-19 Thread Rick Macklem
Sakshi Bansal wrote: > > > Sometimes. When this occurs (I get something like this every time I do an > > "rm -r") > > I can sometimes go into the directory and do an explicit "rm ". At > > that point > > it will report that the file doesn't exist (I suspect because it sees 2 of > > them and > > th

Re: [Gluster-devel] rm -r problem on FreeBSD port

2016-01-19 Thread Rick Macklem
Sakshi Bansai wrote: > Hi Rick, > > Could you get us some more information about your setup: > First off, just to make it clear, the setup is a simple 2 brick distribute (no replication or ...) like the doc recommends for a quick tryout. > 1) Are you parallely doing 'rm -r' from multiple mount p

Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2016-01-19 Thread Rick Macklem
Raghavendra Gowdappa wrote: > > > - Original Message - > > From: "Rick Macklem" > > To: "Raghavendra Gowdappa" > > Cc: "Jeff Darcy" , "Raghavendra G" > > , "freebsd-fs" > > , "Hubbard Jordan&q

Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2016-01-19 Thread Rick Macklem
> > freebsd...@freebsd.org, xhernan...@datalab.es, j...@ixsystems.com > > Sent: Tuesday, January 19, 2016 3:35:07 PM > > Subject: Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of > > CPU usage > > > > >>>>> On Tue, 19 Jan 2016 01:01:19 -0500

[Gluster-devel] rm -r problem on FreeBSD port

2016-01-18 Thread Rick Macklem
Hi, I have a simple gluster volume made up of 2 bricks using distribute (running on the FreeBSD port of 3.7.6). When I do a "rm -rf " for a fairly large tree, I sometimes get "Directory not empty" errors. When I look in the directory (even after an unmount, shutdown, restart, remount) the "ls -l"

Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2016-01-18 Thread Rick Macklem
Raghavendra Gowdappa wrote: > > > - Original Message - > > From: "Rick Macklem" > > To: "Jeff Darcy" > > Cc: "Raghavendra G" , "freebsd-fs" > > , "Hubbard Jordan" > > , "Xavier Hernandez&qu

Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2016-01-08 Thread Rick Macklem
Oops, I realized the last patch did a write(2) while holding a pthread_mutex. I've never used pthread_mutexes, but I suspect this isn't allowed. The attached updated patch delays the write() until after the pthread_mutex_unlock(). Sorry about the confusion, rick - Original Message - > > >

Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2016-01-08 Thread Rick Macklem
Jeff Darcy wrote: > > > I don't know anything about gluster's poll implementation so I may > > > be totally wrong, but would it be possible to use an eventfd (or a > > > pipe if eventfd is not supported) to signal the need to add more > > > file descriptors to the poll call ? > > > > > > > > > The

Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2015-12-30 Thread Rick Macklem
Jordan Hubbard wrote: > > > On Dec 30, 2015, at 2:31 AM, Niels de Vos wrote: > > > >> I'm guessing that Linux uses the event-epoll stuff instead of event-poll, > >> so it wouldn't exhibit this. Is that correct? > > > > Well, both. most (if not all) Linux builds will use event-poll. But, > > tha

Re: [Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2015-12-30 Thread Rick Macklem
Niels de Vos wrote: > On Tue, Dec 29, 2015 at 08:12:40PM -0500, Rick Macklem wrote: > > Hi, > > > > I'm been playing with the FreeBSD port of GlusterFS and it seems > > to be working ok. I do notice that the daemons use a lot of CPU, > > even when there is

[Gluster-devel] FreeBSD port of GlusterFS racks up a lot of CPU usage

2015-12-29 Thread Rick Macklem
Hi, I'm been playing with the FreeBSD port of GlusterFS and it seems to be working ok. I do notice that the daemons use a lot of CPU, even when there is nothing to do (no volumes started, etc). When I ktrace the daemon, I see a small number of nanosleep() and select() syscalls and lots of poll() s

[Gluster-devel] everything builds and installs on FreeBSD via ports tarball

2015-12-09 Thread Rick Macklem
Hi, Just to let you know, others are working on a "port" for FreeBSD and everything builds/installs when you use it. (It uses gcc and some other things I didn't use. I suspect my "make install" problem had to do with using BSD make, but I don't know.) Anyhow, it build/installs and work once you:

[Gluster-devel] minor "make install" issue for FreeBSD

2015-12-08 Thread Rick Macklem
Near the end of "make install", it fails in glusterfind because DESTDIR is empty. Here's the "make install" output: ../.././install-sh -c -d '/usr/local/libexec/glusterfs/gfind_missing_files' /usr/bin/install -c gfind_missing_files.sh gfid_to_path.sh gfid_to_path.py '/usr/local/libexec/glusterfs

[Gluster-devel] more re: building on FreeBSD

2015-12-07 Thread Rick Macklem
Ok, after I did autogen.sh before configure, the build did make the shared libraries. (The patch I posted in the last email wasn't needed, since library ordering won't matter for shared libs. It must have been trying to do static linking without doing autogen.sh.) It fails near the end of "make in

[Gluster-devel] building/installing on FreeBSD

2015-12-07 Thread Rick Macklem
Hi, I've been trying to build/install 3.7.6 from the source tarball onto FreeBSD and have had some luck. I basically needed to apply this little patch: --- cli/src/Makefile.in.sav 2015-12-06 17:06:59.252807000 -0500 +++ cli/src/Makefile.in 2015-12-06 17:07:44.741783000 -0500 @@ -63,8 +63,8 @@

Re: [Gluster-devel] using GlusterFS to build an NFSv4.1 pNFS server

2015-06-02 Thread Rick Macklem
riment. If it ever is useful for (near) production environments, I suspect it would be users that have set up a FreeBSD NFS server and it is outgrowing what a single server can handle. In other words, they would come from the FreeBSD NFS server side and not the GlusterFS side. > Other comments are inl

[Gluster-devel] using GlusterFS to build an NFSv4.1 pNFS server

2015-06-01 Thread Rick Macklem
Hi, Btw, I do most of the FreeBSD NFSv4 work. I am interested in trying to use GlusterFS to build a FreeBSD NFSv4.1 pNFS server. My hope is that, by directing the NFSv4.1 client to the host where the file resides, the client will be able to do I/O on it efficiently via the NFSv3 server. (The new l