Re: [Gluster-users] Gluster 3.1 and NFS problem

2010-10-28 Thread Shehjar Tikoo
Hi What kind of app/tool was running on the nfs mount point when it hung? Here are some things we can do to debug further. Please restart the NFS server daemon using the TRACE log level, remount NFS and restart the tests. That way I'll be able to zero-in on the operation that results in this

Re: [Gluster-users] NFS export issue with GlusterFS 3.1

2010-10-28 Thread Shehjar Tikoo
Bernard Li wrote: Hi Shehjar: The hosts with exports in the replication pool are already running NFS servers so I need to setup GlusterFS native NFS server on another server. I am using the following /etc/glusterfs/glusterfsd.vol: Thats not recommended but I can see why this is needed. The

[Gluster-users] How does gluster identify which brick is the closest

2010-10-28 Thread Thai. Ngo Bao
Hello all, First of all, I would like to thank you for the great FS. I have some basic questions regarding Elastic Hash Algorithm (EHA). I understand that EHA decides data placement at a host level and then places complete files on its selected storage. EHA also takes one step further and

[Gluster-users] rdma problems with glusterfs 3.1.0

2010-10-28 Thread Michael Galloway
Good day all, I’ve built a new glusterfs volume using 20 nodes of one of my clusters, each with a 2TB SATA disk, formatted with ext3 (system is centos 5.2, x86_64). The volume is such: Volume Name: gfsvol1 Type: Distributed-Replicate Status: Started Number of Bricks: 10 x 2 = 20 Transport-type:

Re: [Gluster-users] rdma problems with glusterfs 3.1.0

2010-10-28 Thread Michael Galloway
i guess thats at least part of what my question is, is OFED 1.3.1 sufficient or not? thanks! --- michael On Thu, Oct 28, 2010 at 12:50 PM, Lana Deere lana.de...@gmail.com wrote: Michael, I was having at least a similar symptom to the Transport endpoint is not connected message you list,

Re: [Gluster-users] rdma problems with glusterfs 3.1.0

2010-10-28 Thread Joe Landman
On 10/28/2010 01:46 PM, Michael Galloway wrote: i guess thats at least part of what my question is, is OFED 1.3.1 sufficient or not? We haven't tried it with 1.3.x OFED. 1.4.2 was the minimum we've used (in the 2.0.x days). Currently using 1.5.x for the 3.0.x gluster. Will be working

Re: [Gluster-users] rdma problems with glusterfs 3.1.0

2010-10-28 Thread Craig Carl
Michael - I would suggest OFED 1.5.1, we have seen problems with Gluster on earlier versions of OFED that have been resolved completely by 1.5.1. We have also seen problems with OFED packages on RHEL and CentOS, I would suggest you download directly from

[Gluster-users] Permission Denied when copying from one gluster 3.1 volume to another 3.1 volume

2010-10-28 Thread John Lao
Hi, I am running glusterfs 3.1 on 2 different volumes and mounted on the client as /mnt/gluster/vol1 and /mnt/gluster/vol2. When I try to copy data from vol1 to vol2 as a regular user I get a permission denied error. When I try to do the copy as root it succeeds. But, as a non-root user I

Re: [Gluster-users] Permission Denied when copying from one gluster 3.1 volume to another 3.1 volume

2010-10-28 Thread Luis
Are your perms set for the storage bricks? What about a subdirectory created as root from the gluster mount? Youll have to chmod that dir of course . John Lao j...@cloud9analytics.com wrote: Hi, I am running glusterfs 3.1 on 2 different volumes and mounted on the client as /mnt/gluster/vol1

Re: [Gluster-users] Permission Denied when copying from one gluster 3.1 volume to another 3.1 volume

2010-10-28 Thread John Lao
Yes the perms are set correctly. I blew away the directory that root created so that is not an issue. What's puzzling is I can create files in both volumes, but get permission denied when copying from one volume to another. Regards, John Lao Luis l...@luiscerezo.org wrote: Are your perms

Re: [Gluster-users] Permission Denied when copying from one gluster 3.1 volume to another 3.1 volume

2010-10-28 Thread Luis E. Cerezo
it really sounds like a perms issue to me. If the root of the all the storage bricks aren't writable by said user, a write will fail. Can you do a simple touch file1234 on the gluster volume as the non-root user? another thing to check, what is selinux set to? (getenforce) -luis On Oct 28,

Re: [Gluster-users] Permission Denied when copying from one gluster 3.1 volume to another 3.1 volume

2010-10-28 Thread John Lao
I can create files on both gluster volumes as the regular user. The problem happens when I try to copy files from one volume to another volume as the regular user. What works is if I copy data from one gluster volume to local disk, then copy the files from local disk to the other gluster

Re: [Gluster-users] Permission Denied when copying from one gluster 3.1 volume to another 3.1 volume

2010-10-28 Thread Pytec Design
Is it possible that your UID:GID do not match for said user on each server? John Lao wrote: I can create files on both gluster volumes as the regular user. The problem happens when I try to copy files from one volume to another volume as the regular user. What works is if I copy data from

Re: [Gluster-users] Permission Denied when copying from one gluster 3.1 volume to another 3.1 volume

2010-10-28 Thread John Lao
uid:gid is the same for the user on all machines. Regards, John Lao Pytec Design sa...@pytecdesign.com wrote: Is it possible that your UID:GID do not match for said user on each server? John Lao wrote: I can create files on both gluster volumes as the regular user. The problem happens

Re: [Gluster-users] Permission Denied when copying from one gluster 3.1 volume to another 3.1 volume

2010-10-28 Thread Luis E. Cerezo
how's about an strace of the copy? On Oct 28, 2010, at 6:37 PM, John Lao wrote: uid:gid is the same for the user on all machines. Regards, John Lao Pytec Design sa...@pytecdesign.com wrote: Is it possible that your UID:GID do not match for said user on each server? John

[Gluster-users] GlusterFS behavior with 2 clients

2010-10-28 Thread Matt Sorin
Hello, I recently discovered GlusterFS and followed the installation instructions and the relatively brief tutorials that describe setting up test-volume but the behavior I am seeing is odd. I have 4 machines set up to test GlusterFS: 2 servers and 2 clients. All the machines are running