[Lustre-discuss] Unable to write to the Lustre File System as any user except root
I have a File Server set up running Lustre 2.1. I have one MDS and 3 OSS with Infiniband interconnect. The MDS and 3 OSS mount fine and I am able to mount a client. If I perform any basic operation (such as ll, cp, mv, etc.) as root, it appears to work. However, when I run as any other user, I get the following error in my syslog: LustreError: 11-0: an error occurred while communicating with 192.168.10.2@o2ibmailto:192.168.10.2@o2ib. The mds_getxattr operation failed with -13. It tells me that I don't have permission to read from or write to the file system. Why am I seeing this? Thank you, Carl ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
[Lustre-discuss] MDS network traffic question
We have a small lustre install consisting of an MDS and 5 OSS servers. Historically the MDS and OSS servers had both a 1Gbit ethernet interface (tcp0) to workstations and a QDR IB interface (ib0) to our cluster. We're planning on adding a MTU 9000 10Gbit ethernet (tcp1) interface to the MDS and OSS nodes and workstations for faster access. Our software has a pretty high IO to CPU component. I just discovered that our MDS can't in fact take another PCIe 8x card but it does have a spare GigE port. The 10gbit Ethernet switch can support 1gbit and 10gbit interfaces. We'd then have 3 networks tcp0 at 1gbit to slow clients tcp1 at 10gbit to faster clients ib0 to cluster My question is: Is there a risk of congestion or overrunning that 2nd GigE MDS interface if our workstations and OSS servers communicate over tcp1 at 10gbit but the MDS tcp1 is connected at 1Gbit. The bulk of our traffic will continue to be between the cluster and lustre over IB but the workstations can trivially over run ethernet hence the desire for 10gbit between them and the OSSes. My gut feeling is it should be fine, particularly with the larger MTU, there's not that much traffic to the MDS but I'd easily believe it if somebody said it's risky thing to do. The alternative is to buy a new MDS and swap disks into it. James Robnett National Radio Astronomy Observatory Array Operations Center ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss
