Re: [CentOS] NFS performance on CentOS 7
On May 9, 2015, at 2:34 PM, Michael Eager ea...@eagerm.com wrote: I am setting up a file server with CentOS 7. I'm seeing performance which is considerably slower than a similar server running CentOS 6.6. A 3Gb directory can be copied to/from the CentOS 6.6 server in about 50 seconds. The same directory takes about 270 seconds to copy to/from the CentOS 7 system. I see the same performance difference with NFS mounted file systems or using scp, so it doesn't appear to be an NFS issue. The MTU on the NICs on both systems is 1500, and changing it to 6000 on the CentOS 7 system had no effect. Anyone have any ideas what might cause this problem or how to fix it? 3GB/50seconds = 480Mbps Can't speak directly to centos6/7 differences nor NFS on centos6/7 I've seen NFS(netapp filer to vmware host to windows VM) sustain 1Mbps. So the NFS protocol itself isn't the bottleneck given sufficient hardware. Since scp performs similar to NFS the on the wire protocol isn't the problem. Verify the MTU setting: ping a.b.c.d -M do -s 8972 Or in your case: ping a.b.c.d -M do -s 5972 (6000 is a very odd MTU) I'd start by getting the latest/validated driver from $NICVendor. What IO throughput does the local file system give? Test with hdparm / dd / iometer / sqlio / cp -a /path /dev/null Test sever to server with iperf as others suggested. Hope that points you in the right direction. Steven Tardy ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] NFS performance on CentOS 7
On 09-05-2015 15:34, Michael Eager wrote: I am setting up a file server with CentOS 7. I'm seeing performance which is considerably slower than a similar server running CentOS 6.6. A 3Gb directory can be copied to/from the CentOS 6.6 server in about 50 seconds. The same directory takes about 270 seconds to copy to/from the CentOS 7 system. I see the same performance difference with NFS mounted file systems or using scp, so it doesn't appear to be an NFS issue. The MTU on the NICs on both systems is 1500, and changing it to 6000 on the CentOS 7 system had no effect. Anyone have any ideas what might cause this problem or how to fix it? You may test only your network performance, using iperf, iperf3 or netperf, and then test your disk IO (others may indicate tools for this). Currently you are measuring two big subsystems which can have its down issues and/or affect each other. By splitting the test you may get a better picture of what is better/worse. If you can sustain near line rate on iperf, the issue is probably somewhere else then. Marcelo ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] NFS performance on CentOS 7
On Sat, 9 May 2015, Michael Eager wrote: I am setting up a file server with CentOS 7. I'm seeing performance which is considerably slower than a similar server running CentOS 6.6. A 3Gb directory can be copied to/from the CentOS 6.6 server in about 50 seconds. The same directory takes about 270 seconds to copy to/from the CentOS 7 system. I see the same performance difference with NFS mounted file systems or using scp, so it doesn't appear to be an NFS issue. The MTU on the NICs on both systems is 1500, and changing it to 6000 on the CentOS 7 system had no effect. Anyone have any ideas what might cause this problem or how to fix it? My first guess would be that stat() operations are the bottleneck. Are you using network authentication of some kind? If so, I'd try to identify differences in the authentication cache. For instance, CentOS 6 may be using nslcd or nscd, while CentOS 7 is using sssd or nslcd. Repeated UID/GID lookups absent effective cacheing will slow things down as you describe. -- Paul Heinlein heinl...@madboa.com http://www.madboa.com/ ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
Re: [CentOS] NFS performance on CentOS 7
- Original Message - | I am setting up a file server with CentOS 7. I'm seeing | performance which is considerably slower than a similar | server running CentOS 6.6. A 3Gb directory can be copied | to/from the CentOS 6.6 server in about 50 seconds. The | same directory takes about 270 seconds to copy to/from | the CentOS 7 system. | | I see the same performance difference with NFS mounted | file systems or using scp, so it doesn't appear to be | an NFS issue. The MTU on the NICs on both systems is | 1500, and changing it to 6000 on the CentOS 7 system had | no effect. | | Anyone have any ideas what might cause this problem or | how to fix it? | | -- | Michael Eager ea...@eagercon.com | 1960 Park Blvd., Palo Alto, CA 94306 650-325-8077 Do you have IPTables or FirewallD turned on? Are you using NFSv3 or NFSv4? Are these machines on the same switch? Any errors seen in `netstat -i` output? There could be lots of reasons for this problem from cabling to switch/host misconfiguration. -- James A. Peltier IT Services - Research Computing Group Simon Fraser University - Burnaby Campus Phone : 604-365-6432 Fax : 778-782-3045 E-Mail : jpelt...@sfu.ca Website : http://www.sfu.ca/itservices Twitter : @sfu_rcg Powering Engagement Through Technology ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
[CentOS] NFS performance on CentOS 7
I am setting up a file server with CentOS 7. I'm seeing performance which is considerably slower than a similar server running CentOS 6.6. A 3Gb directory can be copied to/from the CentOS 6.6 server in about 50 seconds. The same directory takes about 270 seconds to copy to/from the CentOS 7 system. I see the same performance difference with NFS mounted file systems or using scp, so it doesn't appear to be an NFS issue. The MTU on the NICs on both systems is 1500, and changing it to 6000 on the CentOS 7 system had no effect. Anyone have any ideas what might cause this problem or how to fix it? -- Michael Eagerea...@eagercon.com 1960 Park Blvd., Palo Alto, CA 94306 650-325-8077 ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
