You also have to be careful with network utilization… we have some very hungry NFS clients in our environment and the NFS traffic can actually DOS other services that need to use the network links. If you configure GPFS admin/daemon traffic over the same link as the SMB/NFS traffic then this could lead to GPFS node evictions if disk leases cannot get renewed. You could limit the amount that SMV/NFS use on the network with something like the tc facility if you’re sharing the network interfaces for GPFS and CES services.
HTH, -Bryan From: [email protected] [mailto:[email protected]] On Behalf Of Sven Oehme Sent: Friday, May 04, 2018 11:27 AM To: gpfsug main discussion list <[email protected]> Subject: Re: [gpfsug-discuss] Not recommended, but why not? Note: External Email ________________________________ there is nothing wrong with running CES on NSD Servers, in fact if all CES nodes have access to all LUN's of the filesystem thats the fastest possible configuration as you eliminate 1 network hop. the challenge is always to do the proper sizing, so you don't run out of CPU and memory on the nodes as you overlay functions. as long as you have good monitoring in place you are good. if you want to do the extra precaution, you could 'jail' the SMB and NFS daemons into a c-group on the node, i probably wouldn't limit memory but CPU as this is the more critical resource to prevent expels and other time sensitive issues. sven On Fri, May 4, 2018 at 8:39 AM Buterbaugh, Kevin L <[email protected]<mailto:[email protected]>> wrote: Hi All, In doing some research, I have come across numerous places (IBM docs, DeveloperWorks posts, etc.) where it is stated that it is not recommended to run CES on NSD servers … but I’ve not found any detailed explanation of why not. I understand that CES, especially if you enable SMB, can be a resource hog. But if I size the servers appropriately … say, late model boxes with 2 x 8 core CPU’s, 256 GB RAM, 10 GbE networking … is there any reason why I still should not combine the two? To answer the question of why I would want to … simple, server licenses. Thanks… Kevin — Kevin Buterbaugh - Senior System Administrator Vanderbilt University - Advanced Computing Center for Research and Education [email protected]<mailto:[email protected]> - (615)875-9633<tel:(615)%20875-9633> _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org<http://spectrumscale.org> http://gpfsug.org/mailman/listinfo/gpfsug-discuss ________________________________ Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial product.
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
