We replaced two FS900 flash units with 8x8Gb FC on each unit with commodity Dell sever with two ESS3200 using 2x100GbE on each unit/controller and our metadata is 40% faster with 1.8 billion files in the file system. So it pays to upgrade the speed to as fast as you can afford.
Best Regards, Larry Henson IT Engineering Storage Team Office (832) 750-1403 Cell (713) 702-4896 [cid:[email protected]] From: gpfsug-discuss <[email protected]> On Behalf Of Alec Sent: Monday, June 5, 2023 11:41 AM To: gpfsug main discussion list <[email protected]> Subject: [EXTERNAL] Re: [gpfsug-discuss] Connecting IBM ESS 3200 to 10 Gb Ethernet THIS EMAIL IS A PHISHING RISK Do you trust the sender? The email address is: [email protected]<mailto:[email protected]> While this email has passed our filters, we need you to review with caution before taking any action. If the email looks at all suspicious, click the Report a Phish button. Many network storage engineers simply don't understand bandwidth (or the importance of port groups)... With an ESS you are talking GIGA*BYTES* per second and storage and networking architects simply see 10Gbe and assume that's good enough. A 10Gbe connection can do about 1.4GB/s.. 100Gbe can do 12.5GB/s. To the wrong engineer you can explain this until you're blue in the face and they won't get it. You need to divide Gbe by 8 to get about the GB/s throughput. Explain to them that a USB-C interface is capable of 10Gbe... So you're throttling millions of dollars in technology to the speed of a consumer grade USB-C interface. When infact an ESS can drive at least 2x100Gbe to saturation. I don't have an ESS but a classic SAN array and Spectrum Scale and I can saturate 32*8Gbe fiber connections. Alec On Mon, Jun 5, 2023, 8:56 AM Andrew Beattie <[email protected]<mailto:[email protected]>> wrote: Prasad, You would be better off looking at the following: https://www.nvidia.com/en-au/networking/ethernet/cable-accessories/<https://urldefense.com/v3/__https:/www.nvidia.com/en-au/networking/ethernet/cable-accessories/__;!!PfbeBCCAmug!jmAmqSobWPpE5V4hUEfLxp6yNbcYtZu-9x66128owzvoc1eWOR5z8L4aNjBhpLRuFKNjMzpQ-ggSmAeUZQ$> This will allow you to adapt from the QSFP+ 100GB transceiver down to a SFP+ 10GB transceiver and then use standard OM4 cable and Cisco 10GB transceivers at the other end. However I will also comment that using 10GB network for an all flash ESS is a bit like buying an F1 racing car and never taking it out of first gear. You would honestly be better investing in a single 100GB switch to at least build the ESS cluster at 100Gbit and getting the full potential bandwidth from your investment in NVMe Otherwise buy a FS5200 + 2 x86 servers and some scale licensing, because you are down rating the ESS3200 to less than 25% of its potential performance Regards, Andrew Beattie Technical Sales Specialist - Storage for Big Data & AI IBM Australia and New Zealand P. +61 421 337 927 E. [email protected]<mailto:[email protected]> Twitter: AndrewJBeattie LinkedIn: ________________________________ From: gpfsug-discuss <[email protected]<mailto:[email protected]>> on behalf of Prasad Surampudi <[email protected]<mailto:[email protected]>> Sent: Monday, June 5, 2023 11:24:01 PM To: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> Subject: [EXTERNAL] [gpfsug-discuss] Connecting IBM ESS 3200 to 10 Gb Ethernet Does anyone know if we can connect IBM ESS 3200 to a customer 10 Gb ethernet network? If so what cables we need to connect it to a Cisco C93180YC-EX switch? Does it support 100 Gb to 4x10 GB fanout connections? Prasad Surampudi | Sr. Systems ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Does anyone know if we can connect IBM ESS 3200 to a customer 10 Gb ethernet network? If so what cables we need to connect it to a Cisco C93180YC-EX switch? Does it support 100 Gb to 4x10 GB fanout connections? Prasad Surampudi | Sr. Systems Enginee prasad.surampudi@theatsgr<mailto:[email protected]>oup.com<mailto:[email protected]> | 302.419.5833 Innovative IT consulting & modern infrastructure solutions www.theatsgroup.com<https://urldefense.com/v3/__http:/theatsgroup.com__;!!PfbeBCCAmug!jmAmqSobWPpE5V4hUEfLxp6yNbcYtZu-9x66128owzvoc1eWOR5z8L4aNjBhpLRuFKNjMzpQ-giHl4qp_w$> _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org<https://urldefense.com/v3/__http:/gpfsug.org__;!!PfbeBCCAmug!jmAmqSobWPpE5V4hUEfLxp6yNbcYtZu-9x66128owzvoc1eWOR5z8L4aNjBhpLRuFKNjMzpQ-gjmhCxIGA$> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org<https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!PfbeBCCAmug!jmAmqSobWPpE5V4hUEfLxp6yNbcYtZu-9x66128owzvoc1eWOR5z8L4aNjBhpLRuFKNjMzpQ-gjlkfhRRQ$> The information contained in this e-mail message may be privileged, confidential, and/or protected from disclosure. This e-mail message may contain protected health information (PHI); dissemination of PHI should comply with applicable federal and state laws. If you are not the intended recipient, or an authorized representative of the intended recipient, any further review, disclosure, use, dissemination, distribution, or copying of this message or any attachment (or the information contained therein) is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender by return e-mail and delete all references to it and its contents from your systems.
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org
