Folks
I have a few more questions on 10GB Ethernet for Roach 2. Can we buy a 10GB Adapter (SFP+) for a pc then connect directly to the Roach? Or do we need to buy a switch as well? Solar Flare sells these 10GBE SFP+ adapters called "server adapters." I am using a regular Linux workstation, not a server. Are there any issues with servers vs workstations in terms of drivers etc? Would Solarflare Flareon SFN7002F work? It is a $300 adapter for SFP+. One of the cheaper ones. Not sure what the difference between the $1000 vs $300 10GBE adapters. Sorry for the dumb questions. Tim ________________________________________ From: [email protected] [[email protected]] on behalf of [email protected] [[email protected]] Sent: Tuesday, February 03, 2015 2:16 PM To: [email protected] Subject: casper Digest, Vol 87, Issue 2 Send casper mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit https://calmail.berkeley.edu/manage/list/listinfo/[email protected] or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of casper digest..." Today's Topics: 1. Roach 2 GB Ethernet Basic Questions (Madden, Timothy J.) 2. Re: Roach 2 GB Ethernet Basic Questions (John Ford) 3. Re: Roach 2 GB Ethernet Basic Questions (Dan Werthimer) ---------------------------------------------------------------------- Message: 1 Date: Mon, 2 Feb 2015 21:46:48 +0000 From: "Madden, Timothy J." <[email protected]> Subject: [casper] Roach 2 GB Ethernet Basic Questions To: "[email protected]" <[email protected]> Message-ID: <[email protected]> Content-Type: text/plain; charset="iso-8859-1" Sorry in advance for dumb questions. I have been using Roach 1 for a few ye ars and like it. Now we have a Roach 2. I want to get the 10GB ethernet working. A few questions: What should I buy to plug into those holes on the back, where the mezzanine slots are? Can I use a fiber optic widget to plug in? Or do we have to use copper? Can we use Long fiber or the short fiber version of 10GB ethernet? Are there part numbers of what I should buy to stick into the back of the Roach 2 to allow 10GB Ethernet connection? What should I buy to plug into the linux box. I assume some fiber optic 10GB PCI -Express card but not sure. I am running Red Hat Linux. Any name brands and part numbers? Where do I get the latest libraries to download for roach 2. I did not attend the last Casper conference so I am not "hip" to the location. Thanks Tim Madden Argonne Lab -------------- next part -------------- An HTML attachment scrubbed and removed. HTML attachments are only available in MIME digests. ------------------------------ Message: 2 Date: Mon, 2 Feb 2015 17:21:28 -0500 From: "John Ford" <[email protected]> Subject: Re: [casper] Roach 2 GB Ethernet Basic Questions To: "Madden, Timothy J." <[email protected]> Cc: "[email protected]" <[email protected]> Message-ID: <[email protected]> Content-Type: text/plain;charset=iso-8859-1 > Sorry in advance for dumb questions. I have been using Roach 1 for a > few ye ars and like it. Now we have a Roach 2. I want to get the 10GB > ethernet working. > > A few questions: > What should I buy to plug into those holes on the back, where the > mezzanine > slots are? > Can I use a fiber optic widget to plug in? Or do we have to use > copper? Can > we use Long fiber or the short > fiber version of 10GB ethernet? Are there part numbers of what I > should buy > to stick into the back of the Roach 2 to allow 10GB Ethernet > connection? There are daughter cards for SFP+ connectors for the ROACH2 These allow either copper or fiber. You can get transcievers for either single mode or multi-mode, or copper cables with the cables and connectors all made up. Google around for sfp+ and you will find lots of possibilities. The daughter cards each contain 4 SFP+ connectors. The card for the PC is likewise SFP+ enabled. We use mellanox, solar flare, and Myricom NICs with good luck on Red Hat. Likewise new switches are SFP+ enabled. I wouldn't fool around with cx-4 connectors unless you have a boatload of old stuff you have to try to use. John > What should I buy to plug into the linux box. I assume some fiber > optic 10GB > PCI -Express card but not sure. > I am running Red Hat Linux. Any name brands and part numbers? > Where do I get the latest libraries to download for roach 2. I did not > attend > the last Casper conference so I am not "hip" to the location. > > Thanks > Tim Madden > Argonne Lab > > > ------------------------------ Message: 3 Date: Mon, 2 Feb 2015 19:59:40 -0800 From: Dan Werthimer <[email protected]> Subject: Re: [casper] Roach 2 GB Ethernet Basic Questions To: "Madden, Timothy J." <[email protected]> Cc: "[email protected]" <[email protected]> Message-ID: <caghs_vgg92ab4t5wnbe4umzejx6ow6cy9ttpfkbydi97zmh...@mail.gmail.com> Content-Type: text/plain; charset="utf-8" hi tim, there are two possible 10Gbe mezzanine cards for roach2: CX4: 3xCX4 connectors - CX4 is old and hard to find NIC's, cables and switches. SFP+: 4xSFP+ connectors - SFP+ is the new standard for 10Gbe, and much more reliable, you can purchase all kinds of copper and optical SFP+ cables, for up to 80 km links (see for instance SFP+ transceivers at fiberstore.com) SFP+ copper cables are available up to 10 meters. i think active copper cables are available up to about 50 meters. and there are tons of SFP+ switches and NIC's. for CX4, it's still possible to purchase, but mostly as used stuff on ebay. as john said, unless you have a bunch of old CX4 equipment, it's better to use the SFP+ mezzanine board. best wishes, dan On Mon, Feb 2, 2015 at 1:46 PM, Madden, Timothy J. <[email protected]> wrote: > Sorry in advance for dumb questions. I have been using Roach 1 for a > few ye ars and like it. Now we have a Roach 2. I want to get the 10GB > ethernet working. > > A few questions: > What should I buy to plug into those holes on the back, where the > mezzanine > slots are? > Can I use a fiber optic widget to plug in? Or do we have to use > copper? Can > we use Long fiber or the short > fiber version of 10GB ethernet? Are there part numbers of what I > should buy > to stick into the back of the Roach 2 to allow 10GB Ethernet > connection? > What should I buy to plug into the linux box. I assume some fiber > optic 10GB > PCI -Express card but not sure. > I am running Red Hat Linux. Any name brands and part numbers? > Where do I get the latest libraries to download for roach 2. I did not > attend > the last Casper conference so I am not "hip" to the location. > > Thanks > Tim Madden > Argonne Lab > > > -------------- next part -------------- An HTML attachment scrubbed and removed. HTML attachments are only available in MIME digests. End of casper Digest, Vol 87, Issue 2 *************************************
