Re: [smartos-discuss] hardware selection question
I have picked up an R610 with 48GB from ebay for a home lab. The onboard RAID (PERC) could be set up with each disk being a separate raid 0 array but i would suggest you pick up a different controller to get any decent performance. Hope this helps, Alex > On 7 Aug 2017, at 01:55, Steve wrote: > > Hi Lonnie, > > If you are not used to them, I tend to shy away from 1U chassis as it > means the fans have to work in tight space resulting in back to back > high RPM fans generating a lot of noise. Of course in a data center you > usually pay per U and noise is not a factor. > > More space also allows for air to move a bit easier and thus easier to > keep cool. In addition, I often remove half the fans (3 out of 6) when > it is a location where noise is more annoying. I have a script I write > which continuously monitors the CPU temperature, RPM on fans and disk > integrity. If all is OK I get a daily message. If the temp starts to go > high I send myself a warning, and if it goes too high it does a poweroff > after sending an email. > > -- > Steve > --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
RE: [smartos-discuss] hardware selection question
If you want to test / play or use Project FiFo you need at least E-xxx Xeon processors since FiFo needs the special embedded encryption instruction (AVX?) set. I always order the idrac advanced or the HP Ilo professional license. It happened twice in my life that I lost contact with the global zone because of a faulty configuration whilst playing with settings. And the dancing of my shacking hands above the keyboard is the last feeling I ever want to feel again. With remote server management like iDrac or Ilo you always have a backup door to your server. ( it was the main reason that I used Sun servers for 7 years, since they were the only servers in the market with "free" remote server licences and a dedicated management NIC. ) I have 2 HP DL380G7 servers with 72 GB RAM and 2x L5640 running in a data center, they are comparable with the R710's, average load is 7% with 30 VM's running on it. I need more VM's but RAM is limiting my plans. The RAM banks are all filled so I have to switch to 8 or 16GB RAM modules. The total price for renewing the RAM is almost as high as buying a used HP G8 series server, so I still not sure what to do. So my opinion: 1. Buy a server that has remote server management capabilities (iDRAC or Ilo or comparable) Don't think that the basic idrac/ilo can save your life, because they only let you see the console screen until the server has fully booted. After that they turn the screen black. 2. buy as much RAM as you can afford 3. never use only 2 HD's this is really a poor man's solution 4. with HP or DELL RAID controllers you must set all drives to RAID 0 single drive. There is no JBOD option available but with RAID 0 all drives will be discovered and usable by ZFS -Oorspronkelijk bericht- Van: Richard Elling [mailto:richard.ell...@richardelling.com] Verzonden: maandag 7 augustus 2017 01:07 Aan: smartos-discuss@lists.smartos.org Onderwerp: Re: [smartos-discuss] hardware selection question > On Aug 6, 2017, at 4:01 PM, Steve wrote: > > I saw a Supermicro with 60 drives in a 4U chassis! They max out at 90 > I believe. We use 60 SAS 2.5" drives in 2u chassis with dual, 2-socket + 2 12G SAS HBA controllers. Next week we'll have them on the exhibit floor at Flash Memory Summit in San Jose, CA, visit the Newisys booth. -- richard --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] hardware selection question
> On Aug 6, 2017, at 4:01 PM, Steve wrote: > > I saw a Supermicro with 60 drives in a 4U chassis! They max out at 90 I > believe. We use 60 SAS 2.5" drives in 2u chassis with dual, 2-socket + 2 12G SAS HBA controllers. Next week we'll have them on the exhibit floor at Flash Memory Summit in San Jose, CA, visit the Newisys booth. -- richard --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] hardware selection question
I saw a Supermicro with 60 drives in a 4U chassis! They max out at 90 I believe. The amount of money saved by using ZFS, and not RAID controllers, must be quite noticeable. -- Steve --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] hardware selection question
On 08/06/2017 18:44, Lonnie Cumberland wrote: > Actually just came across a: > > Dell PowerEdge C6220 SFF 4 Node Server 8x Xeon E5-2650 256GB RAM 16x > Caddy RAILS > > for about $2,000 but would have to see if it meets the remaining > requirements. I'd really rather not pay that much to get started, though. Sweet system - 64 threads! -- Steve --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] hardware selection question
Hi Lonnie, If you are not used to them, I tend to shy away from 1U chassis as it means the fans have to work in tight space resulting in back to back high RPM fans generating a lot of noise. Of course in a data center you usually pay per U and noise is not a factor. More space also allows for air to move a bit easier and thus easier to keep cool. In addition, I often remove half the fans (3 out of 6) when it is a location where noise is more annoying. I have a script I write which continuously monitors the CPU temperature, RPM on fans and disk integrity. If all is OK I get a daily message. If the temp starts to go high I send myself a warning, and if it goes too high it does a poweroff after sending an email. -- Steve --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] hardware selection question
Actually just came across a: Dell PowerEdge C6220 SFF 4 Node Server 8x Xeon E5-2650 256GB RAM 16x Caddy RAILS for about $2,000 but would have to see if it meets the remaining requirements. I'd really rather not pay that much to get started, though. Cheers, Lonnie On Sun, Aug 6, 2017 at 6:38 PM, Steve wrote: > On 08/06/2017 17:46, Lonnie Cumberland wrote: > > Greetings All, > > > > I am trying to figure out some nice hardware to get started with Triton > > and some nodes and am thinking about getting 4 of these: > > I buy generation 9 (9X) used servers from Supermicro. Out of warranty > they go for as little as $500 for dual 8 core CPUs and 49G RAM. > - - > Eh, 48G of course. You also want ECC RAM. ZFS really needs reliable RAM. > > -- > Steve > --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] hardware selection question
On 08/06/2017 17:46, Lonnie Cumberland wrote: > Greetings All, > > I am trying to figure out some nice hardware to get started with Triton > and some nodes and am thinking about getting 4 of these: I buy generation 9 (9X) used servers from Supermicro. Out of warranty they go for as little as $500 for dual 8 core CPUs and 49G RAM. - - - Eh, 48G of course. You also want ECC RAM. ZFS really needs reliable RAM. -- Steve --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] hardware selection question
Thanks Steve, Currently, the R710's that I had been looking at, I was actually remembering not to have a raid controller since I seem to remember coming across that in my reading on Triton Data Center somewhere and sent the retailer a message asking if it had Intel VT-x and EPT support. I actually came across the 710's on eBay and was just investigating a bit more on them to get a feel. I'll try to find these 9X systems that you are talking about and have a look see before I make a purchase. Cheers, Lonnie On Sun, Aug 6, 2017 at 6:28 PM, Steve wrote: > On 08/06/2017 17:46, Lonnie Cumberland wrote: > > Greetings All, > > > > I am trying to figure out some nice hardware to get started with Triton > > and some nodes and am thinking about getting 4 of these: > > I buy generation 9 (9X) used servers from Supermicro. Out of warranty > they go for as little as $500 for dual 8 core CPUs and 49G RAM. > > Look online for sales. When you are using ZFS you don't want a disk > controller that gets in the way to be helpful as that will degrade ZFS > meaning you don't need (or want) a RAID controller. I use the controller > built-in on the M/B. It must allow ZFS to reach the drives directly, it > seems most RAID controllers do not actually allow that. > > When looking at the CPU(s) make sure they support the two virtualization > technologies. https://ark.intel.com/#@Processors > > -- > Steve > --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] hardware selection question
On 08/06/2017 17:46, Lonnie Cumberland wrote: > Greetings All, > > I am trying to figure out some nice hardware to get started with Triton > and some nodes and am thinking about getting 4 of these: I buy generation 9 (9X) used servers from Supermicro. Out of warranty they go for as little as $500 for dual 8 core CPUs and 49G RAM. Look online for sales. When you are using ZFS you don't want a disk controller that gets in the way to be helpful as that will degrade ZFS meaning you don't need (or want) a RAID controller. I use the controller built-in on the M/B. It must allow ZFS to reach the drives directly, it seems most RAID controllers do not actually allow that. When looking at the CPU(s) make sure they support the two virtualization technologies. https://ark.intel.com/#@Processors -- Steve --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com