Re: [smartos-discuss] hardware selection question

2017-08-07 Thread Alex Kritikos 
I have picked up an R610 with 48GB from ebay for a home lab. The onboard RAID 
(PERC) could be set up with each disk being a separate raid 0 array but i would 
suggest you pick up a different controller to get any decent performance. 

Hope this helps,

Alex

> On 7 Aug 2017, at 01:55, Steve  wrote:
> 
> Hi Lonnie,
> 
> If you are not used to them, I tend to shy away from 1U chassis as it
> means the fans have to work in tight space resulting in back to back
> high RPM fans generating a lot of noise. Of course in a data center you
> usually pay per U and noise is not a factor.
> 
> More space also allows for air to move a bit easier and thus easier to
> keep cool. In addition, I often remove half the fans (3 out of 6) when
> it is a location where noise is more annoying. I have a script I write
> which continuously monitors the CPU temperature, RPM on fans and disk
> integrity. If all is OK I get a daily message. If the temp starts to go
> high I send myself a warning, and if it goes too high it does a poweroff
> after sending an email.
> 
> --
> Steve
> 


---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

RE: [smartos-discuss] hardware selection question

2017-08-06 Thread the outsider 
If you want to test / play or use Project FiFo you need at least E-xxx Xeon
processors since FiFo needs the special embedded encryption instruction
(AVX?) set. 
I always order the idrac advanced or the HP Ilo professional license. It
happened twice in my life that I lost contact with the global zone because
of a faulty configuration whilst playing with settings.
And the dancing of my shacking hands above the keyboard is the last feeling
I ever want to feel again. With remote server management like iDrac or Ilo
you always have a backup door to your server. 
( it was the main reason that I used Sun servers for 7 years, since they
were the only servers in the market with "free" remote server licences and a
dedicated management NIC. ) 

I have 2 HP DL380G7 servers with 72 GB RAM and 2x L5640 running in a data
center, they are comparable with the R710's, average load is 7% with 30 VM's
running on it. I need more VM's but RAM is limiting my plans. The RAM banks
are all filled so I have to switch to 8 or 16GB RAM modules. The total price
for renewing the RAM is almost as high as buying a used HP G8 series server,
so I still not sure what to do.

So my opinion:
1. Buy a server that has remote server management capabilities (iDRAC or Ilo
or comparable) 
Don't think that the basic idrac/ilo can save your life, because
they only let you see the console screen until the server has fully booted.
After that they turn the screen black.
2. buy as much RAM as you can afford
3. never use only 2 HD's this is really a poor man's solution
4. with HP or DELL RAID controllers you must set all drives to RAID 0 single
drive. There is no JBOD option available but with RAID 0 all drives will be
discovered and usable by ZFS


-Oorspronkelijk bericht-
Van: Richard Elling [mailto:richard.ell...@richardelling.com] 
Verzonden: maandag 7 augustus 2017 01:07
Aan: smartos-discuss@lists.smartos.org
Onderwerp: Re: [smartos-discuss] hardware selection question


> On Aug 6, 2017, at 4:01 PM, Steve <smar...@szmidt.org> wrote:
> 
> I saw a Supermicro with 60 drives in a 4U chassis! They max out at 90 
> I believe.
 
 
 We use 60 SAS 2.5" drives in 2u chassis with dual, 2-socket + 2 12G SAS HBA
 controllers.
 Next week we'll have them on the exhibit floor at Flash Memory Summit in San
 Jose, CA, visit the Newisys booth.
  -- richard
 


---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] hardware selection question

2017-08-06 Thread Richard Elling 

> On Aug 6, 2017, at 4:01 PM, Steve  wrote:
> 
> I saw a Supermicro with 60 drives in a 4U chassis! They max out at 90 I
> believe.


We use 60 SAS 2.5" drives in 2u chassis with dual, 2-socket + 2 12G SAS HBA 
controllers.
Next week we'll have them on the exhibit floor at Flash Memory Summit in San 
Jose, CA,
visit the Newisys booth.
 -- richard



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] hardware selection question

2017-08-06 Thread Steve 
I saw a Supermicro with 60 drives in a 4U chassis! They max out at 90 I
believe.

The amount of money saved by using ZFS, and not RAID controllers, must
be quite noticeable.

-- 
Steve


---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] hardware selection question

2017-08-06 Thread Steve 
On 08/06/2017 18:44, Lonnie Cumberland wrote:
> Actually just came across a:
> 
> Dell PowerEdge C6220 SFF 4 Node Server 8x Xeon E5-2650 256GB RAM 16x
> Caddy RAILS
> 
> for about $2,000 but would have to see if it meets the remaining
> requirements. I'd really rather not pay that much to get started, though.

Sweet system - 64 threads!

-- 
Steve


---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] hardware selection question

2017-08-06 Thread Lonnie Cumberland 
Actually just came across a:

Dell PowerEdge C6220 SFF 4 Node Server 8x Xeon E5-2650 256GB RAM 16x Caddy
RAILS

for about $2,000 but would have to see if it meets the remaining
requirements. I'd really rather not pay that much to get started, though.

Cheers,
Lonnie


On Sun, Aug 6, 2017 at 6:38 PM, Steve  wrote:

> On 08/06/2017 17:46, Lonnie Cumberland wrote:
> > Greetings All,
> >
> > I am trying to figure out some nice hardware to get started with Triton
> > and some nodes and am thinking about getting 4 of these:
> 
> I buy generation 9 (9X) used servers from Supermicro. Out of warranty
> they go for as little as $500 for dual 8 core CPUs and 49G RAM.
>   - -
> Eh, 48G of course. You also want ECC RAM. ZFS really needs reliable RAM.
> 
> --
> Steve
> 



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] hardware selection question

2017-08-06 Thread Steve 
On 08/06/2017 17:46, Lonnie Cumberland wrote:
> Greetings All,
> 
> I am trying to figure out some nice hardware to get started with Triton
> and some nodes and am thinking about getting 4 of these:

I buy generation 9 (9X) used servers from Supermicro. Out of warranty
they go for as little as $500 for dual 8 core CPUs and 49G RAM.
- - -
Eh, 48G of course. You also want ECC RAM. ZFS really needs reliable RAM.

-- 
Steve


---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] hardware selection question

2017-08-06 Thread Lonnie Cumberland 
Thanks Steve,

Currently, the R710's that I had been looking at, I was actually
remembering not to have a raid controller since I seem to remember coming
across that in my reading on Triton Data Center somewhere and sent the
retailer a message asking if it had  Intel VT-x and EPT support.  I
actually came across the 710's on eBay and was just investigating a bit
more on them to get a feel.

I'll try to find these 9X systems that you are talking about and have a
look see before I make a purchase.

Cheers,
Lonnie


On Sun, Aug 6, 2017 at 6:28 PM, Steve  wrote:

> On 08/06/2017 17:46, Lonnie Cumberland wrote:
> > Greetings All,
> >
> > I am trying to figure out some nice hardware to get started with Triton
> > and some nodes and am thinking about getting 4 of these:
> 
> I buy generation 9 (9X) used servers from Supermicro. Out of warranty
> they go for as little as $500 for dual 8 core CPUs and 49G RAM.
> 
> Look online for sales. When you are using ZFS you don't want a disk
> controller that gets in the way to be helpful as that will degrade ZFS
> meaning you don't need (or want) a RAID controller. I use the controller
> built-in on the M/B. It must allow ZFS to reach the drives directly, it
> seems most RAID controllers do not actually allow that.
> 
> When looking at the CPU(s) make sure they support the two virtualization
> technologies. https://ark.intel.com/#@Processors
> 
> --
> Steve
> 



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

Re: [smartos-discuss] hardware selection question

2017-08-06 Thread Steve 
On 08/06/2017 17:46, Lonnie Cumberland wrote:
> Greetings All,
> 
> I am trying to figure out some nice hardware to get started with Triton
> and some nodes and am thinking about getting 4 of these:

I buy generation 9 (9X) used servers from Supermicro. Out of warranty
they go for as little as $500 for dual 8 core CPUs and 49G RAM.

Look online for sales. When you are using ZFS you don't want a disk
controller that gets in the way to be helpful as that will degrade ZFS
meaning you don't need (or want) a RAID controller. I use the controller
built-in on the M/B. It must allow ZFS to reach the drives directly, it
seems most RAID controllers do not actually allow that.

When looking at the CPU(s) make sure they support the two virtualization
technologies. https://ark.intel.com/#@Processors

-- 
Steve


---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com

[smartos-discuss] hardware selection question

2017-08-06 Thread Lonnie Cumberland 
Greetings All,

I am trying to figure out some nice hardware to get started with Triton and
some nodes and am thinking about getting 4 of these:

Dell PowerEdge R710 8-Core 2.5" Server 32GB RAM PERC6i iDRAC6 + 2 Trays

Actually, one of them will have 64Gb RAM for the HN.

Of course there are much more powerful systems like:

DELL POWEREDGE 4-NODE C6220 SFF 8x E5-2660 256GB

but they also are going for about $2000 and I wanted some nice, but still
powerful systems to get started.

I  was wondering what the community thought of these as basic intro systems?

Thanks,
Lonnie



---
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com