Re: [OmniOS-discuss] All SSD pool advice
Thanks everyone. Regarding the expanders, our 4U servers are on the following chassis: http://www.supermicro.com/products/chassis/4U/846/SC846E16-R1200.cfm We are using all SAS disks, except for the SSDs. How big is the risk here when it comes to SAS - SATA conversion? Our newer servers have direct connections on each lane to the disk. Chris Chris Nagele Co-founder, Wildbit Beanstalk, Postmark, dploy.io On Sat, Apr 4, 2015 at 7:18 PM, Doug Hughes d...@will.to wrote: We have a couple of machines with all SSD pool (~6-10 Samsung 850 pro is the current favorite). They work great for IOPS. Here's my take. 1) you don't need a dedicated zil. Just let the zpool intersperse it amongst the existing zpool devices. They are plenty fast enough. 2) you don't need an L2arc for the same reason. a smaller number of dedicated devices would likely cause more of a bottleneck than serving off the existing pool devices (unless you were to put it on one of those giant RDRAM things or similar, but that adds a lot of expense) On 4/4/2015 3:07 PM, Chris Nagele wrote: We've been running a few 4U Supermicro servers using ZeusRAM for zil and SSDs for L2. The main disks are regular 1TB SAS. I'm considering moving to all SSD since the pricing has dropped so much. What things should I know or do when moving to all SSD pools? I'm assuming I don't need L2 and that I should keep the ZeusRAM. Should I only use certain types of SSDs? Thanks, Chris -- Chris Nagele Co-founder, Wildbit Beanstalk, Postmark, dploy.io ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] All SSD pool advice
On Mon, Apr 6, 2015 at 8:41 AM, Chris Nagele nag...@wildbit.com wrote:
Thanks everyone. Regarding the expanders, our 4U servers are on the
following chassis:
http://www.supermicro.com/products/chassis/4U/846/SC846E16-R1200.cfm
We are using all SAS disks, except for the SSDs. How big is the risk
here when it comes to SAS - SATA conversion? Our newer servers have
direct connections on each lane to the disk.
There are A LOT of opinions on this. What I have done that has worked
extremely well was use 70 Samsung 840 Pro SSD with LSI interposers in
Supermicro chassis. There were a couple early failures of the interposers
but it has been rock solid ever since. mpt_sas blue chunks and panic'd
the system on one. On another one I caught it in action and doing a 'zpool
offline {device}' kept everything running without a hitch.
I run with ZIL off because this is used entirely for scratch data and
virtual machines that can be redeployed in minutes. It would be sync safe
with the addition of some good log devices.
I'm not sure if the interposers increased stability or it has simply been
the quality of the Samsung SSD.
-Chip
Chris
Chris Nagele
Co-founder, Wildbit
Beanstalk, Postmark, dploy.io
On Sat, Apr 4, 2015 at 7:18 PM, Doug Hughes d...@will.to wrote:
We have a couple of machines with all SSD pool (~6-10 Samsung 850 pro is
the
current favorite). They work great for IOPS. Here's my take.
1) you don't need a dedicated zil. Just let the zpool intersperse it
amongst
the existing zpool devices. They are plenty fast enough.
2) you don't need an L2arc for the same reason. a smaller number of
dedicated devices would likely cause more of a bottleneck than serving
off
the existing pool devices (unless you were to put it on one of those
giant
RDRAM things or similar, but that adds a lot of expense)
On 4/4/2015 3:07 PM, Chris Nagele wrote:
We've been running a few 4U Supermicro servers using ZeusRAM for zil and
SSDs for L2. The main disks are regular 1TB SAS.
I'm considering moving to all SSD since the pricing has dropped so much.
What things should I know or do when moving to all SSD pools? I'm
assuming I
don't need L2 and that I should keep the ZeusRAM. Should I only use
certain
types of SSDs?
Thanks,
Chris
--
Chris Nagele
Co-founder, Wildbit
Beanstalk, Postmark, dploy.io
___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss
___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss
___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss
___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] All SSD pool advice
We have a couple of machines with all SSD pool (~6-10 Samsung 850 pro is the current favorite). They work great for IOPS. Here's my take. 1) you don't need a dedicated zil. Just let the zpool intersperse it amongst the existing zpool devices. They are plenty fast enough. 2) you don't need an L2arc for the same reason. a smaller number of dedicated devices would likely cause more of a bottleneck than serving off the existing pool devices (unless you were to put it on one of those giant RDRAM things or similar, but that adds a lot of expense) On 4/4/2015 3:07 PM, Chris Nagele wrote: We've been running a few 4U Supermicro servers using ZeusRAM for zil and SSDs for L2. The main disks are regular 1TB SAS. I'm considering moving to all SSD since the pricing has dropped so much. What things should I know or do when moving to all SSD pools? I'm assuming I don't need L2 and that I should keep the ZeusRAM. Should I only use certain types of SSDs? Thanks, Chris -- Chris Nagele Co-founder,Wildbit http://wildbit.com/ Beanstalk http://beanstalkapp.com/, Postmark http://postmarkapp.com/, dploy.io http://dploy.io/ ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
