[OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-11-11 Thread Stefan Müller-Wilken
Hi Peter, hi list, If you have a SAS controller attached via the mpt_sas driver, for instance, you can absolutely expect hot plugged disks to go away and return automatically. If not, then you are experiencing bugs in the system and should report them as such so that we can fix them.

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-10 Thread Laurent Blume
On 09/10/13 15:37, Edward Ned Harvey (openindiana) wrote: In BIOS, I have the option to enable/disable SATA port 0, 1,2,3. If the port is enabled and nothing connected, it throws and error during POST. If something is connected, it's identified as a 1TB or whatever drive, and presented to the

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-10 Thread Joshua M. Clulow
On 10 October 2013 00:18, Laurent Blume laurent...@elanor.org wrote: Solaris and descendants are not hot-swap OS's. If you want to replace a drive, you need to tell the system beforehand that you will remove a disk with cfgadm, and depending on your HBA/driver combination, tell it again after

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-10 Thread Peter Tribble
On Thu, Oct 10, 2013 at 9:01 AM, Joshua M. Clulow j...@sysmgr.org wrote: On 10 October 2013 00:18, Laurent Blume laurent...@elanor.org wrote: Solaris and descendants are not hot-swap OS's. If you want to replace a drive, you need to tell the system beforehand that you will remove a disk

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-10 Thread Edward Ned Harvey (openindiana)
From: Aneurin Price [mailto:aneurin.pr...@gmail.com] Is this in IDE emulation mode per-chance? If your controller acts this way in AHCI mode, it's defective and should be replaced Alright, I'll try again. Gimme a couple days to respond, as this is what I do for offsite data rotation. I

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-10 Thread Edward Ned Harvey (openindiana)
From: Joshua M. Clulow [mailto:j...@sysmgr.org] This is emphatically false. Though the pestilence of cfgadm(1M) and the idea that device replacement is somehow advantageously manual had persisted inside Sun's walls until its untimely demise, SunOS itself is certainly capable of

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-10 Thread Laurent Blume
On 10/10/13 10:01, Joshua M. Clulow wrote: This is emphatically false. It's good to see such enthusiasm. However, all that crap has never, to my knowledge, been clearly documented, so blaming it on the users is not exactly fair. Trial and errors over years is what it took me, including

[OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-09 Thread Stefan Müller-Wilken
Hi all, ... so just to make sure I got that right: for the T3-1 you'd suggest to dump the PCIe HBA and go with the on-board SAS controller - even for production use? And for the DL380, where this is no option, place each drive in a single drive logical volum? And then, in both cases, build

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-09 Thread Marc Jakob
Hi Stefan, I run since 3 months a dl380e with single raid0 disks in a mirrored zfs pool - works fine! I had to install the cpqary3 driver for the p420i controller first. Regards, Marc Am 09.10.2013 um 09:33 schrieb Stefan Müller-Wilken stefan.mueller-wil...@acando.de: Hi all, ... so

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-09 Thread Edward Ned Harvey (openindiana)
From: Christopher Chan [mailto:christopher.c...@bradbury.edu.hk] Sent: Tuesday, October 08, 2013 8:42 PM Er...isn't hotswap capability PART of the specs whether the drives are SAS or SATA? I can do this on a cheap desktop motherboard but you cannot on a server board with getting a HBA?

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-09 Thread Edward Ned Harvey (openindiana)
From: Stefan Müller-Wilken [mailto:stefan.mueller-wil...@acando.de] Sent: Wednesday, October 09, 2013 3:34 AM ... so just to make sure I got that right: for the T3-1 you'd suggest to dump the PCIe HBA and go with the on-board SAS controller - even for production use? And for the DL380,

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-09 Thread Edward Ned Harvey (openindiana)
From: Edward Ned Harvey (openindiana) If it were truly hot plug, then the OS should get a drive disconnected signal, and c1t1d1 should not exist anymore. As is the case with a USB drive or firewire. (or hotplug capable HBA) ___

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-09 Thread Aneurin Price
On 9 October 2013 14:37, Edward Ned Harvey (openindiana) openindi...@nedharvey.com wrote: From: Christopher Chan [mailto:christopher.c...@bradbury.edu.hk] Sent: Tuesday, October 08, 2013 8:42 PM Er...isn't hotswap capability PART of the specs whether the drives are SAS or SATA? I can do this

[OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Stefan Müller-Wilken
Dear all, I know, this is only in parts an OpenIndiana related questions but maybe someone might share their experience / opinions... I have a customer running OI157_a8 on a Dell DL380-G7. Works like a charm and everyone's happy. There's only one downside to the configuration and that's the

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Edward Ned Harvey (openindiana)
From: Stefan Müller-Wilken [mailto:stefan.mueller-wil...@acando.de] Question now: what would you recommend? 8 LSI RAID0 LVs under ZFS, 8 drives under LSI RAID-5, or switch to an Oracle certified controller with JBOD mode (which one??)? Does it make sense to go for Soft RAID anyway, with

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Peter Tribble
On Tue, Oct 8, 2013 at 2:28 PM, Stefan Müller-Wilken stefan.mueller-wil...@acando.de wrote: Dear all, I know, this is only in parts an OpenIndiana related questions but maybe someone might share their experience / opinions... I have a customer running OI157_a8 on a Dell DL380-G7. You

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Saso Kiselkov
On 10/8/13 2:28 PM, Stefan Müller-Wilken wrote: Dear all, I know, this is only in parts an OpenIndiana related questions but maybe someone might share their experience / opinions... I have a customer running OI157_a8 on a Dell DL380-G7. Works like a charm and everyone's happy. There's

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Edward Ned Harvey (openindiana)
From: Peter Tribble [mailto:peter.trib...@gmail.com] This is where I get a little confused. Why an extra HBA at all - what's wrong with using the SAS ports on the system board? My usual reason for using an HBA is for hot plug, and red blinking lights on failed drives. If you have degraded

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Saso Kiselkov
On 10/8/13 3:29 PM, Edward Ned Harvey (openindiana) wrote: From: Peter Tribble [mailto:peter.trib...@gmail.com] This is where I get a little confused. Why an extra HBA at all - what's wrong with using the SAS ports on the system board? My usual reason for using an HBA is for hot plug, and

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Stefan Müller-Wilken
Hi Peter, You mean HP, not Dell, I presume. My bad! You're right, that's obviously HP, not Dell! This is where I get a little confused. Why an extra HBA at all - what's wrong with using the SAS ports on the system board? Huh? Do you know the T3-1? I didn't even know there is an option

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Stefan Müller-Wilken
Huh? Do you know the T3-1? I didn't even know there is an option *not* to use an HBA when connecting 8 SAS drives. Take a look at https://wikis.oracle.com/display/SystemsComm/SPARC+T3-1+Server . Is there an on board option at all? I've got them here. 16-drive variant. There are 2 LSI 2008

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Edward Ned Harvey (openindiana)
From: Saso Kiselkov [mailto:skiselkov...@gmail.com] I find, with the motherboard built-in sas controller, you usually need to power off in order to swap a drive, and you need to devfsadm -Cv after coming up, in order to make the new drive available. What kind of a messed up SAS

[OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Stefan Müller-Wilken
The on-board SAS controller isn't externally facing, and not expecting hotswap drives. Drive detection is performed by BIOS during POST. Dell optiplex, precision, and poweredge. I have all 3 sitting in my basement right now, with SATA cables dangling out the chassis through holes I cut, in order

Re: [OpenIndiana-discuss] Opinions on LSI RAID vs. ZFS

2013-10-08 Thread Peter Tribble
On Tue, Oct 8, 2013 at 8:20 PM, Stefan Müller-Wilken stefan.mueller-wil...@acando.de wrote: Well, at least in my case with both the HP DL380 and the Oracle T3-1 we're talking about server cases with hot-swap drive bays. So, I wouldn't expect external connectors anyway. But as both are in