Re: zfs on hardware raid array

2019-01-19 Thread Daniel Eischen

> On Jan 19, 2019, at 2:31 PM, Brian Bilbrey  wrote:
> 
> (Bcc’d to the OP)
> 
> You *could* do what I’ve done in the past - make each disk into a single disk 
> volume presented by the array, then use the presented volumes to make your 
> mirrors, z2s, etc… I’m not running that anymore, but it was fine and reliable 
> for years. A failed disk could be replaced in the array, then re-presented to 
> the OS for rebuild. I actually kept a presented volume back to use as a warm 
> spare in those circumstances. 
> 
> A reasonably inexpensive alternative is to replace the controller with one 
> that permits JBOD.

[ BCC'd to the poster above ]

We have some Oracle X5 servers that are also unable to configure the SAS disks 
as JBOD.  We do the same thing, each disk is a separate volume, and we just use 
ZFS mirrors on the individual volumes.

We thought it strange that Oracle would spec hardware (I think it's an LSI 
controller) that didn't allow JBOD when they themselves recommend not using 
hardware RAID for ZFS, and also don't support booting from anything other than 
ZFS (starting with Solaris 11).

--
DE
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: zfs on hardware raid array

2019-01-19 Thread Brian Bilbrey
(Bcc’d to the OP)

You *could* do what I’ve done in the past - make each disk into a single disk 
volume presented by the array, then use the presented volumes to make your 
mirrors, z2s, etc… I’m not running that anymore, but it was fine and reliable 
for years. A failed disk could be replaced in the array, then re-presented to 
the OS for rebuild. I actually kept a presented volume back to use as a warm 
spare in those circumstances. 

A reasonably inexpensive alternative is to replace the controller with one that 
permits JBOD.

Best,

Brian


> On Jan 19, 2019, at 10:07, Maciej Jan Broniarz  wrote:
> 
> Hi,
> 
> I want to use ZFS on a hardware-raid array. I have no option of making it 
> JBOD. I know it is best to use ZFS on JBOD, but 
> that possible in that particular case. My question is - how bad of an idea is 
> it. I have read very different opinions on that subject, but none of them 
> seems conclusive.
> 
> Any comments and especially case studies are most welcome.
> All best,
> mjb
> ___
> freebsd-stable@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"

___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


zfs on hardware raid array

2019-01-19 Thread Maciej Jan Broniarz
Hi,

I want to use ZFS on a hardware-raid array. I have no option of making it JBOD. 
I know it is best to use ZFS on JBOD, but 
that possible in that particular case. My question is - how bad of an idea is 
it. I have read very different opinions on that subject, but none of them seems 
conclusive.

Any comments and especially case studies are most welcome.
All best,
mjb
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: More CARP issues under 12

2019-01-19 Thread Kevin Oberman
On Thu, Jan 17, 2019 at 4:21 AM Pete French 
wrote:

> so, having got a workaround for yesterdays problems, I now went to upgrade
> my
> other pair of boxes using CARP. No 'pf' on these, just one shared address.
> This is the setup I have tested in development and it works fine.
>
> I install the new kenel and do the first reboot - and I get the panic
> below. Maybe its not carp related, but seems suspicious as the last
> thing it spits out is a carp message.
>
> Note this is the first reboot - so 12.0 kernel with the 11 userland, in
> perparation for the installworld step. Machine is booting from, ZFS and
> also
> has a GELI partition contain some data which requires a manual password.
>

To point  out the obvious, booting a 12.0 kernel with 11  userland to
multiuser mode is seriously unsupported. You really need to boot to single
user and install 12.0 userland to really expect things to work. OTOH, while
I would expect that MANY things might not work, panics should not come from
problems in userland. Still, I would not be at all shocked if it turns out
to be coincidental to CARP. I would also not be shocked if this makes no
difference, but even between minor version updates, there can be issues
when the kernel and userland are different versions.

Is there a reason that a standalone boot is not possible? Both installworld
and mergemaster should be run before moving to multiuser mode and reboot is
preferred to exit. In some cases even delete-old can be required before
safely going to multimode.
--
Kevin Oberman, Part time kid herder and retired Network Engineer
E-mail: rkober...@gmail.com
PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683
___
freebsd-stable@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"