Re: [SCIENTIFIC-LINUX-USERS] RAID 6 array and failing harddrives

2017-04-11 Thread Konstantin Olchanski
On Tue, Apr 11, 2017 at 10:47:09PM +0200, David Sommerseth wrote: > > So lets flip this around ... Why isn't btrfs enabled by default in RHEL... > I already wrote about BTRFS in this thread. I did some extensive tests of BTRFS and the performance is quite acceptable (close to hardware

Re: [SCIENTIFIC-LINUX-USERS] RAID 6 array and failing harddrives

2017-04-11 Thread Michael Tiernan
On 4/11/17 3:41 PM, jdow wrote: So I suppose the extended downtime while several terabytes of data are restored after it's loss due to filesystem malfunction is of no consequence to you. While not trying to dowse the fire with gasoline, I'd like to remind folks that data loss isn't the only

Re: [SCIENTIFIC-LINUX-USERS] RAID 6 array and failing harddrives

2017-04-11 Thread jdow
On 2017-04-11 09:44, Konstantin Olchanski wrote: On Tue, Apr 11, 2017 at 11:13:25AM +0200, David Sommerseth wrote: But that aside, according to [1], ZFS on Linux was considered stable in 2013. That is still fairly fresh, and my concerns regarding the time it takes to truly stabilize file

Re: [SCIENTIFIC-LINUX-USERS] RAID 6 array and failing harddrives

2017-04-11 Thread Tom H
On Tue, Apr 11, 2017 at 4:30 AM, Jose Marques wrote: >> On 10 Apr 2017, at 18:23, David Sommerseth >> wrote: >> >> But I'll give you that Oracle is probably a very different beast on >> the legal side and doesn't have a too good "open

Re: RAID 6 array and failing harddrives

2017-04-11 Thread Tom H
On Mon, Apr 10, 2017 at 1:23 PM, David Sommerseth wrote: > On 10/04/17 09:15, Tom H wrote: >> >> zfs'll never be in-tree for licensing reasons. > > Well, "never" might be a too strong word. Stranger things have > happened, like Microsoft embracing Linux and open

Re: [SCIENTIFIC-LINUX-USERS] RAID 6 array and failing harddrives

2017-04-11 Thread David Sommerseth
On 11/04/17 10:30, Jose Marques wrote: >> On 10 Apr 2017, at 18:23, David Sommerseth >> wrote: >> >> But I'll give you that Oracle is probably a very different beast on the >> legal side and doesn't have a too good "open source karma". > > ZFS on Linux is based

Re: [SCIENTIFIC-LINUX-USERS] RAID 6 array and failing harddrives

2017-04-11 Thread Jose Marques
> On 10 Apr 2017, at 18:23, David Sommerseth > wrote: > > But I'll give you that Oracle is probably a very different beast on the > legal side and doesn't have a too good "open source karma". ZFS on Linux is based on OpenZFS

Re: RAID 6 array and failing harddrives

2017-04-10 Thread David Sommerseth
On 10/04/17 09:15, Tom H wrote: > zfs'll never be in-tree for licensing reasons. Well, "never" might be a too strong word. Stranger things have happened, like Microsoft embracing Linux and open source; even starting to open up some of their closed projects as open source ;-) But I'll give you

Re: RAID 6 array and failing harddrives

2017-04-10 Thread David Sommerseth
On 10/04/17 10:43, Tom H wrote: > On Thu, Apr 6, 2017 at 5:01 PM, David Sommerseth > wrote: > > >> I would never run btrfs on *any* production server, regardless of >> currently available kernel versions. Because it is not deemed ready >> for production yet. For

Re: RAID 6 array and failing harddrives

2017-04-10 Thread Tom H
On Thu, Apr 6, 2017 at 5:01 PM, David Sommerseth wrote: > I would never run btrfs on *any* production server, regardless of > currently available kernel versions. Because it is not deemed ready > for production yet. For testing I would be willing to experiment

Re: RAID 6 array and failing harddrives

2017-04-10 Thread Tom H
On Thu, Apr 6, 2017 at 8:15 AM, David Sommerseth wrote: > On 06/04/17 10:54, Tom H wrote: >> On Wed, Apr 5, 2017 at 5:50 AM, David Sommerseth >> wrote: >>> >>> ZFS looks great, so does btrfs - on the paper. But until ZFS is native

Re: RAID 6 array and failing harddrives

2017-04-06 Thread David Sommerseth
On 06/04/17 21:17, Konstantin Olchanski wrote: >> ... until ZFS is native in Linux ... >> ... My meaning of "native" is that it is included in the upstream Linux >> kernel, not a side-loaded product/project/kernel module. > > At least for BTRFS, "native" seems to be a bad thing. The BTRFS version

Re: RAID 6 array and failing harddrives

2017-04-06 Thread David Sommerseth
On 06/04/17 10:54, Tom H wrote: > On Wed, Apr 5, 2017 at 5:50 AM, David Sommerseth > wrote: >> >> ZFS looks great, so does btrfs - on the paper. But until ZFS is native >> in Linux or btrfs stabilizes on the same level as ext4 and XFS, I'm >> not going that path

Re: RAID 6 array and failing harddrives

2017-04-06 Thread Tom H
On Wed, Apr 5, 2017 at 5:50 AM, David Sommerseth wrote: > > ZFS looks great, so does btrfs - on the paper. But until ZFS is native > in Linux or btrfs stabilizes on the same level as ext4 and XFS, I'm > not going that path for production environments. What do you

Re: RAID 6 array and failing harddrives

2017-04-05 Thread David Sommerseth
On 05/04/17 11:50, David Sommerseth wrote: > ZFS looks great, so does btrfs - on the paper. But until ZFS is native > in Linux or btrfs stabilizes on the same level as ext4 and XFS, I'm not > going that path for production environments :) Just to be clear, when I say "ZFS is native in Linux" - I

Re: RAID 6 array and failing harddrives

2017-04-04 Thread Graham Allan
On 4/4/2017 6:59 PM, Konstantin Olchanski wrote: Moving to ZFS... ZFS is also scary... Heh - another soon to be victim of ZFS on linux :) No kidding. Former victim of XLV+XFS (remember XLV?), former victim of LV+EFS, former victim of ext2, ext3, reiserfs, former victim of LVM, current

Re: RAID 6 array and failing harddrives

2017-04-04 Thread Konstantin Olchanski
> > Moving to ZFS... > > ZFS is also scary... > > Heh - another soon to be victim of ZFS on linux :) > No kidding. Former victim of XLV+XFS (remember XLV?), former victim of LV+EFS, former victim of ext2, ext3, reiserfs, former victim of LVM, current victim of mdadm/raid5/6/ext4/xfs. > > You'll

Re: RAID 6 array and failing harddrives

2017-04-04 Thread Steven Haigh
On 05/04/17 05:44, Konstantin Olchanski wrote: > Moving to ZFS because of issues like this. RAID6 rebuild with 4-6-8-10TB disks > has become too scary. If there is any transient error during the rebuild, > the md driver starts kicking disks out, getting into funny states with many > "missing"

Re: RAID 6 array and failing harddrives

2017-04-04 Thread Konstantin Olchanski
Moving to ZFS because of issues like this. RAID6 rebuild with 4-6-8-10TB disks has become too scary. If there is any transient error during the rebuild, the md driver starts kicking disks out, getting into funny states with many "missing" disks, recovery is only via "mdadm --assemble --force" and

RAID 6 array and failing harddrives

2017-04-04 Thread David Sommerseth
Hi, I just need some help to understand what might be the issue on a SL7.3 server which today decided to disconnect two drives from a RAID 6 setup. First some gory details - smartctl + mdadm output - kernel