[zfs-discuss] zpool import hangs any zfs-related programs, eats all RAM and dies in swapping hell

2011-06-10 Thread Jim Klimov
for my assistant by catching near-freeze conditions, is here: * http://thumper.cos.ru/~jim/freeram-watchdog-20110610-v0.11.tgz I guess it is time for questions now :) What methods can I use (beside 20-hour-long ZDB walks) to gain a quick insight on the cause of problems - why doesn't the pool import

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Jim Klimov Besides, the format is not public and subject to change, I think. So future compatibility is not guaranteed. That is not correct. Years ago, there was a comment in the man

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Jonathan Walker New to ZFS, I made a critical error when migrating data and configuring zpools according to needs - I stored a snapshot stream to a file using zfs send -R

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Darren J Moffat
On 06/10/11 12:47, Edward Ned Harvey wrote: From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Jonathan Walker New to ZFS, I made a critical error when migrating data and configuring zpools according to needs - I stored a snapshot stream to a

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Jim Klimov
2011-06-10 15:58, Darren J Moffat пишет: As I pointed out last time this came up the NDMP service on Solaris 11 Express and on the Oracle ZFS Storage Appliance uses the 'zfs send' stream as what is to be stored on the tape. This discussion turns interesting ;) Just curious: how do these

Re: [zfs-discuss] zpool import hangs any zfs-related programs, eats all RAM and dies in swapping hell

2011-06-10 Thread Jim Klimov
software watchdog which saves some trouble for my assistant by catching near-freeze conditions, is here: * http://thumper.cos.ru/~jim/freeram-watchdog-20110610-v0.11.tgz

[zfs-discuss] ACARD ANS-9010 cannot work well LSI 9211-8i SAS inerface

2011-06-10 Thread Fred Liu
Just want to share with you. We have found and been suffering from some weird issues because of it. It is better to connect them directly to the sata ports on the mainboard. Thanks. Fred ___ zfs-discuss mailing list zfs-discuss@opensolaris.org

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread David Magda
On Fri, June 10, 2011 07:47, Edward Ned Harvey wrote: #1 A single bit error causes checksum mismatch and then the whole data stream is not receivable. I wonder if it would be worth adding a (toggleable?) forward error correction (FEC) [1] scheme to the 'zfs send' stream. Even if we're

Re: [zfs-discuss] zpool import hangs any zfs-related programs, eats all RAM and dies in swapping hell

2011-06-10 Thread Jim Klimov
2011-06-10 18:00, Steve Gonczi пишет: Hi Jim, I wonder what OS version you are running? There was a problem similar to what you are describing in earlier versions in the 13x kernel series. Should not be present in the 14x kernels. It is OpenIndiana oi_148a, and unlike many other details -

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Marty Scholes
If it is true that unlike ZFS itself, the replication stream format has no redundancy (even of ECC/CRC sort), how can it be used for long-term retention on tape? It can't. I don't think it has been documented anywhere, but I believe that it has been well understood that if you don't trust

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Jim Klimov
2011-06-10 20:58, Marty Scholes пишет: If it is true that unlike ZFS itself, the replication stream format has no redundancy (even of ECC/CRC sort), how can it be used for long-term retention on tape? It can't. I don't think it has been documented anywhere, but I believe that it has been well

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Paul Kraus
On Fri, Jun 10, 2011 at 8:59 AM, Jim Klimov jimkli...@cos.ru wrote: Is such tape storage only intended for reliable media such as another ZFS or triple-redundancy tape archive with fancy robotics? How would it cope with BER in transfers to/from such media? Large and small businesses have

Re: [zfs-discuss] zpool import hangs any zfs-related programs, eats all RAM and dies in swapping hell

2011-06-10 Thread Tim Cook
On Jun 10, 2011 11:52 AM, Jim Klimov jimkli...@cos.ru wrote: 2011-06-10 18:00, Steve Gonczi пишет: Hi Jim, I wonder what OS version you are running? There was a problem similar to what you are describing in earlier versions in the 13x kernel series. Should not be present in the 14x

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Marty Scholes
I stored a snapshot stream to a file The tragic irony here is that the file was stored on a non-zfs filesystem. You had had undetected bitrot which unknowingly corrupted the stream. Other files also might have been silently corrupted as well. You may have just made one of the strongest

Re: [zfs-discuss] ZFS receive checksum mismatch

2011-06-10 Thread Richard Elling
On Jun 10, 2011, at 8:59 AM, David Magda wrote: On Fri, June 10, 2011 07:47, Edward Ned Harvey wrote: #1 A single bit error causes checksum mismatch and then the whole data stream is not receivable. I wonder if it would be worth adding a (toggleable?) forward error correction (FEC) [1]