Re: [zfs-discuss] mpt errors on snv 127

2009-12-06 Thread Chad Cantwell
Thanks for the info on the yukon driver. I realize too many variables makes things impossible to determine, but I had made these hardware changes awhile back, and they seemed to work fine at the time. Since they aren't now, even in the older OpenSolaris (i've tried 2009.06 and 2008.11 now), the p

Re: [zfs-discuss] Permanent errors on two files

2009-12-06 Thread Gary Mills
On Sat, Dec 05, 2009 at 01:52:12AM +0300, Victor Latushkin wrote: > On Dec 5, 2009, at 0:52, Cindy Swearingen > wrote: > > >The zpool status -v command will generally print out filenames, dnode > >object numbers, or identify metadata corruption problems. These look > >like object numbers, becau

[zfs-discuss] freeNAS moves to Linux from FreeBSD

2009-12-06 Thread Gary Gendel
The only reason I thought this news would be of interest is that the discussions had some interesting comments. Basically, there is a significant outcry because zfs was going away. I saw NextentaOS and EON mentioned several times as the path to go. Seem that there is some opportunity for Open

Re: [zfs-discuss] Permanent errors on two files

2009-12-06 Thread Gary Mills
On Fri, Dec 04, 2009 at 02:52:47PM -0700, Cindy Swearingen wrote: > > If space/dcc is a dataset, is it mounted? ZFS might not be able to > print the filenames if the dataset is not mounted, but I'm not sure > if this is why only object numbers are displayed. Yes, it's mounted and is quite an acti

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Edward Ned Harvey
> cat my_log_file | tee >(gzip > my_log_file.gz) >(wc -l) >(md5sum) | > sort | uniq -c That is great. ;-) Thank you very much. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Edward Ned Harvey
Oh well. I built LZO, and can't seem to link it in the lzop build, despite correctly setting the FLAGS variables they say in the INSTALL file. I'd love to provide an lzop comparison, but can't get it. I give up ... Also, can't build python-lzo. Also would be sweet, but hey. For whoever cares,

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Richard Elling
On Dec 6, 2009, at 3:35 PM, Edward Ned Harvey wrote: OS means Operating System, or OpenSolaris. This is in the second meaning I wrote OS in my answer. It was not obvious you were using Solaris 10 though. Sorry about that. (FYI, zstreamdump seems to be an addition to build 125.) Oh - I neve

Re: [zfs-discuss] OpenSolaris 2009.06 ZFS - COMSTAR iSCSI - NFS Reboot Issue

2009-12-06 Thread Richard Elling
On Dec 6, 2009, at 1:17 PM, Amos Deering wrote: I have recently become aware of the capabilities of OpenSolaris, and am attempting to setup a Storage Box to give a combination of CIFS and iSCSI and/or NFS. I have seemingly succsessfully been able to configure a zfs iscsi share via iscsit

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Richard Elling
On Dec 5, 2009, at 11:03 AM, Mike Gerdts wrote: On Sat, Dec 5, 2009 at 11:32 AM, Bob Friesenhahn wrote: On Sat, 5 Dec 2009, dick hoogendijk wrote: On Sat, 2009-12-05 at 09:22 -0600, Bob Friesenhahn wrote: You can also stream into a gzip or lzop wrapper in order to obtain the benefit of

Re: [zfs-discuss] mpt errors on snv 127

2009-12-06 Thread James C. McPherson
Gday Chad, the more swaptronics you partake in, the more difficult it is going to be for us (collectively) to figure out what is going wrong on your system. Btw, since you're running a build past 124, you can use the "yge" driver instead of the yukonx (from Marvell) or myk (from Murayama-san) dr

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Bob Friesenhahn
On Sun, 6 Dec 2009, Edward Ned Harvey wrote: I see 3.6X less CPU consumption from 'lzop -3' than from 'gzip -3'. Where do you get lzop from? I don't see any binaries on their site, nor blastwave, nor opencsw. And I am having difficulty building it from source. I just built it from source.

[zfs-discuss] Problems while resilvering

2009-12-06 Thread Matthias Appel
Hi, i have go a problem with a zfs pool which wont resilver correctly. The pool consists of two two-way mirrors. One of the disks reportet checksum errors and fell out of the pool. I replaced the faulty harddisk and switched it to available via cfgadm. The resilver started immediately but gave

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Edward Ned Harvey
> I see 3.6X less CPU > consumption from 'lzop -3' than from 'gzip -3'. Where do you get lzop from? I don't see any binaries on their site, nor blastwave, nor opencsw. And I am having difficulty building it from source. ___ zfs-discuss mailing list zf

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Edward Ned Harvey
> OS means Operating System, or OpenSolaris. This is in the second > meaning I wrote OS in my answer. It was not obvious you were using > Solaris 10 though. Sorry about that. > > (FYI, zstreamdump seems to be an addition to build 125.) Oh - I never connected OS to OpenSolaris. ;-) So I gathe

Re: [zfs-discuss] Workaround for mpt timeouts in snv_127

2009-12-06 Thread Stan Seibert
I've spent all weekend fighting this problem on our storage server after installing a ZFS log device, and your suggestion fixed it! I also have a LSI 3081E-R adapter (B3 revision) connected to a SAS expander backplane with 7 drives on it. None of the /etc/system options mentioned in this thre

[zfs-discuss] OpenSolaris 2009.06 ZFS - COMSTAR iSCSI - NFS Reboot Issue

2009-12-06 Thread Amos Deering
I have recently become aware of the capabilities of OpenSolaris, and am attempting to setup a Storage Box to give a combination of CIFS and iSCSI and/or NFS. I have seemingly succsessfully been able to configure a zfs iscsi share via iscsitgt, yet the performance is just not up to par, so I dec

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Julien Gabel
>> Depending of your version of OS, I think the following post from Richard >> Elling will be of great interest to you: > Where exactly do you get zstreamdump? > I found a link to zstreamdump.c ... but is that it?  Shouldn't it be part of > a source tarball or something? > Does it matter what OS?

Re: [zfs-discuss] Accidentally added disk instead of attaching

2009-12-06 Thread Volker A. Brandt
> Do you know a good zfs backup restore walktrough online? Not really. Check out the zfs send and receive commands in the ZFS Administration Guide: http://docs.sun.com/app/docs/doc/819-5461/gbinw?a=view Basically, you make a snapshot of every filesystem you want to backup, then you use "zfs sen

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-06 Thread Neil Perrin
I'll try to find out whether ZFS binding the same file always to the same opening transaction group. Not sure what you mean by this. Transactions (eg writes) will go into the current open transaction group (txg). Subsequent writes may enter the same or a future txg. Txgs are obviously committe

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Amado Gramajo
AcghhjkkNnmuUiui - Original Message - From: zfs-discuss-boun...@opensolaris.org To: Edward Ned Harvey Cc: ZFS discuss Sent: Sun Dec 06 10:54:11 2009 Subject: Re: [zfs-discuss] ZFS send | verify | receive On Sun, 6 Dec 2009, Edward Ned Harvey wrote: > > I also have a "threadzip" script,

Re: [zfs-discuss] [zfs-code] Transaction consistency of ZFS

2009-12-06 Thread Neil Perrin
On 12/06/09 10:11, Anurag Agarwal wrote: Hi, My reading of write code of ZFS (zfs_write in zfs_vnops.c), is that all the writes in zfs are logged in the ZIL. Each write gets recorded in memory in case it needs to be forced out later (eg fsync()), but is not written to the on-disk log until

Re: [zfs-discuss] Accidentally added disk instead of attaching

2009-12-06 Thread Martijn de Munnik
Do you know a good zfs backup restore walktrough online? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Using iSCSI on ZFS with non-native FS - How to backup.

2009-12-06 Thread Jens Vilstrup
On 06/12/2009, at 09.05, Tim Cook wrote: > Yes. Snapshots work at the block level so you can take snapshots regardless > of the FS on top of the iSCSI LUN. The two caveats are you'll need another > Mac system at your DR to recover, and also to get a guaranteed consistent > snapshot, you'll ne

Re: [zfs-discuss] Accidentally added disk instead of attaching

2009-12-06 Thread Martijn de Munnik
I saw this bug report… http://bugs.opensolaris.org/view_bug.do?bug_id=4852783 -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Seth Heeren
Edward Ned Harvey wrote: >> I use the excellent pbzip2 >> >> zfs send ... | tee >(md5sum) | pbzip2 | ssh remote ... >> >> Utilizes those 8 cores quite well :) >> > > This (pbzip2) sounds promising, and it must be better than what I wrote. > ;-) But I don't understand the syntax you've got

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Bob Friesenhahn
On Sun, 6 Dec 2009, Edward Ned Harvey wrote: Threadzip performed 10x faster (hardly a performance I expect from lzop) and compressed about 2-3% smaller than gzip. Also hardly a performance I could expect from lzop. The key is multiple cores. I'm on an 8-core xeon. I am glad to see that you f

Re: [zfs-discuss] Accidentally added disk instead of attaching

2009-12-06 Thread Volker A. Brandt
> I wanted to add a disk to the tank pool to create a mirror. I accidentally > used zpool add ? instead of zpool attach ? and now the disk is added. Is > there a way to remove the disk without loosing data? Been there, done that -- at a customer site while showing off ZFS. :-) Currently, you cann

[zfs-discuss] Accidentally added disk instead of attaching

2009-12-06 Thread Martijn de Munnik
Hi, I wanted to add a disk to the tank pool to create a mirror. I accidentally used zpool add … instead of zpool attach … and now the disk is added. Is there a way to remove the disk without loosing data? Or maybe change it to mirror? Thanks, Martijn -- This message posted from opensolaris.org

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Edward Ned Harvey
> I use the excellent pbzip2 > > zfs send ... | tee >(md5sum) | pbzip2 | ssh remote ... > > Utilizes those 8 cores quite well :) This (pbzip2) sounds promising, and it must be better than what I wrote. ;-) But I don't understand the syntax you've got above, using tee, redirecting to somethi

Re: [zfs-discuss] [zfs-code] Transaction consistency of ZFS

2009-12-06 Thread Anurag Agarwal
Hi, My reading of write code of ZFS (zfs_write in zfs_vnops.c), is that all the writes in zfs are logged in the ZIL. And if that indeed is the case, then yes, ZFS does guarantee the sequential consistency, even when there are power outage or server crash. You might loose some writes if ZIL has not

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Edward Ned Harvey
> Gzip can be a bit slow. Luckily there is 'lzop' which is quite a lot > more CPU efficient on i386 and AMD64, and even on SPARC. If the > compressor is able to keep up with the network and disk, then it is > fast enough. See "http://www.lzop.org/";. In my development/testing this week, I did "

Re: [zfs-discuss] Transaction consistency of ZFS

2009-12-06 Thread Toby Thain
On 5-Dec-09, at 9:32 PM, nxyyt wrote: The "rename trick" may not work here. Even if I renamed the file successfully, the data of the file may still reside in the memory instead of flushing back to the disk. If I made any mistake here, please correct me. Thank you! I'll try to find out w

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Seth Heeren
Bob Friesenhahn wrote: > On Sun, 6 Dec 2009, Edward Ned Harvey wrote: >> >> I also have a "threadzip" script, because gzip is invariably the >> bottleneck >> in the data stream. Utilize those extra cores!!! ;-) > > Gzip can be a bit slow. Luckily there is 'lzop' which is quite a lot > more CPU e

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Seth Heeren
Edward Ned Harvey wrote: >> If feasible, you may want to generate MD5 sums on the streamed output >> and then use these for verification. >> > > That's actually not a bad idea. It should be kinda obvious, but I hadn't > thought of it because it's sort-of duplicating existing functionality. >

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Bob Friesenhahn
On Sun, 6 Dec 2009, Edward Ned Harvey wrote: I also have a "threadzip" script, because gzip is invariably the bottleneck in the data stream. Utilize those extra cores!!! ;-) Gzip can be a bit slow. Luckily there is 'lzop' which is quite a lot more CPU efficient on i386 and AMD64, and even

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Colin Raven
On Sat, Dec 5, 2009 at 17:17, Richard Elling wrote: > On Dec 4, 2009, at 4:11 PM, Edward Ned Harvey wrote: > > Depending of your version of OS, I think the following post from Richard >>> Elling >>> will be of great interest to you: >>> - >>> >>> http://richardelling.blogspot.com/2009/10/check-in

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Edward Ned Harvey
Where exactly do you get zstreamdump? I found a link to zstreamdump.c ... but is that it? Shouldn't it be part of a source tarball or something? Does it matter what OS? Every reference I see for zstreamdump is about opensolaris. But I'm running solaris. __

Re: [zfs-discuss] ZFS send | verify | receive

2009-12-06 Thread Edward Ned Harvey
> If feasible, you may want to generate MD5 sums on the streamed output > and then use these for verification. That's actually not a bad idea. It should be kinda obvious, but I hadn't thought of it because it's sort-of duplicating existing functionality. I do have a "multipipe" script that behav

Re: [zfs-discuss] Using iSCSI on ZFS with non-native FS - How to backup.

2009-12-06 Thread Tim Cook
On Sat, Dec 5, 2009 at 12:13 PM, Jens Vilstrup wrote: > Hi there. > > I'm looking at moving my home server to ZFS and adding a second for backup > purposes. > In the process of researching ZFS I noticed iSCSI. > I'm thinking of creating a zvol, share it with iSCSI and use it with my > Mac(s). > I