Re: [zfs-discuss] Scrub works in parallel?
2012-06-11 5:37, Edward Ned Harvey wrote: From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Kalle Anka Assume we have 100 disks in one zpool. Assume it takes 5 hours to scrub one disk. If I scrub the zpool, how long time will it take? Will it scrub one disk at a time, so it will take 500 hours, i.e. in sequence, just serial? Or is it possible to run the scrub in parallel, so it takes 5h no matter how many disks? It will be approximately parallel, because it's actually scrubbing only the used blocks, and the order it scrubs in will be approximately the order they were written, which was intentionally parallel. What the other posters said, plus: 100 disks is quite a lot of contention on the bus(es), so even if it is all parallel, the bus and CPU bottlenecks would raise the scrubbing time somewhat above the single-disk scrub time. Roughly, if all else is ideal (i.e. no/few random seeks and a fast scrub at 100Mbps/disk), the SATA3 interface at 6Gbit/s (on the order of ~600Mbyte/s) will be maxed out at about 6 disks. If your disks are colocated on one HBA receptacle (i.e. via a backplane), this may be an issue for many disks in an enclosure (a 4-lane link will sustain about 24 drives at such speed, and that's not the market's max speed). Further on, the PCI buses will become a bottleneck and the CPU processing power might become one too, and for a box with 100 disks this may be noticeable, depending on the other architectural choices, components and their specs. HTH, //Jim ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Hard Drive Choice Question
On 05/17/2012 04:10 AM, Ian Collins wrote: I wouldn't be too fussed about 7x24 rating in a home server. I still have a set of 10 regular Seagate drives I bought in 2007 that were spinning non stop for four years in a very hostile environment (my garage!). They simply refuse to die and I'm still using them in various test systems. Of course, your mileage will vary. Lately I've been having better luck with my 500 GB WD Blue drives, while in two systems I have recently replaced dying Segate 500 GB drives (7200.11) from 2009. One was part of a ZFS mirror, and the other a Linux mdraid mirror. The drive in the OI box had a very large number of reallocated sectors and finally showed a bad SMART status (but no ZFS checksum errors on scrub). The drive in the Linux system started throwing read errors, yet had few reallocated sectors and still showed "PASSED" in the SMART data. Worse, it FAILED to reallocate sectors! If you're running 2009-vintage 7200.11 Barracudas, be prepared to replace them soon if you haven't already done so. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Hard Drive Choice Question
On Wed, May 16, 2012 at 10:53 AM, Paul Kraus wrote: > What do people like today for 7x24 operation SATA drives? I am > willing to consider 2TB, but don't really need the extra capacity (but > if that is all the market offers, I don't have to use the other half > :-) I found a Seagate Constellation ES 2 TB for about $350 (which is > more than I really want to spend, I got the ES2 1TB drives for about > $130 when I bought them). I have been sticking with Seagate as I am > comfortable with them, but am willing to look at others. The only > thing I insist on is that the drive be rated for 7x24 operation. I got uncomfortable with the way Seagate handled that whole 1.5TB firmware issue, and then there was a recent crop of 3TB drives that had issues, but those were consumer, not 7x24 drives. I would take a look at Hitachi, since that's what Sun put in my x4540. I've also had some luck with the samsungs. One interesting thing I saw (I have 4x3TB samsungs and 3x 3TB seagates in one zfs pool) is that the SMART counters climb very fast for 2 or 3 of the counters. I don't recall which offhand, but if you have a chance, I'd like to validate if it's my drive, or if it's normal. Thanks. -- http://www.glumbert.com/media/shift http://www.youtube.com/watch?v=tGvHNNOLnCk "This officer's men seem to follow him merely out of idle curiosity." -- Sandhurst officer cadet evaluation. "Securing an environment of Windows platforms from abuse - external or internal - is akin to trying to install sprinklers in a fireworks factory where smoking on the job is permitted." -- Gene Spafford learn french: http://www.youtube.com/watch?v=30v_g83VHK4 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] Is there an actual newsgroup for zfs-discuss?
Actual newsgroup for zfs-discuss? David ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
On 12/06/12 06:40 AM, David Combs wrote: Actual newsgroup for zfs-discuss? Actually, no. Where's the value in having a newsgroup as well as a mailing list? James C. McPherson -- Oracle http://www.jmcp.homeunix.com/blog ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
Advantages to true newsgroup? THREADS! If you wait until a thread is finished, you can then see the entire thread, and if you want, you can download the whole thing, or just parts thereof. Great for learning, if you're mostly a lurker, not posting answers. That's vastly simpler than getting a thousand emails, saving them all in a file, and then having to sort them by subject-line (modified so "RE:", etc are ignored in sort key), to get them grouped by zfs-topic. What a pain. When via a powerful newsreader (I use trn4), all of that is done for you automatically. Furthermore, at least one newsreader, trn4, via its "t" (tree) command, will draw a tree (rooted at the right side of the page, but the text oriented so you can read right-side-up, without turning your head sideways) so you can pursue topics, can see how they lay out, or better yet, delete, say, flame subthreads (surely not a problem with zfs-discuss). Besides that, you don't have posts hitting your regular email list, diluting the urgent stuff you really do have to respond to, making it easier to miss that stuff. Lets you keep newsgroup-TYPE stuff (eg zfs-discuss email) separate from true-email stuff. -- QUESTION: how much effort (for someone who already knows how, has done it before) to create a newsgroup that mirrors a listserv? Once done, all anyone has to do is request from his friendly isp (mine is panix.com, *very* friendly) to support that new newsgroup. Name it something like comp.unix.solaris.zfs. Or just have it all go to comp.unix.solaris, which of course already exists. Anyway, I hope I've answered your question. Cheers! David -Original Message- From: James C. McPherson [mailto:j...@opensolaris.org] Sent: Monday, June 11, 2012 4:55 PM To: David Combs Cc: zfs-discuss@opensolaris.org Subject: Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss? On 12/06/12 06:40 AM, David Combs wrote: > Actual newsgroup for zfs-discuss? Actually, no. Where's the value in having a newsgroup as well as a mailing list? James C. McPherson -- Oracle http://www.jmcp.homeunix.com/blog - No virus found in this message. Checked by AVG - www.avg.com Version: 2012.0.2178 / Virus Database: 2433/5062 - Release Date: 06/11/12 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
On 11 June, 2012 - David Combs sent me these 2,4K bytes:
> Advantages to true newsgroup?
>
> THREADS! If you wait until a thread is finished, you can then see the entire
> thread, and if you want, you can download the whole thing, or just parts
> thereof.
>
> Great for learning, if you're mostly a lurker, not posting answers.
>
> That's vastly simpler than getting a thousand emails, saving them all in a
> file, and then having to sort them by subject-line (modified so "RE:", etc
> are ignored in sort key), to get them grouped by zfs-topic. What a pain.
.. or use a mail reader that doesn't suck.
> When via a powerful newsreader (I use trn4), all of that is done for you
> automatically.
mutt is probably pretty close.
> Furthermore, at least one newsreader, trn4, via its "t" (tree) command, will
> draw a tree (rooted at the right side of the page, but the text oriented so
> you can read right-side-up, without turning your head sideways) so you can
> pursue topics, can see how they lay out, or better yet, delete, say, flame
> subthreads (surely not a problem with zfs-discuss).
>
> Besides that, you don't have posts hitting your regular email list, diluting
> the urgent stuff you really do have to respond to, making it easier to miss
> that stuff.
>
> Lets you keep newsgroup-TYPE stuff (eg zfs-discuss email) separate from
> true-email stuff.
It's called "mail filtering".
> --
>
> QUESTION: how much effort (for someone who already knows how, has done it
> before) to create a newsgroup that mirrors a listserv?
>
> Once done, all anyone has to do is request from his friendly isp (mine is
> panix.com, *very* friendly) to support that new newsgroup.
>
> Name it something like comp.unix.solaris.zfs.
>
> Or just have it all go to comp.unix.solaris, which of course already exists.
>
>
> Anyway, I hope I've answered your question.
>
> Cheers!
>
> David
>
>
> -Original Message-
> From: James C. McPherson [mailto:j...@opensolaris.org]
> Sent: Monday, June 11, 2012 4:55 PM
> To: David Combs
> Cc: zfs-discuss@opensolaris.org
> Subject: Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
>
> On 12/06/12 06:40 AM, David Combs wrote:
> > Actual newsgroup for zfs-discuss?
>
> Actually, no. Where's the value in having a newsgroup as well as a mailing
> list?
>
>
> James C. McPherson
> --
> Oracle
> http://www.jmcp.homeunix.com/blog
> -
> No virus found in this message.
Good to know, I better trust this info - just like spam that says it's
not spam :P
> Checked by AVG - www.avg.com
> Version: 2012.0.2178 / Virus Database: 2433/5062 - Release Date: 06/11/12
>
> ___
> zfs-discuss mailing list
> zfs-discuss@opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
/Tomas
--
Tomas Forsman, st...@acc.umu.se, http://www.acc.umu.se/~stric/
|- Student at Computing Science, University of Umeå
`- Sysadmin at {cs,acc}.umu.se
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
On Mon, Jun 11, 2012 at 5:05 PM, Tomas Forsman wrote: > .. or use a mail reader that doesn't suck. Or the mailman thread view. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
In message <008c01cd4812$7399c180$5acd4480$@net>, David Combs writes: >Actual newsgroup for zfs-discuss? Did you try Gmane's interface? http://groups.google.com/groups?selm=jo43q0%24no50%241%40tr22n12.aset.psu.edu> John groenv...@acm.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
Title: signature There is a ZFS Community on the Oracle Communities that was just kicked off this month - https://communities.oracle.com/portal/server.pt/community/oracle_solaris_zfs_file_system/526 Regards, Alan Hargreaves On 06/12/12 08:05, Tomas Forsman wrote: On 11 June, 2012 - David Combs sent me these 2,4K bytes: Advantages to true newsgroup? THREADS! If you wait until a thread is finished, you can then see the entire thread, and if you want, you can download the whole thing, or just parts thereof. Great for learning, if you're mostly a lurker, not posting answers. That's vastly simpler than getting a thousand emails, saving them all in a file, and then having to sort them by subject-line (modified so "RE:", etc are ignored in sort key), to get them grouped by zfs-topic. What a pain. .. or use a mail reader that doesn't suck. When via a powerful newsreader (I use trn4), all of that is done for you automatically. mutt is probably pretty close. Furthermore, at least one newsreader, trn4, via its "t" (tree) command, will draw a tree (rooted at the right side of the page, but the text oriented so you can read right-side-up, without turning your head sideways) so you can pursue topics, can see how they lay out, or better yet, delete, say, flame subthreads (surely not a problem with zfs-discuss). Besides that, you don't have posts hitting your regular email list, diluting the urgent stuff you really do have to respond to, making it easier to miss that stuff. Lets you keep newsgroup-TYPE stuff (eg zfs-discuss email) separate from true-email stuff. It's called "mail filtering". -- QUESTION: how much effort (for someone who already knows how, has done it before) to create a newsgroup that mirrors a listserv? Once done, all anyone has to do is request from his friendly isp (mine is panix.com, *very* friendly) to support that new newsgroup. Name it something like comp.unix.solaris.zfs. Or just have it all go to comp.unix.solaris, which of course already exists. Anyway, I hope I've answered your question. Cheers! David -Original Message- From: James C. McPherson [mailto:j...@opensolaris.org] Sent: Monday, June 11, 2012 4:55 PM To: David Combs Cc: zfs-discuss@opensolaris.org Subject: Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss? On 12/06/12 06:40 AM, David Combs wrote: Actual newsgroup for zfs-discuss? Actually, no. Where's the value in having a newsgroup as well as a mailing list? James C. McPherson -- Oracle http://www.jmcp.homeunix.com/blog - No virus found in this message. Good to know, I better trust this info - just like spam that says it's not spam :P Checked by AVG - www.avg.com Version: 2012.0.2178 / Virus Database: 2433/5062 - Release Date: 06/11/12 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss /Tomas -- Hardware and Software, Engineered to Work Together Alan Hargreaves | Senior Principal Technical Support Engineer | Principal Field Technologist Solaris and Networking | Global Systems Support Email: alan.hargrea...@oracle.com Blog: alanhargreaves.wordpress.com Phone: +61-2-9491-2342 | Mobile: +61-416-207-573 Oracle Global Customer Services Log, update, and monitor your Service Request online using My Oracle Support This message is cryptographically signed. Any modern mail reader should be able to verify that the message has been delivered unaltered since I sent it. smime.p7s Description: S/MIME Cryptographic Signature ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
You're describing primarily client differences, not server/service differences. Some people have been using the same tools for mail and for news for years, with the same benefits to each. Right now I'm posting through GMane's NNTP interface, only to show that you can. nntp://news.gmane.org/gmane.os.solaris.opensolaris.zfs . Normally I read it as a list (using mutt), because there I get the entire thread, and it's downloaded in full, whether I'm lurking or posting answers, and they're saved in a separate folder separate from my inbox, separate from my true-email stuff. And I don't have to use trn4! Gak, that was a horrible waste of trn3. On 6/11/12 4:55 PM, David Combs wrote: Advantages to true newsgroup? THREADS! If you wait until a thread is finished, you can then see the entire thread, and if you want, you can download the whole thing, or just parts thereof. Great for learning, if you're mostly a lurker, not posting answers. That's vastly simpler than getting a thousand emails, saving them all in a file, and then having to sort them by subject-line (modified so "RE:", etc are ignored in sort key), to get them grouped by zfs-topic. What a pain. When via a powerful newsreader (I use trn4), all of that is done for you automatically. Furthermore, at least one newsreader, trn4, via its "t" (tree) command, will draw a tree (rooted at the right side of the page, but the text oriented so you can read right-side-up, without turning your head sideways) so you can pursue topics, can see how they lay out, or better yet, delete, say, flame subthreads (surely not a problem with zfs-discuss). Besides that, you don't have posts hitting your regular email list, diluting the urgent stuff you really do have to respond to, making it easier to miss that stuff. Lets you keep newsgroup-TYPE stuff (eg zfs-discuss email) separate from true-email stuff. -- QUESTION: how much effort (for someone who already knows how, has done it before) to create a newsgroup that mirrors a listserv? Once done, all anyone has to do is request from his friendly isp (mine is panix.com, *very* friendly) to support that new newsgroup. Name it something like comp.unix.solaris.zfs. Or just have it all go to comp.unix.solaris, which of course already exists. Anyway, I hope I've answered your question. Cheers! David -Original Message- From: James C. McPherson [mailto:j...@opensolaris.org] Sent: Monday, June 11, 2012 4:55 PM To: David Combs Cc: zfs-discuss@opensolaris.org Subject: Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss? On 12/06/12 06:40 AM, David Combs wrote: Actual newsgroup for zfs-discuss? Actually, no. Where's the value in having a newsgroup as well as a mailing list? James C. McPherson -- Oracle http://www.jmcp.homeunix.com/blog - No virus found in this message. Checked by AVG - www.avg.com Version: 2012.0.2178 / Virus Database: 2433/5062 - Release Date: 06/11/12 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
On 6/11/12 3:12 PM, Alan Hargreaves wrote: There is a ZFS Community on the Oracle Communities that was just kicked off this month - https://communities.oracle.com/portal/server.pt/community/oracle_solaris_zfs_file_system/526 Thanks for the heads up, but it's just another horrid Oracle web UI with next to no functionality. Given that, I doubt it will have much participation. But I've been wrong before (I certainly won't be logging into Oracle's support portal every day to see what's new, that's for sure - email, RSS, ATOM, NNTP, _something_ other than polling manually in a browser...) (I'm amazed that a company that touts its server and database performance thinks it's fine and dandy PR to have customer logins take >20 seconds... nice to see that hasn't changed since the Sun days) -- Carson ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Is there an actual newsgroup for zfs-discuss?
On Tue, Jun 12, 2012 at 08:12:48AM +1000, Alan Hargreaves wrote: > There is a ZFS Community on the Oracle Communities that was just kicked > off this month - > https://communities.oracle.com/portal/server.pt/community/oracle_solaris_zfs_file_system/526 Ohh, another censored forum/crappy thing - no thanx! Regards, jel. -- Otto-von-Guericke University http://www.cs.uni-magdeburg.de/ Department of Computer Science Geb. 29 R 027, Universitaetsplatz 2 39106 Magdeburg, Germany Tel: +49 391 67 12768 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] Recovery of RAIDZ with broken label(s)
Hi all, I have a 5 drive RAIDZ volume with data that I'd like to recover. The long story runs roughly: 1) The volume was running fine under FreeBSD on motherboard SATA controllers. 2) Two drives were moved to a HP P411 SAS/SATA controller 3) I *think* the HP controllers wrote some volume information to the end of each disk (hence no more ZFS labels 2,3) 4) In its "auto configuration" wisdom, the HP controller built a mirrored volume using the two drives (and I think started the actual mirroring process). (Hence on at least on of the drives - a copied labels 0,1). 5) From there everything went downhill. This happened a while back, and so the exact order of things (including my botched attemtps at recovery) are hazy. I tried using Jeff Bonwick's labelfix binary to create new labels but it carps because the txg is not zero. The situation now is I have dd'd the drives onto a NAS. These images are shared via NFS to a VM running Oracle Solaris 11 11/11 X86. When I attempt to import the pool I get: root@solaris-01:/mnt# zpool import -d /dev/lofi pool: ZP-8T-RZ1-01 id: 9952605666247778346 state: FAULTED status: One or more devices contains corrupted data. action: The pool cannot be imported due to damaged devices or data. see: http://www.sun.com/msg/ZFS-8000-5E config: ZP-8T-RZ1-01 FAULTED corrupted data raidz1-0ONLINE 12339070507640025002 UNAVAIL corrupted data /dev/lofi/5 ONLINE /dev/lofi/4 ONLINE /dev/lofi/3 ONLINE /dev/lofi/1 ONLINE I'm not sure why I can't import although 4 of the 5 drives are "ONLINE". Can anyone please point me to a next step? I can also make the solaris machine available via SSH if some wonderful person wants to poke around. If I lose the data that's ok, but it'd be nice to know all avenues were tried before I delete the 9TB of images (I need the space...) Many thanks, Scott zfs-list at thismonkey dot com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
