Re: [zfs-discuss] A resilver record?

2011-03-29 Thread Roy Sigurd Karlsbakk
In my case we do not have the bandwidth to do a FULL send/recv, it would take weeks. I'm not 100% sure how the data would end up (whether de-fragmentation would be achieved), but could you do a rend/receive to a new filesystem on the same host? You could, but doing so on the same pool

Re: [zfs-discuss] A resilver record?

2011-03-28 Thread Paul Kraus
On Thu, Mar 24, 2011 at 7:07 AM, Edward Ned Harvey opensolarisisdeadlongliveopensola...@nedharvey.com wrote: When you have a backup server, which does nothing but zfs receive, that's probably your best case scenario.  Because the data is as nonvolatile as possible.  But indeed, because all the

Re: [zfs-discuss] A resilver record?

2011-03-28 Thread Ian Collins
On 03/29/11 02:52 AM, Paul Kraus wrote: On Thu, Mar 24, 2011 at 7:07 AM, Edward Ned Harvey opensolarisisdeadlongliveopensola...@nedharvey.com wrote: When you have a backup server, which does nothing but zfs receive, that's probably your best case scenario. Because the data is as nonvolatile

Re: [zfs-discuss] A resilver record?

2011-03-24 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Giovanni Tirloni We've production servers with 9 vdev's (mirrored) doing `zfs send` daily to backup servers with with 7 vdev's (each 3-disk raidz1). Some backup servers that receive datasets

Re: [zfs-discuss] A resilver record?

2011-03-23 Thread Giovanni Tirloni
On Mon, Mar 21, 2011 at 3:45 PM, Roy Sigurd Karlsbakk r...@karlsbakk.net wrote: Our main backups storage server has 3x 8-drive raidz2 vdevs. Was replacing the 500 GB drives in one vdev with 1 TB drives. The last 2 drives took just under 300 hours each. :( The first couple drives took

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Richard Elling How many times do we have to rehash this? The speed of resilver is dependent on the amount of data, the distribution of data on the resilvering device, speed of the

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Edward Ned Harvey it depends on the total number of used blocks that must be resilvered on the resilvering device, multiplied by the access time for the resilvering device. It is a safe

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Paul Kraus
On Sun, Mar 20, 2011 at 7:20 PM, Richard Elling richard.ell...@gmail.com wrote: On Mar 20, 2011, at 3:02 PM, Ian Collins wrote: On 03/20/11 08:57 PM, Ian Collins wrote: Has anyone seen a resilver longer than this for a 500G drive in a riadz2 vdev? scrub: resilver completed after 169h25m

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Freddie Cash
On Sun, Mar 20, 2011 at 12:57 AM, Ian Collins i...@ianshome.com wrote:  Has anyone seen a resilver longer than this for a 500G drive in a riadz2 vdev? scrub: resilver completed after 169h25m with 0 errors on Sun Mar 20 19:57:37 2011              c0t0d0  ONLINE       0     0     0  769G

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Roy Sigurd Karlsbakk
The 30+ second latency I see on this system during a resilver renders it pretty useless as a staging server (lots of small snapshots). I've seen similar numbers on a system during resilver, without L2ARC/SLOG. Adding L2ARC/SLOG made the system work quite well during resilver/scrub, but

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Roy Sigurd Karlsbakk
Our main backups storage server has 3x 8-drive raidz2 vdevs. Was replacing the 500 GB drives in one vdev with 1 TB drives. The last 2 drives took just under 300 hours each. :( The first couple drives took approx 150 hours each, and then it just started taking longer and longer for each drive.

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Paul Kraus Is resilver time related to the amount of data (TBs) or the number of objects (file + directory counts) ? I have seen zpools with lots of data in very few files resilver

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Ian Collins
On 03/22/11 10:39 AM, Edward Ned Harvey wrote: So the conclusion to draw is: Yes, there are situations where ZFS resilver is a strength, and limited by serial throughput. But for what I call typical usage patterns, it's a weakness, and it's dramatically much worse than resilvering the whole

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Richard Elling
On Mar 21, 2011, at 5:09 AM, Edward Ned Harvey wrote: From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Richard Elling How many times do we have to rehash this? The speed of resilver is dependent on the amount of data, the distribution of

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Richard Elling
On Mar 21, 2011, at 5:32 AM, Edward Ned Harvey wrote: From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Edward Ned Harvey it depends on the total number of used blocks that must be resilvered on the resilvering device, multiplied by the

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Erik Trimble
On 3/21/2011 3:25 PM, Richard Elling wrote: On Mar 21, 2011, at 5:09 AM, Edward Ned Harvey wrote: From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Richard Elling How many times do we have to rehash this? The speed of resilver is dependent on

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Edward Ned Harvey
From: Richard Elling [mailto:richard.ell...@gmail.com] There is no direct correlation between the number of blocks and resilver time. Incorrect. Although there are possibly some cases where you could be bandwidth limited, it's certainly not true in general. If Richard were correct, then a

Re: [zfs-discuss] A resilver record?

2011-03-21 Thread Richard Elling
[richard tries pushing the rope one more time] On Mar 21, 2011, at 8:40 PM, Edward Ned Harvey wrote: From: Richard Elling [mailto:richard.ell...@gmail.com] There is no direct correlation between the number of blocks and resilver time. Incorrect. Although there are possibly some cases

[zfs-discuss] A resilver record?

2011-03-20 Thread Ian Collins
Has anyone seen a resilver longer than this for a 500G drive in a riadz2 vdev? scrub: resilver completed after 169h25m with 0 errors on Sun Mar 20 19:57:37 2011 c0t0d0 ONLINE 0 0 0 769G resilvered and I told the client it would take 3 to 4 days! :) -- Ian.

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread Roy Sigurd Karlsbakk
Has anyone seen a resilver longer than this for a 500G drive in a riadz2 vdev? scrub: resilver completed after 169h25m with 0 errors on Sun Mar 20 19:57:37 2011 c0t0d0 ONLINE 0 0 0 769G resilvered and I told the client it would take 3 to 4 days! It all depends on the number of drives in

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread taemun
769G resilvered on a 500G drive? I'm guessing there was a whole bunch of activity (and probably snapshot creation) happening alongside the resilver. On 20 March 2011 18:57, Ian Collins i...@ianshome.com wrote: Has anyone seen a resilver longer than this for a 500G drive in a riadz2 vdev?

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread Roy Sigurd Karlsbakk
It all depends on the number of drives in the VDEV(s), traffic patterns during resilver, speed VDEV fill, of drives etc. Still, close to 6 days is a lot. Can you detail your configuration? How many times do we have to rehash this? The speed of resilver is dependent on the amount of data,

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread David Magda
On Mar 20, 2011, at 14:24, Roy Sigurd Karlsbakk wrote: It all depends on the number of drives in the VDEV(s), traffic patterns during resilver, speed VDEV fill, of drives etc. Still, close to 6 days is a lot. Can you detail your configuration? How many times do we have to rehash this? The

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread Roy Sigurd Karlsbakk
I think maybe the number of drives in the vdev perhaps come into play because that when people have a lot of disks, they often put them into RAIDZ[123] configurations. So it's just a matter of confusing the (IOps limiting) configuration with the fact that one may have many disks. My answer

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread Richard Elling
On Mar 20, 2011, at 12:48 PM, David Magda wrote: On Mar 20, 2011, at 14:24, Roy Sigurd Karlsbakk wrote: It all depends on the number of drives in the VDEV(s), traffic patterns during resilver, speed VDEV fill, of drives etc. Still, close to 6 days is a lot. Can you detail your configuration?

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread Ian Collins
On 03/20/11 08:57 PM, Ian Collins wrote: Has anyone seen a resilver longer than this for a 500G drive in a riadz2 vdev? scrub: resilver completed after 169h25m with 0 errors on Sun Mar 20 19:57:37 2011 c0t0d0 ONLINE 0 0 0 769G resilvered I didn't intend to

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread David Magda
On Mar 20, 2011, at 18:02, Ian Collins wrote: I didn't intend to start an argument, I was just very surprised the resilver took so long. ZFS is a relatively young file system, and it does a lot of things differently than what has been done in the past. Personally I think arguments / debates

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread Richard Elling
On Mar 20, 2011, at 3:02 PM, Ian Collins wrote: On 03/20/11 08:57 PM, Ian Collins wrote: Has anyone seen a resilver longer than this for a 500G drive in a riadz2 vdev? scrub: resilver completed after 169h25m with 0 errors on Sun Mar 20 19:57:37 2011 c0t0d0 ONLINE 0

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread Ian Collins
On 03/21/11 12:20 PM, Richard Elling wrote: On Mar 20, 2011, at 3:02 PM, Ian Collins wrote: On 03/20/11 08:57 PM, Ian Collins wrote: Has anyone seen a resilver longer than this for a 500G drive in a riadz2 vdev? scrub: resilver completed after 169h25m with 0 errors on Sun Mar 20 19:57:37

Re: [zfs-discuss] A resilver record?

2011-03-20 Thread Erik Trimble
On 3/20/2011 2:23 PM, Richard Elling wrote: On Mar 20, 2011, at 12:48 PM, David Magda wrote: On Mar 20, 2011, at 14:24, Roy Sigurd Karlsbakk wrote: It all depends on the number of drives in the VDEV(s), traffic patterns during resilver, speed VDEV fill, of drives etc. Still, close to 6 days