Hello zfs-discuss,
Subject says it all.
I first checked - no IO activity at all to the pool named thumper-2.
So I started replacing one drive with 'zpool replace thumper-2 c7t7d0
c4t1d0'.
Now the question is why am I seeing writes to other disks than c7t7d0?
Also why in case of replacing a disk we do not just copy disk-to-disk?
It would be MUCH faster here. Probably 'coz we're traversing
meta-data? But perhaps it could be done in a clever way so we endup
just copying from one disk to another. Checking parity or checksum
here it's not necessary - scrub is for it. What we want in most cases
is to replace drive as fast as possible.
On another thumper I have a failing drive (port resets, etc.) so I
issued over a week ago drive replacement. Well it still hasn't
completed even 4% in a week! The pool config is the same. It's just
waaaay to slow and in a long term risky.
bash-3.00# zpool status
pool: thumper-2
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scrub: resilver in progress, 0,01% done, 350h29m to go
config:
NAME STATE READ WRITE CKSUM
thumper-2 ONLINE 0 0 0
raidz2 ONLINE 0 0 0
c0t0d0 ONLINE 0 0 0
c1t0d0 ONLINE 0 0 0
c4t0d0 ONLINE 0 0 0
c6t0d0 ONLINE 0 0 0
c7t0d0 ONLINE 0 0 0
c0t1d0 ONLINE 0 0 0
c1t1d0 ONLINE 0 0 0
c5t1d0 ONLINE 0 0 0
c6t1d0 ONLINE 0 0 0
c7t1d0 ONLINE 0 0 0
c0t2d0 ONLINE 0 0 0
raidz2 ONLINE 0 0 0
c1t2d0 ONLINE 0 0 0
c5t2d0 ONLINE 0 0 0
c6t2d0 ONLINE 0 0 0
c7t2d0 ONLINE 0 0 0
c0t4d0 ONLINE 0 0 0
c1t4d0 ONLINE 0 0 0
c4t4d0 ONLINE 0 0 0
c6t4d0 ONLINE 0 0 0
c7t4d0 ONLINE 0 0 0
c0t3d0 ONLINE 0 0 0
c1t3d0 ONLINE 0 0 0
raidz2 ONLINE 0 0 0
c4t3d0 ONLINE 0 0 0
c5t3d0 ONLINE 0 0 0
c6t3d0 ONLINE 0 0 0
c7t3d0 ONLINE 0 0 0
c0t5d0 ONLINE 0 0 0
c1t5d0 ONLINE 0 0 0
c4t5d0 ONLINE 0 0 0
c5t5d0 ONLINE 0 0 0
c6t5d0 ONLINE 0 0 0
c7t5d0 ONLINE 0 0 0
c0t6d0 ONLINE 0 0 0
raidz2 ONLINE 0 0 0
c1t6d0 ONLINE 0 0 0
c4t6d0 ONLINE 0 0 0
c5t6d0 ONLINE 0 0 0
c6t6d0 ONLINE 0 0 0
c7t6d0 ONLINE 0 0 0
c0t7d0 ONLINE 0 0 0
c1t7d0 ONLINE 0 0 0
c4t7d0 ONLINE 0 0 0
c5t7d0 ONLINE 0 0 0
c6t7d0 ONLINE 0 0 0
spare ONLINE 0 0 0
c7t7d0 ONLINE 0 0 0
c4t1d0 ONLINE 0 0 0
spares
c4t1d0 INUSE currently in use
c4t2d0 AVAIL
errors: No known data errors
pool: zones
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
zones ONLINE 0 0 0
mirror ONLINE 0 0 0
c5t0d0s4 ONLINE 0 0 0
c5t4d0s4 ONLINE 0 0 0
errors: No known data errors
bash-3.00#
# iostat -xnz 1
[...]
extended device statistics
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
114.0 0.0 7232.3 0.0 5.9 0.8 51.9 6.7 74 76 c0t0d0
132.0 0.0 8320.6 0.0 9.0 1.0 68.4 7.5 95 98 c6t0d0
123.0 0.0 7807.7 0.0 7.3 0.8 59.3 6.3 76 77 c7t0d0
115.0 0.0 7296.3 0.0 7.9 0.8 68.7 7.1 80 81 c4t0d0
100.0 0.0 6336.4 0.0 3.6 0.6 36.3 6.0 56 60 c6t1d0
0.0 297.0 0.0 151.0 0.0 0.0 0.0 0.2 0 5 c4t1d0
106.0 0.0 6720.3 0.0 5.3 0.6 50.0 6.1 63 65 c7t1d0
122.0 0.0 7743.7 0.0 6.9 0.7 56.8 6.0 72 73 c0t1d0
120.0 0.0 7679.2 0.0 5.6 0.7 46.9 5.7 66 68 c1t1d0
4.0 0.0 129.5 0.0 0.0 0.0 0.0 4.8 0 2 c1t2d0
3.0 0.0 65.5 0.0 0.0 0.0 3.0 6.4 1 2 c7t2d0
109.0 0.0 6912.3 0.0 6.6 0.7 60.7 6.1 65 66 c0t2d0
74.0 0.0 4672.5 0.0 2.4 0.5 31.9 6.7 45 49 c4t3d0
5.0 0.0 130.0 0.0 0.0 0.0 0.8 7.4 0 4 c0t3d0
82.0 0.0 5121.5 0.0 2.6 0.5 31.9 6.3 49 52 c7t3d0
3.0 0.0 65.5 0.0 0.0 0.0 1.0 5.4 0 2 c0t4d0
4.0 0.0 130.0 0.0 0.0 0.0 0.0 5.4 0 2 c4t4d0
5.0 0.0 130.5 0.0 0.0 0.0 1.2 6.1 1 3 c7t4d0
66.0 0.0 4097.6 0.0 1.7 0.4 25.5 6.2 37 41 c0t5d0
60.0 0.0 3650.6 0.0 1.4 0.4 24.0 6.1 34 37 c4t5d0
54.0 0.0 3266.2 0.0 1.3 0.3 24.0 6.4 31 35 c7t5d0
69.0 0.0 4289.1 0.0 2.2 0.4 32.6 6.3 40 43 c0t6d0
0.0 296.0 0.0 150.0 0.0 0.0 0.0 0.1 0 4 c4t6d0
0.0 296.0 0.0 150.0 0.0 0.0 0.0 0.1 0 4 c7t6d0
5.0 0.0 130.0 0.0 0.0 0.0 1.2 3.7 1 2 c6t2d0
0.0 289.0 0.0 147.0 0.0 0.0 0.0 0.1 0 4 c0t7d0
0.0 298.0 0.0 152.0 0.0 0.0 0.0 0.1 0 4 c4t7d0
0.0 297.0 0.0 151.0 0.0 0.0 0.0 0.1 0 4 c7t7d0
111.0 0.0 7103.3 0.0 5.7 0.7 51.1 6.3 66 70 c5t1d0
78.0 0.0 4802.0 0.0 2.3 0.5 28.9 6.2 46 48 c6t3d0
5.0 0.0 130.5 0.0 0.0 0.0 0.0 6.4 0 3 c5t2d0
5.0 0.0 131.0 0.0 0.0 0.0 1.0 6.4 0 3 c6t4d0
4.0 0.0 129.5 0.0 0.0 0.0 0.7 3.6 0 1 c1t3d0
70.0 0.0 4353.6 0.0 2.0 0.5 28.0 6.5 42 45 c5t3d0
57.0 0.0 3458.6 0.0 1.3 0.4 23.6 6.4 33 36 c6t5d0
4.0 0.0 130.0 0.0 0.0 0.0 0.0 4.2 0 2 c1t4d0
0.0 290.0 0.0 147.5 0.0 0.0 0.0 0.1 0 4 c6t6d0
64.0 0.0 3906.6 0.0 1.4 0.4 22.6 6.2 36 40 c1t5d0
0.0 292.0 0.0 148.5 0.0 0.0 0.0 0.2 0 4 c1t6d0
62.0 0.0 3778.6 0.0 1.7 0.4 26.9 6.1 35 38 c5t5d0
0.0 285.0 0.0 144.5 0.0 0.0 0.0 0.1 0 4 c1t7d0
0.0 292.0 0.0 147.5 0.0 0.0 0.0 0.1 0 4 c5t6d0
0.0 300.0 0.0 152.5 0.0 0.0 0.0 0.2 0 5 c5t7d0
0.0 294.0 0.0 150.0 0.0 0.0 0.0 0.1 0 4 c6t7d0
112.0 0.0 7104.3 0.0 5.6 0.7 50.3 6.1 66 68 c1t0d0
bash-3.00# zpool iostat 1
capacity operations bandwidth
pool used avail read write read write
---------- ----- ----- ----- ----- ----- -----
thumper-2 15,5T 4,54T 226 64 1,34M 401K
zones 16,6G 423G 0 0 8,13K 22,6K
---------- ----- ----- ----- ----- ----- -----
thumper-2 15,5T 4,54T 512 418 1,57M 1,24M
zones 16,6G 423G 0 0 0 0
---------- ----- ----- ----- ----- ----- -----
thumper-2 15,5T 4,54T 607 402 1,83M 1,21M
zones 16,6G 423G 0 0 0 0
---------- ----- ----- ----- ----- ----- -----
thumper-2 15,5T 4,54T 399 446 1,23M 1,32M
zones 16,6G 423G 0 0 0 0
---------- ----- ----- ----- ----- ----- -----
thumper-2 15,5T 4,54T 175 430 547K 1,30M
zones 16,6G 423G 0 0 0 0
---------- ----- ----- ----- ----- ----- -----
^C
bash-3.00#
--
Best regards,
Robert mailto:[EMAIL PROTECTED]
http://milek.blogspot.com
_______________________________________________
zfs-discuss mailing list
[email protected]
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
