We are experiencing a problem with performance on our storage pool. We created
a 10TB lun but we are experiencing slow write speeds.
1 large zfs pool containing 6 raidz2 stripes of 6 drives a piece from a PAC
storage unit. The PAC drives are a raid 0 strip of 4 1TB drives due to a
limitation of the PAC storage unit (no JBOD and a limit on how many raid 0
stripes we can have). We have a total of 144 drives or 36 raid 0 stripes in the
zfs pool. ugh, very confusing.
I think we are hitting a bottleneck with the raid 0 stripes.
ad...@comstar1.otc.edu:/var/log# zpool iostat PACMAN 1
capacity operations bandwidth
pool alloc free read write read write
---------- ----- ----- ----- ----- ----- -----
PACMAN 14.4T 115T 12 1.45K 104K 185M
PACMAN 14.4T 115T 0 1.53K 7.98K 195M
PACMAN 14.4T 115T 0 1.57K 0 199M
PACMAN 14.4T 115T 90 1.18K 724K 150M
device r/s w/s Mr/s Mw/s wait actv svc_t %w %b
sd1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0
sd2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0
sd111 0.0 57.1 0.0 6.6 0.7 8.6 161.6 66 100
sd112 0.0 47.0 0.0 5.9 2.4 6.9 199.0 94 100
sd113 0.0 11.2 0.0 1.4 8.9 1.0 885.2 100 100
sd114 3.4 66.1 0.0 1.2 0.0 9.1 130.6 0 100
sd115 3.4 76.2 0.0 1.8 0.0 9.0 113.6 0 100
sd116 3.4 70.6 0.0 1.9 0.0 9.1 123.3 0 100
sd117 0.0 66.1 0.0 1.8 0.6 8.5 138.4 64 100
sd118 0.0 71.7 0.0 2.0 0.0 8.9 124.8 0 100
sd119 3.4 58.2 0.0 2.1 0.6 8.5 148.3 63 100
sd120 0.0 72.8 0.0 1.9 0.0 9.3 127.2 0 100
sd121 0.0 72.8 0.0 1.9 0.0 8.9 122.5 0 100
sd122 0.0 73.9 0.0 2.0 0.0 8.8 119.3 0 100
sd123 0.0 72.8 0.0 1.9 0.0 9.0 124.2 0 100
sd124 0.0 77.3 0.0 2.4 0.0 8.8 114.1 0 100
sd125 0.0 59.4 0.0 0.8 0.0 9.1 153.0 0 100
sd126 0.0 62.7 0.0 7.3 1.4 7.9 148.3 81 100
sd127 0.0 67.2 0.0 6.7 0.0 9.2 136.5 0 100
sd128 1.1 31.4 0.1 3.9 4.4 5.0 290.6 98 100
sd129 0.0 69.4 0.0 7.3 0.6 8.5 129.8 56 100
sd130 0.0 69.4 0.0 8.1 0.6 8.7 133.6 60 100
sd131 0.0 69.4 0.0 7.3 0.0 9.0 129.8 0 100
sd132 0.0 70.6 0.0 7.5 0.0 9.0 127.7 0 100
sd133 0.0 65.0 0.0 6.7 0.0 9.0 138.6 0 100
sd134 0.0 67.2 0.0 7.7 0.0 9.0 133.6 0 100
sd135 0.0 113.1 0.0 8.2 0.0 5.5 48.4 0 85
sd136 4.5 115.4 0.1 8.2 0.0 5.1 42.2 0 81
sd137 3.4 117.6 0.1 8.1 0.0 5.3 43.7 0 89
sd138 3.4 99.7 0.1 8.2 0.0 5.4 52.1 0 85
sd139 4.5 118.7 0.1 8.1 0.0 5.7 46.6 0 85
sd140 0.0 117.6 0.0 8.2 0.0 5.4 46.3 0 85
sd141 3.4 98.6 0.2 7.9 0.0 4.1 39.9 0 85
sd142 3.4 105.3 0.2 8.2 0.0 4.4 40.5 0 86
sd143 3.4 112.0 0.2 8.1 0.0 5.2 45.3 1 85
sd144 0.0 101.9 0.0 8.1 0.0 4.7 46.1 0 82
sd145 0.0 100.8 0.0 7.9 0.0 4.4 44.1 0 82
sd146 3.4 103.0 0.2 7.9 0.0 4.4 41.5 0 83
ad...@comstar1.otc.edu:/var/log# zpool status
pool: PACMAN
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
PACMAN ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000006Ad0 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000006Bd0 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000006Cd0 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000006Dd0 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000006Ed0 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000006Fd0 ONLINE 0 0 0
raidz2-1 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000007Ad0 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000007Bd0 ONLINE 0 0 0
c11t60050CC000F01A8E000000000000007Cd0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000065d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000066d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000067d0 ONLINE 0 0 0
raidz2-2 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000068d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000069d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000070d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000071d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000072d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000073d0 ONLINE 0 0 0
raidz2-3 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000074d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000075d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000076d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000077d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000078d0 ONLINE 0 0 0
c11t60050CC000F01A8E0000000000000079d0 ONLINE 0 0 0
raidz2-4 ONLINE 0 0 0
c11t60050CC000F01AC6000000000000003Ad0 ONLINE 0 0 0
c11t60050CC000F01AC6000000000000003Bd0 ONLINE 0 0 0
c11t60050CC000F01AC6000000000000003Cd0 ONLINE 0 0 0
c11t60050CC000F01AC6000000000000003Dd0 ONLINE 0 0 0
c11t60050CC000F01AC6000000000000003Ed0 ONLINE 0 0 0
c11t60050CC000F01AC6000000000000003Fd0 ONLINE 0 0 0
raidz2-5 ONLINE 0 0 0
c11t60050CC000F01AC60000000000000034d0 ONLINE 0 0 0
c11t60050CC000F01AC60000000000000035d0 ONLINE 0 0 0
c11t60050CC000F01AC60000000000000036d0 ONLINE 0 0 0
c11t60050CC000F01AC60000000000000037d0 ONLINE 0 0 0
c11t60050CC000F01AC60000000000000038d0 ONLINE 0 0 0
c11t60050CC000F01AC60000000000000039d0 ONLINE 0 0 0
errors: No known data errors
pool: rpool
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
rpool ONLINE 0 0 0
c4t0d0s0 ONLINE 0 0 0
errors: No known data errors
--
This message posted from opensolaris.org
_______________________________________________
storage-discuss mailing list
storage-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
