Thanks Brandon for your reply. I verified the configuration was set correctly
according to your note.
# stmfadm list-lu -v
LU Name: 600144F09633E90700004BE849550002
Operational Status: Online
Provider Name : sbd
Alias : /dev/zvol/rdsk/biodata/newiscsitest
View Entry Count : 1
Data File : /dev/zvol/rdsk/biodata/newiscsitest
Meta File : not set
Size : 107374182400
Block Size : 512
Management URL : not set
Vendor ID : SUN
Product ID : COMSTAR
Serial Num : not set
Write Protect : Disabled
Writeback Cache : Enabled
Access State : Active
I am a bit confused on how the ZIL works. I added a disk to my zpool as a log
device, this way I should be able to isolate the disk activity associated with
the ZIL. I then monitored this disk I/O using iostat -nxzTd while I performed 3
write tests:
1. iSCSI mounted volume using COMSTAR environment
2. iSCSI mounted volume using the iscsitgt daemon (old iscsi environment)
3. local ZFS filesstem.
I simply used dd to create a 1 GB file using small block size to slow the IO
down:
dd if=/dev/zero of=comstartest bs=128 count=8388608
During test 1 and 3 I see no write activity to the log device - there is a
little read activity but no write activity.
During test 2 I see a steady 5 MB/s write activity to the log device. This is
what I expected for all 3 tests.
So why don't I see any log activity for the other 2 tests.
I have attached a text file which shows my work.
Thanks,
Jon
--
This message posted from opensolaris.orgComparing ZIL activity between the patched iscsitgt daemon, COMSTAR iscsi
target and
a ZFS volume.
Comments are highlighted with -----
First the COMSTAR iscsi target
------------------------------
----- Configuration:
----- Things to note in configuration
----- - c7t7d0 is the log device for the biodata zpool
----- - c0t0d0 is one of the disks in the zpool
----- - the path to the iscsi volume is dev/zvol/rdsk/biodata/newiscsitest
----- - writeback cache is enabled
target # zpool status
pool: biodata
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
biodata ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
c0t0d0 ONLINE 0 0 0
c1t0d0 ONLINE 0 0 0
c6t0d0 ONLINE 0 0 0
c7t1d0 ONLINE 0 0 0
c8t0d0 ONLINE 0 0 0
c9t0d0 ONLINE 0 0 0
c0t1d0 ONLINE 0 0 0
c1t1d0 ONLINE 0 0 0
c6t1d0 ONLINE 0 0 0
c8t1d0 ONLINE 0 0 0
c9t1d0 ONLINE 0 0 0
raidz2-1 ONLINE 0 0 0
c0t2d0 ONLINE 0 0 0
c1t2d0 ONLINE 0 0 0
c6t2d0 ONLINE 0 0 0
c7t2d0 ONLINE 0 0 0
c8t2d0 ONLINE 0 0 0
c9t2d0 ONLINE 0 0 0
c0t3d0 ONLINE 0 0 0
c1t3d0 ONLINE 0 0 0
c6t3d0 ONLINE 0 0 0
c8t3d0 ONLINE 0 0 0
c9t3d0 ONLINE 0 0 0
raidz2-2 ONLINE 0 0 0
c0t4d0 ONLINE 0 0 0
c1t4d0 ONLINE 0 0 0
c6t4d0 ONLINE 0 0 0
c7t3d0 ONLINE 0 0 0
c8t4d0 ONLINE 0 0 0
c9t4d0 ONLINE 0 0 0
c0t5d0 ONLINE 0 0 0
c1t5d0 ONLINE 0 0 0
c6t5d0 ONLINE 0 0 0
c8t5d0 ONLINE 0 0 0
c9t5d0 ONLINE 0 0 0
raidz2-3 ONLINE 0 0 0
c0t6d0 ONLINE 0 0 0
c1t6d0 ONLINE 0 0 0
c6t6d0 ONLINE 0 0 0
c7t5d0 ONLINE 0 0 0
c8t6d0 ONLINE 0 0 0
c9t6d0 ONLINE 0 0 0
c0t7d0 ONLINE 0 0 0
c1t7d0 ONLINE 0 0 0
c6t7d0 ONLINE 0 0 0
c8t7d0 ONLINE 0 0 0
c9t7d0 ONLINE 0 0 0
logs
c7t7d0 ONLINE 0 0 0
spares
c7t6d0 AVAIL
target # stmfadm list-lu -v
LU Name: 600144F09633E90700004BE849550002
Operational Status: Online
Provider Name : sbd
Alias : /dev/zvol/rdsk/biodata/newiscsitest
View Entry Count : 1
Data File : /dev/zvol/rdsk/biodata/newiscsitest
Meta File : not set
Size : 107374182400
Block Size : 512
Management URL : not set
Vendor ID : SUN
Product ID : COMSTAR
Serial Num : not set
Write Protect : Disabled
Writeback Cache : Enabled
Access State : Active
target # itadm list-target -v
TARGET NAME STATE SESSIONS
iqn.1986-03.com.sun:02:f238fd00-5dc5-6813-dac2-ddea8c78da41 online 2
alias: -
auth: chap
targetchapuser: wam3
targetchapsecret: set
tpg-tags: default
initiator # iscsiadm list target -v
Target: iqn.1986-03.com.sun:02:f238fd00-5dc5-6813-dac2-ddea8c78da41
Alias: -
TPGT: 1
ISID: 4000002a0001
Connections: 1
CID: 1
IP address (Local): 172.31.10.185:32769
IP address (Peer): 172.31.10.117:3260
Discovery Method: Static
Login Parameters (Negotiated):
Data Sequence In Order: yes
Data PDU In Order: yes
Default Time To Retain: 20
Default Time To Wait: 2
Error Recovery Level: 0
First Burst Length: 65536
Immediate Data: yes
Initial Ready To Transfer (R2T): yes
Max Burst Length: 262144
Max Outstanding R2T: 1
Max Receive Data Segment Length: 32768
Max Connections: 1
Header Digest: NONE
Data Digest: NONE
Target: iqn.1986-03.com.sun:02:f238fd00-5dc5-6813-dac2-ddea8c78da41
Alias: -
TPGT: 1
ISID: 4000002a0000
Connections: 1
CID: 0
IP address (Local): 172.31.10.184:32770
IP address (Peer): 172.31.10.118:3260
Discovery Method: Static
Login Parameters (Negotiated):
Data Sequence In Order: yes
Data PDU In Order: yes
Default Time To Retain: 20
Default Time To Wait: 2
Error Recovery Level: 0
First Burst Length: 65536
Immediate Data: yes
Initial Ready To Transfer (R2T): yes
Max Burst Length: 262144
Max Outstanding R2T: 1
Max Receive Data Segment Length: 32768
Max Connections: 1
Header Digest: NONE
Data Digest: NONE
initiator # iscsiadm list target -S
Target: iqn.1986-03.com.sun:02:f238fd00-5dc5-6813-dac2-ddea8c78da41
Alias: -
TPGT: 1
ISID: 4000002a0001
Connections: 1
LUN: 0
Vendor: SUN
Product: COMSTAR
OS Device Name: /dev/rdsk/c2t600144F09633E90700004BE849550002d0s2
Target: iqn.1986-03.com.sun:02:f238fd00-5dc5-6813-dac2-ddea8c78da41
Alias: -
TPGT: 1
ISID: 4000002a0000
Connections: 1
LUN: 0
Vendor: SUN
Product: COMSTAR
OS Device Name: /dev/rdsk/c2t600144F09633E90700004BE849550002d0s2
----- Now lets dump a 1 GB file to it.
----- Note about my test: I am writting 1 1GB file using extremely small block
size (128 bytes)
----- This is to slow the traffic down so the test runs longer.
initiator # mount /dev/dsk/c2t600144F09633E90700004BE849550002d0s2
/disktesting/wam3
initiator # cd /disktesting/wam3
initiator # date ; dd if=/dev/zero of=comstartest8 bs=128 count=8388608 ; date
Fri May 14 13:54:15 EDT 2010
8388608+0 records in
8388608+0 records out
Fri May 14 13:58:14 EDT 2010
initiator # du -sh comstartest8
1.0G comstartest8
----- So now lets look at the disk I/O traffic. During the dump I captured disk
I/O
----- using the command iostat -nxzTd 5 1000. Here I grep out the date - to
show time,
----- c0t0d0 - a disk inside the pool, and c7t7d0 - the log device for the pool
(ZIL)
----- These are the headings for the output
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
target # /usr/xpg4/bin/grep -e May -e c7t7d0 -e c0t0d0
iostat-comstar-test-may14
Fri May 14 13:54:08 EDT 2010
Fri May 14 13:54:13 EDT 2010
Fri May 14 13:54:18 EDT 2010
Fri May 14 13:54:23 EDT 2010
Fri May 14 13:54:28 EDT 2010
Fri May 14 13:54:33 EDT 2010
0.0 118.6 0.0 497.6 0.0 0.1 0.0 1.2 0 2 c0t0d0
Fri May 14 13:54:38 EDT 2010
1.2 0.4 15.5 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
Fri May 14 13:54:43 EDT 2010
0.8 0.0 16.9 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
Fri May 14 13:54:48 EDT 2010
Fri May 14 13:54:53 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c7t7d0
Fri May 14 13:54:58 EDT 2010
Fri May 14 13:55:03 EDT 2010
0.0 164.4 0.0 723.7 0.0 0.2 0.0 1.3 0 3 c0t0d0
Fri May 14 13:55:08 EDT 2010
Fri May 14 13:55:13 EDT 2010
Fri May 14 13:55:18 EDT 2010
Fri May 14 13:55:23 EDT 2010
Fri May 14 13:55:28 EDT 2010
Fri May 14 13:55:33 EDT 2010
0.0 191.8 0.0 812.3 0.0 0.3 0.0 1.3 0 4 c0t0d0
Fri May 14 13:55:38 EDT 2010
Fri May 14 13:55:43 EDT 2010
Fri May 14 13:55:48 EDT 2010
Fri May 14 13:55:53 EDT 2010
Fri May 14 13:55:58 EDT 2010
Fri May 14 13:56:03 EDT 2010
3.6 195.4 39.2 814.5 0.0 0.2 0.0 1.2 0 4 c0t0d0
1.6 0.8 6.8 0.0 0.0 0.0 0.0 0.0 0 0 c7t7d0
Fri May 14 13:56:08 EDT 2010
Fri May 14 13:56:13 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c7t7d0
Fri May 14 13:56:18 EDT 2010
Fri May 14 13:56:23 EDT 2010
Fri May 14 13:56:28 EDT 2010
Fri May 14 13:56:33 EDT 2010
0.0 172.6 0.0 748.6 0.0 0.2 0.0 1.4 0 4 c0t0d0
Fri May 14 13:56:38 EDT 2010
Fri May 14 13:56:43 EDT 2010
Fri May 14 13:56:48 EDT 2010
Fri May 14 13:56:53 EDT 2010
Fri May 14 13:56:58 EDT 2010
Fri May 14 13:57:03 EDT 2010
0.0 182.0 0.0 773.4 0.0 0.3 0.0 1.6 0 4 c0t0d0
Fri May 14 13:57:08 EDT 2010
Fri May 14 13:57:13 EDT 2010
Fri May 14 13:57:18 EDT 2010
Fri May 14 13:57:23 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
Fri May 14 13:57:28 EDT 2010
Fri May 14 13:57:33 EDT 2010
0.0 205.2 0.0 814.6 0.0 0.2 0.0 1.1 0 4 c0t0d0
Fri May 14 13:57:38 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c7t7d0
Fri May 14 13:57:43 EDT 2010
Fri May 14 13:57:48 EDT 2010
Fri May 14 13:57:53 EDT 2010
Fri May 14 13:57:58 EDT 2010
Fri May 14 13:58:03 EDT 2010
0.0 174.2 0.0 812.9 0.0 0.2 0.0 1.4 0 4 c0t0d0
Fri May 14 13:58:08 EDT 2010
Fri May 14 13:58:13 EDT 2010
Fri May 14 13:58:18 EDT 2010
Fri May 14 13:58:23 EDT 2010
Fri May 14 13:58:28 EDT 2010
Fri May 14 13:58:33 EDT 2010
0.0 59.8 0.0 305.5 0.0 0.1 0.0 1.9 0 2 c0t0d0
Fri May 14 13:58:38 EDT 2010
Fri May 14 13:58:43 EDT 2010
Fri May 14 13:58:48 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
Fri May 14 13:58:53 EDT 2010
Fri May 14 13:58:58 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c7t7d0
Fri May 14 13:59:03 EDT 2010
Fri May 14 13:59:08 EDT 2010
----- So my read on this is no wirte activity to c7t7d0 (log/ZIL) but there is
a little
----- read activity. Write activity to the pool every 30 seconds or so.
Now the patched iscsitgt daemon - currently used in solaris 10
---------------------------------------------------------------
----- Configuration:
----- Same zpool as previous test with c7t7d0 as log and c0t0d0 as a disk in
pool
target # iscsitadm list target -v
Target: biodata/oldiscsitest
iSCSI Name: iqn.1986-03.com.sun:02:4517bf94-6129-46b3-cca4-9aa954802286
Alias: biodata/oldiscsitest
Connections: 2
Initiator:
iSCSI Name: iqn.1986-03.com.sun:01:00144f1dd41c.49ac0d8f
Alias: none
Initiator:
iSCSI Name: iqn.1986-03.com.sun:01:00144f1dd41c.49ac0d8f
Alias: none
ACL list:
Initiator: burwell
TPGT list:
TPGT: 1
LUN information:
LUN: 0
GUID: 600144f04be83b650000000000000000
VID: SUN
PID: SOLARIS
Type: disk
Size: 100G
Backing store: /dev/zvol/rdsk/biodata/oldiscsitest
Status: online
initiator # iscsiadm list target -v
Target: iqn.1986-03.com.sun:02:4517bf94-6129-46b3-cca4-9aa954802286
Alias: biodata/oldiscsitest
TPGT: 1
ISID: 4000002a0001
Connections: 1
CID: 0
IP address (Local): 172.31.10.185:41385
IP address (Peer): 172.31.10.117:3260
Discovery Method: Static
Login Parameters (Negotiated):
Data Sequence In Order: yes
Data PDU In Order: yes
Default Time To Retain: 20
Default Time To Wait: 2
Error Recovery Level: 0
First Burst Length: 65536
Immediate Data: yes
Initial Ready To Transfer (R2T): yes
Max Burst Length: 262144
Max Outstanding R2T: 1
Max Receive Data Segment Length: 8192
Max Connections: 1
Header Digest: NONE
Data Digest: NONE
Target: iqn.1986-03.com.sun:02:4517bf94-6129-46b3-cca4-9aa954802286
Alias: biodata/oldiscsitest
TPGT: 1
ISID: 4000002a0000
Connections: 1
CID: 0
IP address (Local): 172.31.10.184:41386
IP address (Peer): 172.31.10.117:3260
Discovery Method: Static
Login Parameters (Negotiated):
Data Sequence In Order: yes
Data PDU In Order: yes
Default Time To Retain: 20
Default Time To Wait: 2
Error Recovery Level: 0
First Burst Length: 65536
Immediate Data: yes
Initial Ready To Transfer (R2T): yes
Max Burst Length: 262144
Max Outstanding R2T: 1
Max Receive Data Segment Length: 8192
Max Connections: 1
Header Digest: NONE
Data Digest: NONE
initiator # iscsiadm list target -S
Target: iqn.1986-03.com.sun:02:4517bf94-6129-46b3-cca4-9aa954802286
Alias: biodata/oldiscsitest
TPGT: 1
ISID: 4000002a0001
Connections: 1
LUN: 0
Vendor: SUN
Product: SOLARIS
OS Device Name: /dev/rdsk/c2t600144F04BE83B650000000000000000d0s2
Target: iqn.1986-03.com.sun:02:4517bf94-6129-46b3-cca4-9aa954802286
Alias: biodata/oldiscsitest
TPGT: 1
ISID: 4000002a0000
Connections: 1
LUN: 0
Vendor: SUN
Product: SOLARIS
OS Device Name: /dev/rdsk/c2t600144F04BE83B650000000000000000d0s2
----- So now lets test it
----- Note about my test: I am writting 1 1GB file using extremely small block
size (128 bytes)
----- This is to slow the traffic down so the test runs longer.
initiator # mount /dev/dsk/c2t600144F04BE83B650000000000000000d0s2
/disktesting/wam3
initiator # cd /disktesting/wam3
initiator # date ; dd if=/dev/zero of=comstartest8 bs=128 count=8388608 ; date
Fri May 14 14:30:06 EDT 2010
8388608+0 records in
8388608+0 records out
Fri May 14 14:34:06 EDT 2010
initator # du -sh comstartest8
1.0G comstartest8
----- So now lets look at the disk I/O traffic. During the dump I captured disk
I/O
----- using the command iostat -nxzTd 5 1000. Here I grep out the date - to
show time,
----- c0t0d0 - a disk inside the pool, and c7t7d0 - the log device for the pool
(ZIL)
----- These are the headings for the output
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
# /usr/xpg4/bin/grep -e May -e c7t7d0 -e c0t0d0 iostat-old-iscsi-test-may14
Fri May 14 14:30:04 EDT 2010
Fri May 14 14:30:09 EDT 2010
3.8 0.0 79.0 0.0 0.0 0.0 0.0 4.3 0 2 c0t0d0
2.0 87.0 32.4 784.8 0.0 0.0 0.0 0.1 0 1 c7t7d0
Fri May 14 14:30:14 EDT 2010
0.4 0.0 25.6 0.0 0.0 0.0 0.0 0.4 0 0 c0t0d0
0.0 222.2 0.0 5187.9 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:19 EDT 2010
0.0 221.2 0.0 5255.5 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:24 EDT 2010
0.0 220.8 0.0 5294.3 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:29 EDT 2010
0.2 91.2 12.8 409.3 0.0 0.1 0.0 1.2 0 2 c0t0d0
0.0 212.6 0.0 5366.5 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:34 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 14.8 0 0 c0t0d0
0.0 220.8 0.0 5266.4 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:39 EDT 2010
0.6 0.0 38.4 0.0 0.0 0.0 0.0 0.5 0 0 c0t0d0
0.0 221.6 0.0 5123.2 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:44 EDT 2010
0.0 221.2 0.0 5163.9 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:49 EDT 2010
0.0 220.6 0.0 5631.9 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:54 EDT 2010
0.0 221.0 0.0 5184.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:30:59 EDT 2010
0.2 165.0 12.8 815.2 0.0 0.3 0.0 1.6 0 4 c0t0d0
0.0 203.8 0.0 5276.1 0.0 0.0 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:04 EDT 2010
0.0 220.8 0.0 5220.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:09 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 7.7 0 0 c0t0d0
0.0 222.6 0.0 5095.2 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:14 EDT 2010
1.4 0.4 27.7 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
0.0 222.0 0.0 5082.4 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:19 EDT 2010
0.6 0.0 4.8 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
0.0 222.8 0.0 5196.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:24 EDT 2010
0.0 221.0 0.0 5201.6 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:29 EDT 2010
0.0 170.6 0.0 813.5 0.0 0.2 0.0 1.3 0 4 c0t0d0
2.0 174.2 32.4 5732.0 0.1 0.0 0.4 0.3 8 5 c7t7d0
Fri May 14 14:31:34 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 16.0 0 0 c0t0d0
0.0 221.0 0.0 5486.4 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:39 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 12.9 0 0 c0t0d0
0.0 221.2 0.0 5434.4 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:44 EDT 2010
0.0 220.0 0.0 5492.8 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:49 EDT 2010
0.0 220.0 0.0 5347.2 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:54 EDT 2010
0.0 221.6 0.0 5293.6 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:31:59 EDT 2010
0.6 202.0 38.4 812.4 0.0 0.3 0.0 1.3 0 5 c0t0d0
0.0 206.0 0.0 5572.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:04 EDT 2010
0.0 222.4 0.0 5224.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:09 EDT 2010
0.0 222.0 0.0 5116.7 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:14 EDT 2010
0.0 220.8 0.0 5226.5 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:19 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 9.8 0 0 c0t0d0
0.0 216.0 0.0 5622.4 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:24 EDT 2010
0.0 221.4 0.0 5260.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:29 EDT 2010
0.0 171.8 0.0 761.5 0.0 0.2 0.0 1.3 0 4 c0t0d0
0.0 204.6 0.0 5444.8 0.0 0.0 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:34 EDT 2010
0.6 0.0 38.4 0.0 0.0 0.0 0.0 7.4 0 0 c0t0d0
0.0 221.6 0.0 5273.6 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:39 EDT 2010
2.2 0.4 45.2 0.0 0.0 0.0 0.0 0.9 0 0 c0t0d0
0.0 221.6 0.0 5172.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:44 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 11.9 0 0 c0t0d0
0.0 221.0 0.0 5290.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:49 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 13.8 0 0 c0t0d0
2.0 198.6 32.5 4830.0 0.1 0.0 0.4 0.2 7 5 c7t7d0
Fri May 14 14:32:54 EDT 2010
0.4 0.0 25.6 0.0 0.0 0.0 0.0 6.3 0 0 c0t0d0
0.0 219.2 0.0 5631.9 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:32:59 EDT 2010
0.0 184.4 0.0 758.4 0.0 0.2 0.0 1.3 0 4 c0t0d0
0.0 199.6 0.0 6265.8 0.0 0.1 0.0 0.3 0 5 c7t7d0
Fri May 14 14:33:04 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 18.7 0 0 c0t0d0
0.0 221.0 0.0 5286.4 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:09 EDT 2010
0.6 0.0 38.4 0.0 0.0 0.0 0.0 4.0 0 0 c0t0d0
0.0 222.2 0.0 5092.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:14 EDT 2010
0.0 222.8 0.0 5088.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:19 EDT 2010
0.0 221.6 0.0 5215.2 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:24 EDT 2010
0.0 220.0 0.0 5446.4 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:29 EDT 2010
0.6 198.6 38.4 814.2 0.0 0.3 0.0 1.4 0 5 c0t0d0
0.0 207.4 0.0 5180.0 0.0 0.0 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:34 EDT 2010
0.0 221.0 0.0 5306.4 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:39 EDT 2010
0.0 221.8 0.0 5144.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:44 EDT 2010
0.0 221.0 0.0 5204.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:49 EDT 2010
0.2 0.0 12.8 0.0 0.0 0.0 0.0 14.3 0 0 c0t0d0
0.0 220.6 0.0 5424.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:54 EDT 2010
0.0 220.2 0.0 5563.2 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:33:59 EDT 2010
2.0 167.8 32.4 814.1 0.0 0.2 0.0 1.4 0 4 c0t0d0
0.0 205.4 0.0 5401.6 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:34:04 EDT 2010
0.4 0.0 25.6 0.0 0.0 0.0 0.0 6.7 0 0 c0t0d0
0.0 221.6 0.0 5028.0 0.0 0.1 0.0 0.2 0 5 c7t7d0
Fri May 14 14:34:09 EDT 2010
0.0 151.0 0.0 2875.2 0.0 0.0 0.0 0.2 0 3 c7t7d0
Fri May 14 14:34:14 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c7t7d0
Fri May 14 14:34:19 EDT 2010
0.0 9.6 0.0 168.8 0.0 0.0 0.0 0.1 0 0 c7t7d0
Fri May 14 14:34:24 EDT 2010
0.0 16.0 0.0 369.6 0.0 0.0 0.0 0.2 0 0 c7t7d0
Fri May 14 14:34:29 EDT 2010
0.0 74.8 0.0 306.5 0.0 0.1 0.0 1.1 0 1 c0t0d0
0.0 5.0 0.0 119.2 0.0 0.0 0.0 0.2 0 0 c7t7d0
Fri May 14 14:34:34 EDT 2010
Fri May 14 14:34:39 EDT 2010
Fri May 14 14:34:44 EDT 2010
----- Now you can see constant writting to c7t7d0 at about 5 MB/s with writes
----- to the pool every 30 seconds or so.
----- This is the disk activity I expect.
Now lets look at just a ZFS volume
---------------------------------------------------------------
----- Configuration:
----- Same zpool as previous test with c7t7d0 as log and c0t0d0 as a disk in
pool
target # zfs list biodata/zfstest
NAME USED AVAIL REFER MOUNTPOINT
biodata/zfstest 7.83G 15.8T 7.83G /biodata/zfstest
target # cd /biodata/zfstest
target # date; dd if=/dev/zero of=comstartest8 bs=128 count=8388608;date
Fri May 14 14:50:03 EDT 2010
8388608+0 records in
8388608+0 records out
Fri May 14 14:51:06 EDT 2010
target # du -sh comstartest8
1.0G comstartest8
----- So now lets look at the disk I/O traffic. During the dump I captured disk
I/O
----- using the command iostat -nxzTd 5 1000. Here I grep out the date - to
show time,
----- c0t0d0 - a disk inside the pool, and c7t7d0 - the log device for the pool
(ZIL)
----- These are the headings for the output
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
# /usr/xpg4/bin/grep -e May -e c7t7d0 -e c0t0d0 iostat-zfs-test-may14
Fri May 14 14:49:54 EDT 2010
Fri May 14 14:49:59 EDT 2010
Fri May 14 14:50:04 EDT 2010
Fri May 14 14:50:09 EDT 2010
Fri May 14 14:50:14 EDT 2010
Fri May 14 14:50:19 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
Fri May 14 14:50:24 EDT 2010
Fri May 14 14:50:29 EDT 2010
0.0 34.4 0.0 2162.6 0.0 0.0 0.0 0.8 0 1 c0t0d0
Fri May 14 14:50:34 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c7t7d0
Fri May 14 14:50:39 EDT 2010
Fri May 14 14:50:44 EDT 2010
Fri May 14 14:50:49 EDT 2010
Fri May 14 14:50:54 EDT 2010
Fri May 14 14:50:59 EDT 2010
0.0 43.2 0.0 2782.9 0.0 0.0 0.0 0.8 0 2 c0t0d0
Fri May 14 14:51:04 EDT 2010
Fri May 14 14:51:09 EDT 2010
Fri May 14 14:51:14 EDT 2010
Fri May 14 14:51:19 EDT 2010
Fri May 14 14:51:24 EDT 2010
Fri May 14 14:51:29 EDT 2010
0.0 21.4 0.0 936.8 0.0 0.0 0.0 0.7 0 1 c0t0d0
Fri May 14 14:51:34 EDT 2010
Fri May 14 14:51:39 EDT 2010
1.4 0.4 27.7 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
Fri May 14 14:51:44 EDT 2010
0.6 0.0 4.8 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
Fri May 14 14:51:49 EDT 2010
Fri May 14 14:51:54 EDT 2010
2.0 0.4 32.4 0.0 0.0 0.0 0.0 0.0 0 0 c7t7d0
Fri May 14 14:51:59 EDT 2010
Fri May 14 14:52:04 EDT 2010
Fri May 14 14:52:09 EDT 2010
Fri May 14 14:52:14 EDT 2010
----- So again no write activity to c7t7d0 (some read) and write activity to
pool
----- every 30 seconds or so._______________________________________________
storage-discuss mailing list
storage-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
