Hi,
----- Original Message -----
| | My comments in relation to the previous patch still stand. This is still
| | the wrong answer to the problem. If we have lock contention here, then
| | we should be looking to fix the locking and not trying to avoid the
| | issue by choosing a different rgrp.
| This is also not too different from how we gained performance
| boosts with the Orlov algorithm to assign unique rgrps to groups
| of files, which also spread the distance of the writes.
|
| This will not increase file fragmentation because that is all
| mitigated by the multi-block allocation algorithms we have
| in place.
I've done some more analysis of the scale-out performance with and
without these two patches, with help from Barry in the performance group.
Attached to this email is an output file that compares performance results
from a stock test kernel to the same test kernel plus my previously posted
patches for intra-node congestion. You can see from this summary grep
that the scalability is vastly better with the patch:
[root@perf82 bin]# pr -m -T -w 160 stock829.log iozone16.log | grep 'Parent'
Parent sees throughput for 1 initial writers = 543094.03 kB/sec
Parent sees throughput for 1 initial writers = 539514.33 kB/sec
Parent sees throughput for 2 initial writers = 621523.39 kB/sec
Parent sees throughput for 2 initial writers = 625554.26 kB/sec
Parent sees throughput for 4 initial writers = 244177.34 kB/sec
Parent sees throughput for 4 initial writers = 803140.31 kB/sec
Parent sees throughput for 6 initial writers = 196014.09 kB/sec
Parent sees throughput for 6 initial writers = 765439.86 kB/sec
Parent sees throughput for 8 initial writers = 157997.14 kB/sec
Parent sees throughput for 8 initial writers = 760862.85 kB/sec
Parent sees throughput for 10 initial writers = 155714.45 kB/sec
Parent sees throughput for 10 initial writers = 829598.76 kB/sec
Parent sees throughput for 12 initial writers = 133166.40 kB/sec
Parent sees throughput for 12 initial writers = 744604.51 kB/sec
Parent sees throughput for 14 initial writers = 146353.44 kB/sec
Parent sees throughput for 14 initial writers = 776214.99 kB/sec
Parent sees throughput for 16 initial writers = 84699.82 kB/sec
Parent sees throughput for 16 initial writers = 796142.16 kB/sec
What this means is that performance of 16 iozone threads was 97.5% parallel
with my patches compared to 24.4% on the stock kernel.
Looking at the file fragmentation data in the same file, you can see that
file fragmentation is also noticeably improved in all runs with the patch
in the 16-process case:
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 8622 extents found
/saswork/iozonetest1: 8435 extents found
/saswork/iozonetest10: 8614 extents found
/saswork/iozonetest10: 8322 extents found
/saswork/iozonetest11: 8617 extents found
/saswork/iozonetest11: 8312 extents found
/saswork/iozonetest12: 8658 extents found
/saswork/iozonetest12: 8319 extents found
/saswork/iozonetest13: 8469 extents found
/saswork/iozonetest13: 8435 extents found
/saswork/iozonetest14: 8650 extents found
/saswork/iozonetest14: 8315 extents found
/saswork/iozonetest15: 8649 extents found
/saswork/iozonetest15: 8489 extents found
/saswork/iozonetest16: 8653 extents found
/saswork/iozonetest16: 8436 extents found
/saswork/iozonetest2: 8464 extents found
/saswork/iozonetest2: 8509 extents found
/saswork/iozonetest3: 8635 extents found
/saswork/iozonetest3: 8448 extents found
/saswork/iozonetest4: 8659 extents found
/saswork/iozonetest4: 9203 extents found
/saswork/iozonetest5: 8647 extents found
/saswork/iozonetest5: 8434 extents found
/saswork/iozonetest6: 8669 extents found
/saswork/iozonetest6: 8435 extents found
/saswork/iozonetest7: 8656 extents found
/saswork/iozonetest7: 8309 extents found
/saswork/iozonetest8: 8660 extents found
/saswork/iozonetest8: 8410 extents found
/saswork/iozonetest9: 8607 extents found
/saswork/iozonetest9: 8435 extents found
See the attachment for more details.
And as I said in my previous email, overall file _system_ fragmentation
is, IMHO, not a big concern in the light of these performance gains.
I'll remove the reference to HZ from the first patch: good call.
I still see no reason to throw away the second patch, at least while we work
on a longer-term solution.
Regards,
Bob Peterson
Red Hat File Systems
nohup: ignoring input
nohup: ignoring input
umount: /saswork: not mounted
umount: /saswork: not mounted
mkfs -t gfs2 -O -p lock_nolock -j 1 -t notaclu:work /dev/mapper/vg_sas-lSASWORK
mkfs -t gfs2 -O -p lock_nolock -j 1 -t notaclu:work /dev/mapper/vg_sas-lSASWORK
It appears to contain an existing filesystem (gfs2)
It appears to contain an existing filesystem (xfs)
/dev/mapper/vg_sas-lSASWORK is a symbolic link to /dev/dm-4
/dev/mapper/vg_sas-lSASWORK is a symbolic link to /dev/dm-4
This will destroy any data on /dev/dm-4
This will destroy any data on /dev/dm-4
Discarding device contents (may take a while on large devices): Done
Discarding device contents (may take a while on large devices): Done
Adding journals: Done
Adding journals: Done
Building resource groups: Done
Building resource groups: Done
Creating quota file: Done
Creating quota file: Done
Writing superblock and syncing: Done
Writing superblock and syncing: Done
Device: /dev/mapper/vg_sas-lSASWORK
Device: /dev/mapper/vg_sas-lSASWORK
Block size: 4096
Block size: 4096
Device size: 3072.00 GB (805306368 blocks)
Device size: 3072.00 GB (805306368 blocks)
Filesystem size: 3072.00 GB (805306173 blocks)
Filesystem size: 3072.00 GB (805306173 blocks)
Journals: 1
Journals: 1
Resource groups: 12277
Resource groups: 12277
Locking protocol: "lock_nolock"
Locking protocol: "lock_nolock"
Lock table: "notaclu:work"
Lock table: "notaclu:work"
UUID: d6530b4d-2e43-41f9-ba74-f2db2a0d976b
UUID: 7cc8be72-7bad-4008-832f-32ee5646ad8e
Mount file system
Mount file system
Tue Jan 16 16:25:57 EST 2018 - Instances: 1 Each File is 256 GB
Tue Jan 16 15:05:21 EST 2018 - Instances: 1 Each File is 256 GB
Children see throughput for 1 initial writers = 543094.50 kB/sec
Children see throughput for 1 initial writers = 539514.88 kB/sec
Parent sees throughput for 1 initial writers = 543094.03 kB/sec
Parent sees throughput for 1 initial writers = 539514.33 kB/sec
Min throughput per process = 543094.50 kB/sec
Min throughput per process = 539514.88 kB/sec
Max throughput per process = 543094.50 kB/sec
Max throughput per process = 539514.88 kB/sec
Avg throughput per process = 543094.50 kB/sec
Avg throughput per process = 539514.88 kB/sec
Min xfer = 268435456.00 kB
Min xfer = 268435456.00 kB
Child[0] xfer count = 268435456.00 kB, Throughput = 543094.50 kB/sec
Child[0] xfer count = 268435456.00 kB, Throughput = 539514.88 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 132869 extents found
/saswork/iozonetest1: 132869 extents found
Tue Jan 16 16:34:56 EST 2018 - Instances: 2 Each File is 128 GB
Tue Jan 16 15:14:24 EST 2018 - Instances: 2 Each File is 128 GB
Children see throughput for 2 initial writers = 631279.31 kB/sec
Children see throughput for 2 initial writers = 630325.97 kB/sec
Parent sees throughput for 2 initial writers = 621523.39 kB/sec
Parent sees throughput for 2 initial writers = 625554.26 kB/sec
Min throughput per process = 311516.28 kB/sec
Min throughput per process = 313204.16 kB/sec
Max throughput per process = 319763.03 kB/sec
Max throughput per process = 317121.81 kB/sec
Avg throughput per process = 315639.66 kB/sec
Avg throughput per process = 315162.98 kB/sec
Min xfer = 130721280.00 kB
Min xfer = 132727040.00 kB
Child[0] xfer count = 130721280.00 kB, Throughput = 311516.28 kB/sec
Child[0] xfer count = 132727040.00 kB, Throughput = 313204.16 kB/sec
Child[1] xfer count = 134217728.00 kB, Throughput = 319763.03 kB/sec
Child[1] xfer count = 134217728.00 kB, Throughput = 317121.81 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 67484 extents found
/saswork/iozonetest1: 67454 extents found
/saswork/iozonetest2: 66466 extents found
/saswork/iozonetest2: 66436 extents found
Tue Jan 16 16:42:46 EST 2018 - Instances: 4 Each File is 64 GB
Tue Jan 16 15:22:14 EST 2018 - Instances: 4 Each File is 64 GB
Children see throughput for 4 initial writers = 618569.31 kB/sec
Children see throughput for 4 initial writers = 820960.05 kB/sec
Parent sees throughput for 4 initial writers = 244177.34 kB/sec
Parent sees throughput for 4 initial writers = 803140.31 kB/sec
Min throughput per process = 83365.39 kB/sec
Min throughput per process = 199391.28 kB/sec
Max throughput per process = 365196.81 kB/sec
Max throughput per process = 208515.95 kB/sec
Avg throughput per process = 154642.33 kB/sec
Avg throughput per process = 205240.01 kB/sec
Min xfer = 15311872.00 kB
Min xfer = 64173056.00 kB
Child[0] xfer count = 15311872.00 kB, Throughput = 83365.39 kB/sec
Child[0] xfer count = 66706432.00 kB, Throughput = 207265.80 kB/sec
Child[1] xfer count = 15369472.00 kB, Throughput = 83680.10 kB/sec
Child[1] xfer count = 64173056.00 kB, Throughput = 199391.28 kB/sec
Child[2] xfer count = 15855872.00 kB, Throughput = 86327.01 kB/sec
Child[2] xfer count = 67108864.00 kB, Throughput = 208515.95 kB/sec
Child[3] xfer count = 67108864.00 kB, Throughput = 365196.81 kB/sec
Child[3] xfer count = 66231552.00 kB, Throughput = 205787.02 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 33746 extents found
/saswork/iozonetest1: 33224 extents found
/saswork/iozonetest2: 33746 extents found
/saswork/iozonetest2: 33227 extents found
/saswork/iozonetest3: 33690 extents found
/saswork/iozonetest3: 33717 extents found
/saswork/iozonetest4: 33750 extents found
/saswork/iozonetest4: 33232 extents found
Tue Jan 16 16:51:15 EST 2018 - Instances: 6 Each File is 42 GB
Tue Jan 16 15:28:28 EST 2018 - Instances: 6 Each File is 42 GB
Children see throughput for 6 initial writers = 672926.77 kB/sec
Children see throughput for 6 initial writers = 773291.00 kB/sec
Parent sees throughput for 6 initial writers = 196014.09 kB/sec
Parent sees throughput for 6 initial writers = 765439.86 kB/sec
Min throughput per process = 65661.12 kB/sec
Min throughput per process = 126947.86 kB/sec
Max throughput per process = 330442.81 kB/sec
Max throughput per process = 130072.10 kB/sec
Avg throughput per process = 112154.46 kB/sec
Avg throughput per process = 128881.83 kB/sec
Min xfer = 8765184.00 kB
Min xfer = 42995968.00 kB
Child[0] xfer count = 9429248.00 kB, Throughput = 70632.77 kB/sec
Child[0] xfer count = 42995968.00 kB, Throughput = 126947.86 kB/sec
Child[1] xfer count = 9757952.00 kB, Throughput = 73098.10 kB/sec
Child[1] xfer count = 43737856.00 kB, Throughput = 129179.75 kB/sec
Child[2] xfer count = 8793344.00 kB, Throughput = 65872.13 kB/sec
Child[2] xfer count = 43730688.00 kB, Throughput = 129118.55 kB/sec
Child[3] xfer count = 8765184.00 kB, Throughput = 65661.12 kB/sec
Child[3] xfer count = 44040192.00 kB, Throughput = 130072.10 kB/sec
Child[4] xfer count = 8972544.00 kB, Throughput = 67219.84 kB/sec
Child[4] xfer count = 43791104.00 kB, Throughput = 129336.58 kB/sec
Child[5] xfer count = 44040192.00 kB, Throughput = 330442.81 kB/sec
Child[5] xfer count = 43579904.00 kB, Throughput = 128636.16 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 22258 extents found
/saswork/iozonetest1: 21802 extents found
/saswork/iozonetest2: 22253 extents found
/saswork/iozonetest2: 21801 extents found
/saswork/iozonetest3: 22297 extents found
/saswork/iozonetest3: 21802 extents found
/saswork/iozonetest4: 22311 extents found
/saswork/iozonetest4: 21805 extents found
/saswork/iozonetest5: 22268 extents found
/saswork/iozonetest5: 21801 extents found
/saswork/iozonetest6: 23265 extents found
/saswork/iozonetest6: 23317 extents found
Tue Jan 16 16:59:37 EST 2018 - Instances: 8 Each File is 32 GB
Tue Jan 16 15:34:54 EST 2018 - Instances: 8 Each File is 32 GB
Children see throughput for 8 initial writers = 620530.25 kB/sec
Children see throughput for 8 initial writers = 764553.85 kB/sec
Parent sees throughput for 8 initial writers = 157997.14 kB/sec
Parent sees throughput for 8 initial writers = 760862.85 kB/sec
Min throughput per process = 39813.33 kB/sec
Min throughput per process = 94960.97 kB/sec
Max throughput per process = 309652.22 kB/sec
Max throughput per process = 95971.38 kB/sec
Avg throughput per process = 77566.28 kB/sec
Avg throughput per process = 95569.23 kB/sec
Min xfer = 4310272.00 kB
Min xfer = 33187328.00 kB
Child[0] xfer count = 4695552.00 kB, Throughput = 43372.21 kB/sec
Child[0] xfer count = 33187328.00 kB, Throughput = 94984.74 kB/sec
Child[1] xfer count = 4891904.00 kB, Throughput = 45186.01 kB/sec
Child[1] xfer count = 33554432.00 kB, Throughput = 95968.48 kB/sec
Child[2] xfer count = 4505856.00 kB, Throughput = 41619.79 kB/sec
Child[2] xfer count = 33417728.00 kB, Throughput = 95641.43 kB/sec
Child[3] xfer count = 4310272.00 kB, Throughput = 39813.33 kB/sec
Child[3] xfer count = 33398784.00 kB, Throughput = 95523.29 kB/sec
Child[4] xfer count = 33554432.00 kB, Throughput = 309652.22 kB/sec
Child[4] xfer count = 33532928.00 kB, Throughput = 95971.38 kB/sec
Child[5] xfer count = 4833024.00 kB, Throughput = 44641.93 kB/sec
Child[5] xfer count = 33202176.00 kB, Throughput = 94960.97 kB/sec
Child[6] xfer count = 5136640.00 kB, Throughput = 47446.79 kB/sec
Child[6] xfer count = 33433088.00 kB, Throughput = 95685.20 kB/sec
Child[7] xfer count = 5282816.00 kB, Throughput = 48797.98 kB/sec
Child[7] xfer count = 33501952.00 kB, Throughput = 95818.36 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 17141 extents found
/saswork/iozonetest1: 16612 extents found
/saswork/iozonetest2: 17125 extents found
/saswork/iozonetest2: 17410 extents found
/saswork/iozonetest3: 17134 extents found
/saswork/iozonetest3: 16611 extents found
/saswork/iozonetest4: 17119 extents found
/saswork/iozonetest4: 16610 extents found
/saswork/iozonetest5: 18218 extents found
/saswork/iozonetest5: 16614 extents found
/saswork/iozonetest6: 17167 extents found
/saswork/iozonetest6: 16616 extents found
/saswork/iozonetest7: 17136 extents found
/saswork/iozonetest7: 16611 extents found
/saswork/iozonetest8: 17118 extents found
/saswork/iozonetest8: 16633 extents found
Tue Jan 16 17:07:27 EST 2018 - Instances: 10 Each File is 25 GB
Tue Jan 16 15:41:30 EST 2018 - Instances: 10 Each File is 25 GB
Children see throughput for 10 initial writers = 637743.89 kB/sec
Children see throughput for 10 initial writers = 837788.38 kB/sec
Parent sees throughput for 10 initial writers = 155714.45 kB/sec
Parent sees throughput for 10 initial writers = 829598.76 kB/sec
Min throughput per process = 33365.45 kB/sec
Min throughput per process = 82793.62 kB/sec
Max throughput per process = 273792.59 kB/sec
Max throughput per process = 84570.91 kB/sec
Avg throughput per process = 63774.39 kB/sec
Avg throughput per process = 83778.84 kB/sec
Min xfer = 3187456.00 kB
Min xfer = 25663488.00 kB
Child[0] xfer count = 7101184.00 kB, Throughput = 74354.26 kB/sec
Child[0] xfer count = 25959680.00 kB, Throughput = 83749.12 kB/sec
Child[1] xfer count = 3398912.00 kB, Throughput = 35598.20 kB/sec
Child[1] xfer count = 25860096.00 kB, Throughput = 83711.46 kB/sec
Child[2] xfer count = 3435520.00 kB, Throughput = 35961.88 kB/sec
Child[2] xfer count = 26129152.00 kB, Throughput = 84295.96 kB/sec
Child[3] xfer count = 3446016.00 kB, Throughput = 36071.40 kB/sec
Child[3] xfer count = 26214400.00 kB, Throughput = 84570.91 kB/sec
Child[4] xfer count = 26214400.00 kB, Throughput = 273792.59 kB/sec
Child[4] xfer count = 26101760.00 kB, Throughput = 84207.62 kB/sec
Child[5] xfer count = 3187456.00 kB, Throughput = 33365.45 kB/sec
Child[5] xfer count = 25663488.00 kB, Throughput = 82793.62 kB/sec
Child[6] xfer count = 3908096.00 kB, Throughput = 40840.93 kB/sec
Child[6] xfer count = 26134784.00 kB, Throughput = 84314.14 kB/sec
Child[7] xfer count = 3290624.00 kB, Throughput = 34447.61 kB/sec
Child[7] xfer count = 25797632.00 kB, Throughput = 83226.38 kB/sec
Child[8] xfer count = 3813376.00 kB, Throughput = 39855.38 kB/sec
Child[8] xfer count = 26025728.00 kB, Throughput = 83963.70 kB/sec
Child[9] xfer count = 3196160.00 kB, Throughput = 33456.19 kB/sec
Child[9] xfer count = 25713664.00 kB, Throughput = 82955.47 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 13295 extents found
/saswork/iozonetest1: 12980 extents found
/saswork/iozonetest10: 13595 extents found
/saswork/iozonetest10: 13328 extents found
/saswork/iozonetest2: 13407 extents found
/saswork/iozonetest2: 13173 extents found
/saswork/iozonetest3: 13376 extents found
/saswork/iozonetest3: 13106 extents found
/saswork/iozonetest4: 13384 extents found
/saswork/iozonetest4: 12999 extents found
/saswork/iozonetest5: 13273 extents found
/saswork/iozonetest5: 13140 extents found
/saswork/iozonetest6: 13360 extents found
/saswork/iozonetest6: 13416 extents found
/saswork/iozonetest7: 13356 extents found
/saswork/iozonetest7: 13000 extents found
/saswork/iozonetest8: 13364 extents found
/saswork/iozonetest8: 13431 extents found
/saswork/iozonetest9: 13480 extents found
/saswork/iozonetest9: 13973 extents found
Tue Jan 16 17:14:46 EST 2018 - Instances: 12 Each File is 21 GB
Tue Jan 16 15:47:28 EST 2018 - Instances: 12 Each File is 21 GB
Children see throughput for 12 initial writers = 625197.03 kB/sec
Children see throughput for 12 initial writers = 752443.34 kB/sec
Parent sees throughput for 12 initial writers = 133166.40 kB/sec
Parent sees throughput for 12 initial writers = 744604.51 kB/sec
Min throughput per process = 27613.53 kB/sec
Min throughput per process = 61407.04 kB/sec
Max throughput per process = 270366.38 kB/sec
Max throughput per process = 63534.68 kB/sec
Avg throughput per process = 52099.75 kB/sec
Avg throughput per process = 62703.61 kB/sec
Min xfer = 2248960.00 kB
Min xfer = 21286656.00 kB
Child[0] xfer count = 2665216.00 kB, Throughput = 32724.06 kB/sec
Child[0] xfer count = 21936384.00 kB, Throughput = 63293.16 kB/sec
Child[1] xfer count = 2750208.00 kB, Throughput = 33767.70 kB/sec
Child[1] xfer count = 21635840.00 kB, Throughput = 62426.07 kB/sec
Child[2] xfer count = 2522368.00 kB, Throughput = 30970.18 kB/sec
Child[2] xfer count = 22011904.00 kB, Throughput = 63512.13 kB/sec
Child[3] xfer count = 2462720.00 kB, Throughput = 30237.84 kB/sec
Child[3] xfer count = 21608192.00 kB, Throughput = 62346.25 kB/sec
Child[4] xfer count = 2532864.00 kB, Throughput = 31099.14 kB/sec
Child[4] xfer count = 22020096.00 kB, Throughput = 63534.68 kB/sec
Child[5] xfer count = 2658304.00 kB, Throughput = 32639.26 kB/sec
Child[5] xfer count = 21422848.00 kB, Throughput = 61811.36 kB/sec
Child[6] xfer count = 2696192.00 kB, Throughput = 33108.70 kB/sec
Child[6] xfer count = 21946624.00 kB, Throughput = 63322.86 kB/sec
Child[7] xfer count = 3151360.00 kB, Throughput = 38693.10 kB/sec
Child[7] xfer count = 21398784.00 kB, Throughput = 61742.04 kB/sec
Child[8] xfer count = 2248960.00 kB, Throughput = 27613.53 kB/sec
Child[8] xfer count = 21982720.00 kB, Throughput = 63426.84 kB/sec
Child[9] xfer count = 22020096.00 kB, Throughput = 270366.38 kB/sec
Child[9] xfer count = 21286656.00 kB, Throughput = 61407.04 kB/sec
Child[10] xfer count = 2526976.00 kB, Throughput = 31026.73 kB/sec
Child[10] xfer count = 21937408.00 kB, Throughput = 63296.08 kB/sec
Child[11] xfer count = 2683648.00 kB, Throughput = 32950.41 kB/sec
Child[11] xfer count = 21600768.00 kB, Throughput = 62324.82 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 11305 extents found
/saswork/iozonetest1: 10902 extents found
/saswork/iozonetest10: 11120 extents found
/saswork/iozonetest10: 10907 extents found
/saswork/iozonetest11: 11293 extents found
/saswork/iozonetest11: 10919 extents found
/saswork/iozonetest12: 11293 extents found
/saswork/iozonetest12: 10903 extents found
/saswork/iozonetest2: 11279 extents found
/saswork/iozonetest2: 11738 extents found
/saswork/iozonetest3: 11287 extents found
/saswork/iozonetest3: 10903 extents found
/saswork/iozonetest4: 11278 extents found
/saswork/iozonetest4: 10905 extents found
/saswork/iozonetest5: 11315 extents found
/saswork/iozonetest5: 10902 extents found
/saswork/iozonetest6: 11305 extents found
/saswork/iozonetest6: 10912 extents found
/saswork/iozonetest7: 11270 extents found
/saswork/iozonetest7: 10902 extents found
/saswork/iozonetest8: 11283 extents found
/saswork/iozonetest8: 10910 extents found
/saswork/iozonetest9: 11292 extents found
/saswork/iozonetest9: 10908 extents found
Tue Jan 16 17:21:59 EST 2018 - Instances: 14 Each File is 18 GB
Tue Jan 16 15:54:06 EST 2018 - Instances: 14 Each File is 18 GB
Children see throughput for 14 initial writers = 627233.04 kB/sec
Children see throughput for 14 initial writers = 781917.29 kB/sec
Parent sees throughput for 14 initial writers = 146353.44 kB/sec
Parent sees throughput for 14 initial writers = 776214.99 kB/sec
Min throughput per process = 26628.86 kB/sec
Min throughput per process = 55250.18 kB/sec
Max throughput per process = 222967.02 kB/sec
Max throughput per process = 56346.68 kB/sec
Avg throughput per process = 44802.36 kB/sec
Avg throughput per process = 55851.24 kB/sec
Min xfer = 2252800.00 kB
Min xfer = 18550528.00 kB
Child[0] xfer count = 3208704.00 kB, Throughput = 37926.68 kB/sec
Child[0] xfer count = 18701824.00 kB, Throughput = 55701.16 kB/sec
Child[1] xfer count = 2255360.00 kB, Throughput = 26658.47 kB/sec
Child[1] xfer count = 18730752.00 kB, Throughput = 55786.88 kB/sec
Child[2] xfer count = 2376960.00 kB, Throughput = 28095.47 kB/sec
Child[2] xfer count = 18874368.00 kB, Throughput = 56346.68 kB/sec
Child[3] xfer count = 2252800.00 kB, Throughput = 26628.86 kB/sec
Child[3] xfer count = 18790912.00 kB, Throughput = 55966.14 kB/sec
Child[4] xfer count = 2856192.00 kB, Throughput = 33759.99 kB/sec
Child[4] xfer count = 18867968.00 kB, Throughput = 56335.29 kB/sec
Child[5] xfer count = 2330880.00 kB, Throughput = 27551.27 kB/sec
Child[5] xfer count = 18664704.00 kB, Throughput = 55590.24 kB/sec
Child[6] xfer count = 2450944.00 kB, Throughput = 28969.98 kB/sec
Child[6] xfer count = 18854144.00 kB, Throughput = 56154.44 kB/sec
Child[7] xfer count = 2498304.00 kB, Throughput = 29559.78 kB/sec
Child[7] xfer count = 18732544.00 kB, Throughput = 55794.91 kB/sec
Child[8] xfer count = 18874368.00 kB, Throughput = 222967.02 kB/sec
Child[8] xfer count = 18742528.00 kB, Throughput = 55822.08 kB/sec
Child[9] xfer count = 2615552.00 kB, Throughput = 30962.77 kB/sec
Child[9] xfer count = 18608896.00 kB, Throughput = 55424.02 kB/sec
Child[10] xfer count = 2759424.00 kB, Throughput = 32616.18 kB/sec
Child[10] xfer count = 18796800.00 kB, Throughput = 55983.70 kB/sec
Child[11] xfer count = 2335488.00 kB, Throughput = 27605.33 kB/sec
Child[11] xfer count = 18658048.00 kB, Throughput = 55570.40 kB/sec
Child[12] xfer count = 2815488.00 kB, Throughput = 33284.04 kB/sec
Child[12] xfer count = 18866432.00 kB, Throughput = 56191.17 kB/sec
Child[13] xfer count = 3438848.00 kB, Throughput = 40647.19 kB/sec
Child[13] xfer count = 18550528.00 kB, Throughput = 55250.18 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 9734 extents found
/saswork/iozonetest1: 9584 extents found
/saswork/iozonetest10: 9726 extents found
/saswork/iozonetest10: 9476 extents found
/saswork/iozonetest11: 9718 extents found
/saswork/iozonetest11: 9344 extents found
/saswork/iozonetest12: 9738 extents found
/saswork/iozonetest12: 9352 extents found
/saswork/iozonetest13: 9713 extents found
/saswork/iozonetest13: 9538 extents found
/saswork/iozonetest14: 9744 extents found
/saswork/iozonetest14: 9417 extents found
/saswork/iozonetest2: 9720 extents found
/saswork/iozonetest2: 9401 extents found
/saswork/iozonetest3: 9737 extents found
/saswork/iozonetest3: 9535 extents found
/saswork/iozonetest4: 9745 extents found
/saswork/iozonetest4: 9345 extents found
/saswork/iozonetest5: 9723 extents found
/saswork/iozonetest5: 9349 extents found
/saswork/iozonetest6: 9723 extents found
/saswork/iozonetest6: 9568 extents found
/saswork/iozonetest7: 9737 extents found
/saswork/iozonetest7: 9539 extents found
/saswork/iozonetest8: 9723 extents found
/saswork/iozonetest8: 10404 extents found
/saswork/iozonetest9: 9514 extents found
/saswork/iozonetest9: 9470 extents found
Tue Jan 16 17:28:51 EST 2018 - Instances: 16 Each File is 16 GB
Tue Jan 16 16:00:33 EST 2018 - Instances: 16 Each File is 16 GB
Children see throughput for 16 initial writers = 346880.52 kB/sec
Children see throughput for 16 initial writers = 816540.99 kB/sec
Parent sees throughput for 16 initial writers = 84699.82 kB/sec
Parent sees throughput for 16 initial writers = 796142.16 kB/sec
Min throughput per process = 1133.90 kB/sec
Min throughput per process = 49606.59 kB/sec
Max throughput per process = 157089.06 kB/sec
Max throughput per process = 52487.02 kB/sec
Avg throughput per process = 21680.03 kB/sec
Avg throughput per process = 51033.81 kB/sec
Min xfer = 121088.00 kB
Min xfer = 15897856.00 kB
Child[0] xfer count = 222720.00 kB, Throughput = 2085.97 kB/sec
Child[0] xfer count = 16385024.00 kB, Throughput = 51125.83 kB/sec
Child[1] xfer count = 14313984.00 kB, Throughput = 133936.28 kB/sec
Child[1] xfer count = 16369920.00 kB, Throughput = 51078.66 kB/sec
Child[2] xfer count = 292096.00 kB, Throughput = 2735.13 kB/sec
Child[2] xfer count = 16404992.00 kB, Throughput = 51188.07 kB/sec
Child[3] xfer count = 322816.00 kB, Throughput = 3022.61 kB/sec
Child[3] xfer count = 16715008.00 kB, Throughput = 52155.46 kB/sec
Child[4] xfer count = 443136.00 kB, Throughput = 4149.65 kB/sec
Child[4] xfer count = 16373504.00 kB, Throughput = 51089.81 kB/sec
Child[5] xfer count = 315648.00 kB, Throughput = 2955.49 kB/sec
Child[5] xfer count = 16047104.00 kB, Throughput = 50071.44 kB/sec
Child[6] xfer count = 121088.00 kB, Throughput = 1133.90 kB/sec
Child[6] xfer count = 16732416.00 kB, Throughput = 52209.74 kB/sec
Child[7] xfer count = 288256.00 kB, Throughput = 2699.02 kB/sec
Child[7] xfer count = 16011008.00 kB, Throughput = 49958.77 kB/sec
Child[8] xfer count = 1543936.00 kB, Throughput = 14456.26 kB/sec
Child[8] xfer count = 16777216.00 kB, Throughput = 52487.02 kB/sec
Child[9] xfer count = 519168.00 kB, Throughput = 4861.68 kB/sec
Child[9] xfer count = 15897856.00 kB, Throughput = 49606.59 kB/sec
Child[10] xfer count = 749056.00 kB, Throughput = 7013.60 kB/sec
Child[10] xfer count = 16335104.00 kB, Throughput = 51094.98 kB/sec
Child[11] xfer count = 323072.00 kB, Throughput = 3025.37 kB/sec
Child[11] xfer count = 16000000.00 kB, Throughput = 49924.41 kB/sec
Child[12] xfer count = 16777216.00 kB, Throughput = 157089.06 kB/sec
Child[12] xfer count = 16497152.00 kB, Throughput = 51475.78 kB/sec
Child[13] xfer count = 288256.00 kB, Throughput = 2699.02 kB/sec
Child[13] xfer count = 16177920.00 kB, Throughput = 50479.57 kB/sec
Child[14] xfer count = 236544.00 kB, Throughput = 2215.07 kB/sec
Child[14] xfer count = 16443648.00 kB, Throughput = 51308.69 kB/sec
Child[15] xfer count = 299264.00 kB, Throughput = 2802.41 kB/sec
Child[15] xfer count = 16441856.00 kB, Throughput = 51286.18 kB/sec
Fragmentation Summary
Fragmentation Summary
/saswork/iozonetest1: 8622 extents found
/saswork/iozonetest1: 8435 extents found
/saswork/iozonetest10: 8614 extents found
/saswork/iozonetest10: 8322 extents found
/saswork/iozonetest11: 8617 extents found
/saswork/iozonetest11: 8312 extents found
/saswork/iozonetest12: 8658 extents found
/saswork/iozonetest12: 8319 extents found
/saswork/iozonetest13: 8469 extents found
/saswork/iozonetest13: 8435 extents found
/saswork/iozonetest14: 8650 extents found
/saswork/iozonetest14: 8315 extents found
/saswork/iozonetest15: 8649 extents found
/saswork/iozonetest15: 8489 extents found
/saswork/iozonetest16: 8653 extents found
/saswork/iozonetest16: 8436 extents found
/saswork/iozonetest2: 8464 extents found
/saswork/iozonetest2: 8509 extents found
/saswork/iozonetest3: 8635 extents found
/saswork/iozonetest3: 8448 extents found
/saswork/iozonetest4: 8659 extents found
/saswork/iozonetest4: 9203 extents found
/saswork/iozonetest5: 8647 extents found
/saswork/iozonetest5: 8434 extents found
/saswork/iozonetest6: 8669 extents found
/saswork/iozonetest6: 8435 extents found
/saswork/iozonetest7: 8656 extents found
/saswork/iozonetest7: 8309 extents found
/saswork/iozonetest8: 8660 extents found
/saswork/iozonetest8: 8410 extents found
/saswork/iozonetest9: 8607 extents found
/saswork/iozonetest9: 8435 extents found