Hi again :),
> both whould be good to compare if there are any settings which differ
> and could end up in such a gap.
Output from SmartOS follows. Netbooting the box via PXE, but since it
runs from ramdisk, shouldn't make a difference ...
>
> your drives are connected to the onbaord sas hba in the hp cube? i
> expect you also might have flashed a mod bios to get the optical sata
> port working, i had very interesting effects with wrong bios settings in
> a modded version (which enables all kind of crap to play around - very
> good for ppl like me).
Yes, I have flashed the modded bios to have all 6 ports available in AHCI mode.
I haven't changed anything in bios during the tests with OmniOS and
SmartOS. Do you have any particular BIOS settings in mind, so I can
double check it?
Thank you again,
Jan
SMARTOS amd-pre-ept/20150613/
#############################
# zfs create -o utf8only=on -o atime=off -o casesensitivity=mixed -o
compression=lz4 zones/public
# cat /root/rsync.conf
[public]
path = /zones/public
read only = no
uid = root
gid = root
hosts allow = 192.168.3.3
# rsync --daemon --config=/root/rsync.conf
OI:
# rsync --progress -av /swimming/public/_HDTV/ 192.168.3.4::public
sending incremental file list
67588 100% 33.21MB/s 0:00:00 (xfer#1, to-check=51/53)
4096 100% 3.91MB/s 0:00:00 (xfer#2, to-check=50/53)
4096 100% 3.91MB/s 0:00:00 (xfer#3, to-check=49/53)
4697789726 100% 28.42MB/s 0:02:37 (xfer#4, to-check=48/53)
85051 100% 209.21kB/s 0:00:00 (xfer#5, to-check=47/53)
4698158496 100% 27.85MB/s 0:02:40 (xfer#6, to-check=46/53)
91745 100% 5.83MB/s 0:00:00 (xfer#7, to-check=45/53)
4696505094 100% 27.83MB/s 0:02:40 (xfer#8, to-check=44/53)
97263 100% 104.84kB/s 0:00:00 (xfer#9, to-check=43/53)
^C 147062784 3% 27.62MB/s 0:02:47
^^^ mkv files
### zpool iostat 1 100
capacity operations bandwidth
pool alloc free read write read write
---------- ----- ----- ----- ----- ----- -----
zones 5.80G 8.12T 0 223 4.79K 19.1M
zones 5.87G 8.12T 0 0 0 0
zones 5.87G 8.12T 0 324 0 37.8M
zones 5.95G 8.12T 0 492 0 26.4M
zones 5.95G 8.12T 0 0 0 0
zones 6.02G 8.12T 0 919 1021 65.5M
zones 6.02G 8.12T 0 0 0 0
zones 6.10G 8.12T 0 795 0 64.4M
zones 6.10G 8.12T 0 0 0 0
zones 6.10G 8.12T 0 464 0 57.2M
zones 6.17G 8.12T 0 432 0 8.43M
zones 6.17G 8.12T 0 0 0 0
zones 6.25G 8.12T 0 794 0 64.4M
zones 6.25G 8.12T 0 0 0 0
zones 6.32G 8.12T 0 861 0 65.3M
zones 6.32G 8.12T 0 0 0 0
zones 6.32G 8.12T 0 798 0 64.4M
zones 6.40G 8.12T 0 0 0 0
zones 6.40G 8.12T 0 264 0 30.5M
zones 6.47G 8.12T 0 553 0 33.8M
zones 6.47G 8.12T 0 0 0 0
zones 6.55G 8.12T 0 797 0 64.4M
zones 6.55G 8.12T 0 0 0 0
zones 6.55G 8.12T 0 892 0 65.2M
zones 6.62G 8.12T 0 0 0 0
zones 6.62G 8.12T 0 782 0 64.3M
zones 6.70G 8.12T 0 83 0 871K
zones 6.70G 8.12T 0 144 0 17.6M
zones 6.78G 8.12T 0 653 0 46.8M
zones 6.78G 8.12T 0 0 0 0
zones 6.85G 8.12T 0 798 0 64.4M
zones 6.85G 8.12T 0 0 0 0
zones 6.93G 8.12T 0 797 0 64.4M
zones 6.93G 8.12T 0 0 0 0
zones 6.93G 8.12T 0 795 0 64.4M
<snip>
#### zpool get all
# zpool get all
NAME PROPERTY VALUE
SOURCE
zones size 8.12T -
zones capacity 0% -
zones altroot -
default
zones health ONLINE -
zones guid 7863802736394192613
default
zones version -
default
zones bootfs -
default
zones delegation on
default
zones autoreplace off
default
zones cachefile -
default
zones failmode wait
default
zones listsnapshots off
default
zones autoexpand off
default
zones dedupditto 0
default
zones dedupratio 1.00x -
zones free 8.12T -
zones allocated 8.05G -
zones readonly off -
zones comment -
default
zones expandsize - -
zones freeing 0
default
zones fragmentation 0% -
zones leaked 0
default
zones feature@async_destroy enabled
local
zones feature@empty_bpobj active
local
zones feature@lz4_compress active
local
zones feature@multi_vdev_crash_dump enabled
local
zones feature@spacemap_histogram active
local
zones feature@enabled_txg active
local
zones feature@hole_birth active
local
zones feature@extensible_dataset enabled
local
zones feature@embedded_data active
local
zones feature@bookmarks enabled
local
zones feature@filesystem_limits enabled
local
zones feature@large_blocks enabled
local
### zfs get all
NAME PROPERTY VALUE SOURCE
zones type filesystem -
zones creation Wed Jun 24 22:24 2015 -
zones used 15.4G -
zones available 6.52T -
zones referenced 497K -
zones compressratio 1.00x -
zones mounted yes -
zones quota none default
zones reservation none default
zones recordsize 128K default
zones mountpoint /zones default
zones sharenfs off default
zones checksum on default
zones compression off default
zones atime off local
zones devices on default
zones exec on default
zones setuid on default
zones readonly off default
zones zoned off default
zones snapdir hidden default
zones aclmode discard default
zones aclinherit restricted default
zones canmount on default
zones xattr on default
zones copies 1 default
zones version 5 -
zones utf8only off -
zones normalization none -
zones casesensitivity sensitive -
zones vscan off default
zones nbmand off default
zones sharesmb off default
zones refquota none default
zones refreservation none default
zones primarycache all default
zones secondarycache all default
zones usedbysnapshots 0 -
zones usedbydataset 497K -
zones usedbychildren 15.4G -
zones usedbyrefreservation 0 -
zones logbias latency default
zones dedup off default
zones mlslabel none default
zones sync standard default
zones refcompressratio 1.00x -
zones written 497K -
zones logicalused 7.25G -
zones logicalreferenced 437K -
zones filesystem_limit none default
zones snapshot_limit none default
zones filesystem_count none default
zones snapshot_count none default
zones redundant_metadata all default
zones/archive type filesystem -
zones/archive creation Wed Jun 24 22:30 2015 -
zones/archive used 28.2K -
zones/archive available 6.52T -
zones/archive referenced 28.2K -
zones/archive compressratio 1.00x -
zones/archive mounted yes -
zones/archive quota none default
zones/archive reservation none default
zones/archive recordsize 128K default
zones/archive mountpoint /zones/archive local
zones/archive sharenfs off default
zones/archive checksum on default
zones/archive compression lzjb local
zones/archive atime off inherited from
zones
zones/archive devices on default
zones/archive exec on default
zones/archive setuid on default
zones/archive readonly off default
zones/archive zoned off default
zones/archive snapdir hidden default
zones/archive aclmode discard default
zones/archive aclinherit restricted default
zones/archive canmount on default
zones/archive xattr on default
zones/archive copies 1 default
zones/archive version 5 -
zones/archive utf8only off -
zones/archive normalization none -
zones/archive casesensitivity sensitive -
zones/archive vscan off default
zones/archive nbmand off default
zones/archive sharesmb off default
zones/archive refquota none default
zones/archive refreservation none default
zones/archive primarycache all default
zones/archive secondarycache all default
zones/archive usedbysnapshots 0 -
zones/archive usedbydataset 28.2K -
zones/archive usedbychildren 0 -
zones/archive usedbyrefreservation 0 -
zones/archive logbias latency default
zones/archive dedup off default
zones/archive mlslabel none default
zones/archive sync standard default
zones/archive refcompressratio 1.00x -
zones/archive written 28.2K -
zones/archive logicalused 9.50K -
zones/archive logicalreferenced 9.50K -
zones/archive filesystem_limit none default
zones/archive snapshot_limit none default
zones/archive filesystem_count none default
zones/archive snapshot_count none default
zones/archive redundant_metadata all default
zones/config type filesystem -
zones/config creation Wed Jun 24 22:24 2015 -
zones/config used 34.9K -
zones/config available 6.52T -
zones/config referenced 34.9K -
zones/config compressratio 1.00x -
zones/config mounted yes -
zones/config quota none default
zones/config reservation none default
zones/config recordsize 128K default
zones/config mountpoint legacy local
zones/config sharenfs off default
zones/config checksum on default
zones/config compression off default
zones/config atime off inherited from
zones
zones/config devices on default
zones/config exec on default
zones/config setuid on default
zones/config readonly off default
zones/config zoned off default
zones/config snapdir hidden default
zones/config aclmode discard default
zones/config aclinherit restricted default
zones/config canmount on default
zones/config xattr on default
zones/config copies 1 default
zones/config version 5 -
zones/config utf8only off -
zones/config normalization none -
zones/config casesensitivity sensitive -
zones/config vscan off default
zones/config nbmand off default
zones/config sharesmb off default
zones/config refquota none default
zones/config refreservation none default
zones/config primarycache all default
zones/config secondarycache all default
zones/config usedbysnapshots 0 -
zones/config usedbydataset 34.9K -
zones/config usedbychildren 0 -
zones/config usedbyrefreservation 0 -
zones/config logbias latency default
zones/config dedup off default
zones/config mlslabel none default
zones/config sync standard default
zones/config refcompressratio 1.00x -
zones/config written 34.9K -
zones/config logicalused 16K -
zones/config logicalreferenced 16K -
zones/config filesystem_limit none default
zones/config snapshot_limit none default
zones/config filesystem_count none default
zones/config snapshot_count none default
zones/config redundant_metadata all default
zones/cores type filesystem -
zones/cores creation Wed Jun 24 22:28 2015 -
zones/cores used 56.4K -
zones/cores available 6.52T -
zones/cores referenced 28.2K -
zones/cores compressratio 1.00x -
zones/cores mounted no -
zones/cores quota none default
zones/cores reservation none default
zones/cores recordsize 128K default
zones/cores mountpoint none local
zones/cores sharenfs off default
zones/cores checksum on default
zones/cores compression gzip local
zones/cores atime off inherited from
zones
zones/cores devices on default
zones/cores exec on default
zones/cores setuid on default
zones/cores readonly off default
zones/cores zoned off default
zones/cores snapdir hidden default
zones/cores aclmode discard default
zones/cores aclinherit restricted default
zones/cores canmount on default
zones/cores xattr on default
zones/cores copies 1 default
zones/cores version 5 -
zones/cores utf8only off -
zones/cores normalization none -
zones/cores casesensitivity sensitive -
zones/cores vscan off default
zones/cores nbmand off default
zones/cores sharesmb off default
zones/cores refquota none default
zones/cores refreservation none default
zones/cores primarycache all default
zones/cores secondarycache all default
zones/cores usedbysnapshots 0 -
zones/cores usedbydataset 28.2K -
zones/cores usedbychildren 28.2K -
zones/cores usedbyrefreservation 0 -
zones/cores logbias latency default
zones/cores dedup off default
zones/cores mlslabel none default
zones/cores sync standard default
zones/cores refcompressratio 1.00x -
zones/cores written 28.2K -
zones/cores logicalused 19K -
zones/cores logicalreferenced 9.50K -
zones/cores filesystem_limit none default
zones/cores snapshot_limit none default
zones/cores filesystem_count none default
zones/cores snapshot_count none default
zones/cores redundant_metadata all default
zones/cores/global type filesystem -
zones/cores/global creation Wed Jun 24 22:28 2015 -
zones/cores/global used 28.2K -
zones/cores/global available 10.0G -
zones/cores/global referenced 28.2K -
zones/cores/global compressratio 1.00x -
zones/cores/global mounted yes -
zones/cores/global quota 10G local
zones/cores/global reservation none default
zones/cores/global recordsize 128K default
zones/cores/global mountpoint /zones/global/cores local
zones/cores/global sharenfs off default
zones/cores/global checksum on default
zones/cores/global compression gzip inherited from
zones/cores
zones/cores/global atime off inherited from
zones
zones/cores/global devices on default
zones/cores/global exec on default
zones/cores/global setuid on default
zones/cores/global readonly off default
zones/cores/global zoned off default
zones/cores/global snapdir hidden default
zones/cores/global aclmode discard default
zones/cores/global aclinherit restricted default
zones/cores/global canmount on default
zones/cores/global xattr on default
zones/cores/global copies 1 default
zones/cores/global version 5 -
zones/cores/global utf8only off -
zones/cores/global normalization none -
zones/cores/global casesensitivity sensitive -
zones/cores/global vscan off default
zones/cores/global nbmand off default
zones/cores/global sharesmb off default
zones/cores/global refquota none default
zones/cores/global refreservation none default
zones/cores/global primarycache all default
zones/cores/global secondarycache all default
zones/cores/global usedbysnapshots 0 -
zones/cores/global usedbydataset 28.2K -
zones/cores/global usedbychildren 0 -
zones/cores/global usedbyrefreservation 0 -
zones/cores/global logbias latency default
zones/cores/global dedup off default
zones/cores/global mlslabel none default
zones/cores/global sync standard default
zones/cores/global refcompressratio 1.00x -
zones/cores/global written 28.2K -
zones/cores/global logicalused 9.50K -
zones/cores/global logicalreferenced 9.50K -
zones/cores/global filesystem_limit none default
zones/cores/global snapshot_limit none default
zones/cores/global filesystem_count none default
zones/cores/global snapshot_count none default
zones/cores/global redundant_metadata all default
zones/dump type volume -
zones/dump creation Wed Jun 24 22:24 2015 -
zones/dump used 4.00G -
zones/dump available 6.52T -
zones/dump referenced 4.00G -
zones/dump compressratio 1.00x -
zones/dump reservation none default
zones/dump volsize 4G local
zones/dump volblocksize 128K -
zones/dump checksum noparity local
zones/dump compression off local
zones/dump readonly off default
zones/dump copies 1 default
zones/dump refreservation none local
zones/dump primarycache all default
zones/dump secondarycache all default
zones/dump usedbysnapshots 0 -
zones/dump usedbydataset 4.00G -
zones/dump usedbychildren 0 -
zones/dump usedbyrefreservation 0 -
zones/dump logbias latency default
zones/dump dedup off local
zones/dump mlslabel none default
zones/dump sync standard default
zones/dump refcompressratio 1.00x -
zones/dump written 4.00G -
zones/dump logicalused 4.00G -
zones/dump logicalreferenced 4.00G -
zones/dump snapshot_limit none default
zones/dump snapshot_count none default
zones/dump redundant_metadata all default
zones/opt type filesystem -
zones/opt creation Wed Jun 24 22:24 2015 -
zones/opt used 28.2K -
zones/opt available 6.52T -
zones/opt referenced 28.2K -
zones/opt compressratio 1.00x -
zones/opt mounted yes -
zones/opt quota none default
zones/opt reservation none default
zones/opt recordsize 128K default
zones/opt mountpoint legacy local
zones/opt sharenfs off default
zones/opt checksum on default
zones/opt compression off default
zones/opt atime off inherited from
zones
zones/opt devices on default
zones/opt exec on default
zones/opt setuid on default
zones/opt readonly off default
zones/opt zoned off default
zones/opt snapdir hidden default
zones/opt aclmode discard default
zones/opt aclinherit restricted default
zones/opt canmount on default
zones/opt xattr on default
zones/opt copies 1 default
zones/opt version 5 -
zones/opt utf8only off -
zones/opt normalization none -
zones/opt casesensitivity sensitive -
zones/opt vscan off default
zones/opt nbmand off default
zones/opt sharesmb off default
zones/opt refquota none default
zones/opt refreservation none default
zones/opt primarycache all default
zones/opt secondarycache all default
zones/opt usedbysnapshots 0 -
zones/opt usedbydataset 28.2K -
zones/opt usedbychildren 0 -
zones/opt usedbyrefreservation 0 -
zones/opt logbias latency default
zones/opt dedup off default
zones/opt mlslabel none default
zones/opt sync standard default
zones/opt refcompressratio 1.00x -
zones/opt written 28.2K -
zones/opt logicalused 9.50K -
zones/opt logicalreferenced 9.50K -
zones/opt filesystem_limit none default
zones/opt snapshot_limit none default
zones/opt filesystem_count none default
zones/opt snapshot_count none default
zones/opt redundant_metadata all default
zones/public type filesystem -
zones/public creation Wed Jun 24 22:44 2015 -
zones/public used 3.25G -
zones/public available 6.52T -
zones/public referenced 3.25G -
zones/public compressratio 1.00x -
zones/public mounted yes -
zones/public quota none default
zones/public reservation none default
zones/public recordsize 128K default
zones/public mountpoint /zones/public default
zones/public sharenfs off default
zones/public checksum on default
zones/public compression lz4 local
zones/public atime off local
zones/public devices on default
zones/public exec on default
zones/public setuid on default
zones/public readonly off default
zones/public zoned off default
zones/public snapdir hidden default
zones/public aclmode discard default
zones/public aclinherit restricted default
zones/public canmount on default
zones/public xattr on default
zones/public copies 1 default
zones/public version 5 -
zones/public utf8only on -
zones/public normalization none -
zones/public casesensitivity mixed -
zones/public vscan off default
zones/public nbmand off default
zones/public sharesmb off default
zones/public refquota none default
zones/public refreservation none default
zones/public primarycache all default
zones/public secondarycache all default
zones/public usedbysnapshots 0 -
zones/public usedbydataset 3.25G -
zones/public usedbychildren 0 -
zones/public usedbyrefreservation 0 -
zones/public logbias latency default
zones/public dedup off default
zones/public mlslabel none default
zones/public sync standard default
zones/public refcompressratio 1.00x -
zones/public written 3.25G -
zones/public logicalused 3.25G -
zones/public logicalreferenced 3.25G -
zones/public filesystem_limit none default
zones/public snapshot_limit none default
zones/public filesystem_count none default
zones/public snapshot_count none default
zones/public redundant_metadata all default
zones/swap type volume -
zones/swap creation Wed Jun 24 22:24 2015 -
zones/swap used 8.12G -
zones/swap available 6.53T -
zones/swap referenced 13.3K -
zones/swap compressratio 1.00x -
zones/swap reservation none default
zones/swap volsize 7.87G local
zones/swap volblocksize 8K -
zones/swap checksum on default
zones/swap compression off default
zones/swap readonly off default
zones/swap copies 1 default
zones/swap refreservation 8.12G local
zones/swap primarycache all default
zones/swap secondarycache all default
zones/swap usedbysnapshots 0 -
zones/swap usedbydataset 13.3K -
zones/swap usedbychildren 0 -
zones/swap usedbyrefreservation 8.12G -
zones/swap logbias latency default
zones/swap dedup off default
zones/swap mlslabel none default
zones/swap sync standard default
zones/swap refcompressratio 1.00x -
zones/swap written 13.3K -
zones/swap logicalused 4K -
zones/swap logicalreferenced 4K -
zones/swap snapshot_limit none default
zones/swap snapshot_count none default
zones/swap redundant_metadata all default
zones/usbkey type filesystem -
zones/usbkey creation Wed Jun 24 22:24 2015 -
zones/usbkey used 124K -
zones/usbkey available 6.52T -
zones/usbkey referenced 124K -
zones/usbkey compressratio 1.00x -
zones/usbkey mounted yes -
zones/usbkey quota none default
zones/usbkey reservation none default
zones/usbkey recordsize 128K default
zones/usbkey mountpoint legacy local
zones/usbkey sharenfs off default
zones/usbkey checksum on default
zones/usbkey compression off default
zones/usbkey atime off inherited from
zones
zones/usbkey devices on default
zones/usbkey exec on default
zones/usbkey setuid on default
zones/usbkey readonly off default
zones/usbkey zoned off default
zones/usbkey snapdir hidden default
zones/usbkey aclmode discard default
zones/usbkey aclinherit restricted default
zones/usbkey canmount on default
zones/usbkey xattr on default
zones/usbkey copies 1 default
zones/usbkey version 5 -
zones/usbkey utf8only off -
zones/usbkey normalization none -
zones/usbkey casesensitivity sensitive -
zones/usbkey vscan off default
zones/usbkey nbmand off default
zones/usbkey sharesmb off default
zones/usbkey refquota none default
zones/usbkey refreservation none default
zones/usbkey primarycache all default
zones/usbkey secondarycache all default
zones/usbkey usedbysnapshots 0 -
zones/usbkey usedbydataset 124K -
zones/usbkey usedbychildren 0 -
zones/usbkey usedbyrefreservation 0 -
zones/usbkey logbias latency default
zones/usbkey dedup off default
zones/usbkey mlslabel none default
zones/usbkey sync standard default
zones/usbkey refcompressratio 1.00x -
zones/usbkey written 124K -
zones/usbkey logicalused 104K -
zones/usbkey logicalreferenced 104K -
zones/usbkey filesystem_limit none default
zones/usbkey snapshot_limit none default
zones/usbkey filesystem_count none default
zones/usbkey snapshot_count none default
zones/usbkey redundant_metadata all default
zones/var type filesystem -
zones/var creation Wed Jun 24 22:24 2015 -
zones/var used 1.58M -
zones/var available 6.52T -
zones/var referenced 1.58M -
zones/var compressratio 1.00x -
zones/var mounted yes -
zones/var quota none default
zones/var reservation none default
zones/var recordsize 128K default
zones/var mountpoint legacy local
zones/var sharenfs off default
zones/var checksum on default
zones/var compression off default
zones/var atime off inherited from
zones
zones/var devices on default
zones/var exec on default
zones/var setuid on default
zones/var readonly off default
zones/var zoned off default
zones/var snapdir hidden default
zones/var aclmode discard default
zones/var aclinherit restricted default
zones/var canmount on default
zones/var xattr on default
zones/var copies 1 default
zones/var version 5 -
zones/var utf8only off -
zones/var normalization none -
zones/var casesensitivity sensitive -
zones/var vscan off default
zones/var nbmand off default
zones/var sharesmb off default
zones/var refquota none default
zones/var refreservation none default
zones/var primarycache all default
zones/var secondarycache all default
zones/var usedbysnapshots 0 -
zones/var usedbydataset 1.58M -
zones/var usedbychildren 0 -
zones/var usedbyrefreservation 0 -
zones/var logbias latency default
zones/var dedup off default
zones/var mlslabel none default
zones/var sync standard default
zones/var refcompressratio 1.00x -
zones/var written 1.58M -
zones/var logicalused 1.48M -
zones/var logicalreferenced 1.48M -
zones/var filesystem_limit none default
zones/var snapshot_limit none default
zones/var filesystem_count none default
zones/var snapshot_count none default
zones/var redundant_metadata all default
> regarding the following output, any special reason why you dont inherit
> atime off & compression? some dataset use no compression, others lz4,
> atime is on nearly everywhere. especially compression might explain, but
> lets wait for the 2nd output to compare.
Just being lazy/sloppy. I've created the filesystems in a for cycle, for
temporary backup, so I can reinstall the openindiana box. (zfs create -o
utf8only=on -o atime=off -o casesensitivity=mixed -o
compression=lz4 zones/public)
I see your point with the atime, but it should be off where it matters -
i.e. manually created datasets.
-------------------------------------------
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription:
https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com
