On Friday, July 05, 2019, at 7:43 PM, Matthew Ahrens wrote:
> Given that Nagy is using recordsize=128K or 1M, writing large files, and not 
> deleting any files
No, there are deletes, they are just written once and never modified. (original 
sentence was: *The usage pattern is write once files (the are never modified, 
just read or deleted)*, maybe that was confusing.
There is fragmentation.

> What is the %frag (from "zpool list -v")?
NAME         SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH 
 ALTROOT
disk0        444G  12.9M   444G        -         -     4%     0%  1.00x  ONLINE 
 -
  da1        444G  12.9M   444G        -         -     4%     0%
disk1        444G   101M   444G        -         -     4%     0%  1.00x  ONLINE 
 -
  da2        444G   101M   444G        -         -     4%     0%
disk10      3.62T  2.21T  1.41T        -         -    72%    60%  1.00x  ONLINE 
 -
  da11      3.62T  2.21T  1.41T        -         -    72%    60%
disk11      3.62T  1.17T  2.45T        -         -    59%    32%  1.00x  ONLINE 
 -
  da12      3.62T  1.17T  2.45T        -         -    59%    32%
disk12      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da13      3.62T  2.21T  1.42T        -         -    72%    60%
disk13      3.62T  2.20T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da14      3.62T  2.20T  1.42T        -         -    72%    60%
disk14      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da15      3.62T  2.21T  1.42T        -         -    72%    60%
disk15      3.62T  1.90T  1.73T        -         -    69%    52%  1.00x  ONLINE 
 -
  da16      3.62T  1.90T  1.73T        -         -    69%    52%
disk16      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da17      3.62T  2.21T  1.42T        -         -    72%    60%
disk17      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da18      3.62T  2.21T  1.42T        -         -    72%    60%
disk18      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da19      3.62T  2.21T  1.42T        -         -    72%    60%
disk19      3.62T  2.21T  1.41T        -         -    72%    60%  1.00x  ONLINE 
 -
  da20      3.62T  2.21T  1.41T        -         -    72%    60%
disk2       3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da3       3.62T  2.21T  1.42T        -         -    72%    60%
disk20      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da21      3.62T  2.21T  1.42T        -         -    72%    60%
disk21      3.62T  2.22T  1.41T        -         -    72%    61%  1.00x  ONLINE 
 -
  da22      3.62T  2.22T  1.41T        -         -    72%    61%
disk22      3.62T  2.20T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da23      3.62T  2.20T  1.42T        -         -    72%    60%
disk23      3.62T  2.20T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da24      3.62T  2.20T  1.42T        -         -    72%    60%
disk24      3.62T  2.21T  1.41T        -         -    72%    61%  1.00x  ONLINE 
 -
  da25      3.62T  2.21T  1.41T        -         -    72%    61%
disk25      3.62T  2.21T  1.41T        -         -    72%    61%  1.00x  ONLINE 
 -
  da26      3.62T  2.21T  1.41T        -         -    72%    61%
disk26      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da27      3.62T  2.21T  1.42T        -         -    72%    60%
disk27      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da28      3.62T  2.21T  1.42T        -         -    72%    60%
disk28      3.62T  2.20T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da29      3.62T  2.20T  1.42T        -         -    72%    60%
disk29      3.62T  2.21T  1.41T        -         -    72%    60%  1.00x  ONLINE 
 -
  da30      3.62T  2.21T  1.41T        -         -    72%    60%
disk3       3.62T  2.21T  1.41T        -         -    72%    60%  1.00x  ONLINE 
 -
  da4       3.62T  2.21T  1.41T        -         -    72%    60%
disk30      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da31      3.62T  2.21T  1.42T        -         -    72%    60%
disk31      3.62T  2.21T  1.41T        -         -    72%    60%  1.00x  ONLINE 
 -
  da32      3.62T  2.21T  1.41T        -         -    72%    60%
disk32      3.62T  2.21T  1.41T        -         -    72%    61%  1.00x  ONLINE 
 -
  da33      3.62T  2.21T  1.41T        -         -    72%    61%
disk33      3.62T  2.21T  1.41T        -         -    72%    60%  1.00x  ONLINE 
 -
  da34      3.62T  2.21T  1.41T        -         -    72%    60%
disk34      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da35      3.62T  2.21T  1.42T        -         -    72%    60%
disk35      3.62T  2.21T  1.41T        -         -    72%    61%  1.00x  ONLINE 
 -
  da36      3.62T  2.21T  1.41T        -         -    72%    61%
disk36      3.62T  2.21T  1.41T        -         -    72%    61%  1.00x  ONLINE 
 -
  da37      3.62T  2.21T  1.41T        -         -    72%    61%
disk37      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da38      3.62T  2.21T  1.42T        -         -    72%    60%
disk38      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da39      3.62T  2.21T  1.42T        -         -    72%    60%
disk39      3.62T  2.21T  1.41T        -         -    72%    61%  1.00x  ONLINE 
 -
  da40      3.62T  2.21T  1.41T        -         -    72%    61%
disk4       3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da5       3.62T  2.21T  1.42T        -         -    72%    60%
disk40      3.62T  2.21T  1.41T        -         -    72%    60%  1.00x  ONLINE 
 -
  da41      3.62T  2.21T  1.41T        -         -    72%    60%
disk41      3.62T  2.21T  1.41T        -         -    72%    61%  1.00x  ONLINE 
 -
  da42      3.62T  2.21T  1.41T        -         -    72%    61%
disk42      3.62T  2.22T  1.40T        -         -    72%    61%  1.00x  ONLINE 
 -
  da43      3.62T  2.22T  1.40T        -         -    72%    61%
disk43      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da44      3.62T  2.21T  1.42T        -         -    72%    60%
disk44      3.62T  2.21T  1.42T        -         -    73%    60%  1.00x  ONLINE 
 -
  da45      3.62T  2.21T  1.42T        -         -    73%    60%
disk45      3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da46      3.62T  2.21T  1.42T        -         -    72%    60%
disk5       3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da6       3.62T  2.21T  1.42T        -         -    72%    60%
disk6       3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da7       3.62T  2.21T  1.42T        -         -    72%    60%
disk7       3.62T  2.21T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da8       3.62T  2.21T  1.42T        -         -    72%    60%
disk8       3.62T  2.21T  1.41T        -         -    72%    60%  1.00x  ONLINE 
 -
  da9       3.62T  2.21T  1.41T        -         -    72%    60%
disk9       3.62T  2.20T  1.42T        -         -    72%    60%  1.00x  ONLINE 
 -
  da10      3.62T  2.20T  1.42T        -         -    72%    60%
It's in this range (around 70%) on all machines. Maybe this is the worst, the 
others are below 70%.

Actually there is a port of mdb, but I couldn't yet make it work, but will try.

Until that one of the machines look like this now:
Mem: 2653M Active, 9526M Inact, 2594M Laundry, 40G Wired, 179M Buf, 1399M Free
ARC: 5822M Total, 2000M MFU, 3414M MRU, 19M Anon, 85M Header, 304M Other
     1264M Compressed, 4587M Uncompressed, 3.63:1 Ratio
(note the high wired and low ARC size)

vmstat -z output:
ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP

UMA Kegs:               248,      0,     261,       9,     261,   0,   0
UMA Zones:             3536,      0,     280,       0,     280,   0,   0
UMA Slabs:               80,      0,  785808,  543592,112654145,   0,   0
UMA Hash:               256,      0,      58,      47,     110,   0,   0
4 Bucket:                32,      0,     947,    5178,163102296,  11,   0
6 Bucket:                48,      0,     294,    4935,72022221,   8,   0
8 Bucket:                64,      0,     481,    4603,140124239,  21,   0
12 Bucket:               96,      0,     124,    2623,77784132,   1,   0
16 Bucket:              128,      0,     348,    2597,50709632,   1,   0
32 Bucket:              256,      0,     286,    1034,32575585,  87,   0
64 Bucket:              512,      0,     209,     471,20368911,323481,   0
128 Bucket:            1024,      0,     253,     271,27097818,71246,   0
256 Bucket:            2048,      0,     493,     175,40747929,1055730,   0
vmem:                  1856,      0,       5,       1,       5,   0,   0
vmem btag:               56,      0,  375910,  237885, 6028740,4427,   0
VM OBJECT:              256,      0,  151123,  236867,14847356,   0,   0
RADIX NODE:             144,      0,  592776,   20907,89003349,   0,   0
MAP:                    240,      0,       3,      61,       3,   0,   0
KMAP ENTRY:             120,      0,      10,     188,      10,   0,   0
MAP ENTRY:              120,      0,   67587,    3957,53576185,   0,   0
VMSPACE:               2560,      0,     888,     115,  514601,   0,   0
fakepg:                 104,      0,      15,    1391,   76322,   0,   0
64 pcpu:                  8,      0,    4050,    2862,    4538,   0,   0
mt_stats_zone:           64,      0,     417,     223,     417,   0,   0
mt_zone:                 24,      0,     417,     752,     417,   0,   0
16:                      16,      0,   16680,    8922,70774679,   0,   0
32:                      32,      0,  338299,  578201,5208736215,   0,   0
64:                      64,      0,  309469,  357961,748712647,   0,   0
128:                    128,      0, 9953499, 9171021,797764021,   0,   0
256:                    256,      0,  189470,  315625,1058014634,   0,   0
512:                    512,      0,    4435,    1005,134855257,   0,   0
1024:                  1024,      0,   60624,     280,78335798,   0,   0
2048:                  2048,      0,    1211,     205,882492694,   0,   0
4096:                  4096,      0,  144317,       7, 3564425,   0,   0
8192:                  8192,      0,     899,       5,  862668,   0,   0
16384:                16384,      0,     123,      13, 1502458,   0,   0
32768:                32768,      0,     737,       2,   61187,   0,   0
65536:                65536,      0,      63,       2, 1413112,   0,   0
SLEEPQUEUE:              80,      0,   16009,     452,   16009,   0,   0
Files:                   80,      0,    5129,    3521,54794711,   0,   0
filedesc0:             1104,      0,     943,      17,  514668,   0,   0
rangeset pctrie nodes:    144,      0,       0,       0,       0,   0,   0
TURNSTILE:              136,      0,   16009,     131,   16009,   0,   0
rl_entry:                40,      0,    1635,    4165,    1635,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0
umtx_shm:                88,      0,       0,       0,       0,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0
PROC:                  1328,      0,     945,     225,  514667,   0,   0
THREAD:                1400,      0,   15878,     130,  664145,   0,   0
cpuset:                 104,      0,      51,     693,      51,   0,   0
domainset:               40,      0,       0,       0,       0,   0,   0
audit_record:          1280,      0,       0,       0,       0,   0,   0
mbuf_packet:            256, 3355455,      20,    3037,14715456,   0,   0
mbuf:                   256, 3355455,    6321,    9732,1433929509,   0,   0
mbuf_cluster:          2048, 524288,    9199,    2369,550172149,   0,   0
mbuf_jumbo_page:       4096, 262144,      23,      89,111235476,   0,   0
mbuf_jumbo_9k:         9216,  77672,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384,  43690,       0,       0,       0,   0,   0
epoch_record pcpu:      256,      0,       4,      12,       4,   0,   0
FPU_save_area:          832,      0,       0,       0,       0,   0,   0
DMAR_MAP_ENTRY:         120,      0,       0,       0,       0,   0,   0
ttyinq:                 160,      0,     240,      60,     555,   0,   0
ttyoutq:                256,      0,     126,      69,     291,   0,   0
g_bio:                  376,      0,     177,     903,1187380626,   0,   0
nvme_request:           128,      0,       0,       0,       0,   0,   0
cryptop:                128,      0,       0,       0,       0,   0,   0
cryptodesc:             120,      0,       0,       0,       0,   0,   0
crypto_session:          24,      0,       0,       0,       0,   0,   0
vtnet_tx_hdr:            24,      0,       0,       0,       0,   0,   0
VNODE:                  480,      0,  155729,  217919, 3706308,   0,   0
VNODEPOLL:              120,      0,       0,       0,       0,   0,   0
BUF TRIE:               144,      0,    2645,  103303,  833924,   0,   0
S VFS Cache:            108,      0,  152765,  325055, 5720395,   0,   0
STS VFS Cache:          148,      0,    2229,    1645, 6532649,   0,   0
L VFS Cache:            328,      0,       0,       0,       0,   0,   0
LTS VFS Cache:          368,      0,       3,      27,     594,   0,   0
NAMEI:                 1024,      0,      15,     177,61851007,   0,   0
rentr:                   24,      0,       0,       0,       1,   0,   0
NCLNODE:                592,      0,    2693,      67,    3235,   0,   0
DIRHASH:               1024,      0,       0,       0,    6802,   0,   0
AIO:                    208,      0,     695,     103,     695,   0,   0
AIOP:                    32,      0,       4,    1121,       8,   0,   0
AIOCB:                  752,      0,       0,     120,    8305,   0,   0
AIOLIO:                 280,      0,       0,       0,       0,   0,   0
pipe:                   760,      0,     227,      98,  323556,   0,   0
procdesc:               136,      0,       0,       0,       0,   0,   0
Mountpoints:           2744,      0,      57,       3,      58,   0,   0
ksiginfo:               112,      0,    1132,    1668,    7843,   0,   0
itimer:                 352,      0,       0,       0,       0,   0,   0
KNOTE:                  160,      0,    4560,    1440,331179470,   0,   0
socket:                 872, 2091912,    3340,     332,10989503,   0,   0
IPsec SA lft_c:          16,      0,       0,       0,       0,   0,   0
unpcb:                  256, 2091915,    1587,     168,   11647,   0,   0
ipq:                     56,  16401,       0,       0,     924,   0,   0
udp_inpcb:              488, 2091912,       9,     303, 5494457,   0,   0
udpcb:                   32, 2092000,       9,    1991, 5494457,   0,   0
tcp_inpcb:              488, 2091912,    5854,     882, 5483388,   0,   0
tcpcb:                  976, 2091912,    1731,     237, 5483388,   0,   0
tcptw:                   88,  27810,    4123,    2942, 2882325,   0,   0
syncache:               168,  15364,       0,     368, 2589921,   0,   0
hostcache:               96,  15375,      55,     150,      63,   0,   0
sackhole:                32,      0,       0,       0,       1,   0,   0
tfo:                      4,      0,       0,       0,       0,   0,   0
tfo_ccache_entries:      80,      0,       0,       0,       0,   0,   0
tcpreass:                48,  32785,       0,       0,       0,   0,   0
tcp_log:                400, 1000000,       0,       0,       0,   0,   0
tcp_log_bucket:         144,      0,       0,       0,       0,   0,   0
tcp_log_node:           120,      0,       0,       0,       0,   0,   0
udplite_inpcb:          488, 2091912,       0,       0,       0,   0,   0
ripcb:                  488, 2091912,       0,       0,       0,   0,   0
rtentry:                208,      0,      25,     184,      97,   0,   0
selfd:                   64,      0,     617,    4777,49749715,   0,   0
swpctrie:               144, 8152380,       0,       0,       0,   0,   0
swblk:                  136, 8152364,       0,       0,       0,   0,   0
md0:                    512,      0,   20000,      16,   20000,   0,   0
FFS inode:              160,      0,     637,     488,  163644,   0,   0
FFS1 dinode:            128,      0,       0,       0,       0,   0,   0
FFS2 dinode:            256,      0,     637,     323,  163644,   0,   0
md1:                    512,      0,   70000,       8,   70000,   0,   0
taskq_zone:              48,      0,      27,    3708,60541155,   0,   0
range_seg_cache:         72,      0,401154406,  175259,936958313,   0,   0
metaslab_alloc_trace_cache:     72,      0,     109,    2421,79839613,   0,   0
zio_cache:             1048,      0,   14281,   15728,1508267717,   0,   0
zio_link_cache:          48,      0,   12926,   33305,1551815411,   0,   0
zio_buf_512:            512,      0,  204765,  235851,31909552,   0,   0
zio_data_buf_512:       512,      0,     161,     679,13079895,   0,   0
zio_buf_1024:          1024,      0,    5288,     980,54622734,   0,   0
zio_data_buf_1024:     1024,      0,     126,     322,20553432,   0,   0
zio_buf_1536:          1536,      0,   16611,    1383,82917761,   0,   0
zio_data_buf_1536:     1536,      0,     929,     329,31971299,   0,   0
zio_buf_2048:          2048,      0,   29577,    5471,89165883,   0,   0
zio_data_buf_2048:     2048,      0,     384,     348,28904326,   0,   0
zio_buf_2560:          2560,      0,   49197,      79,72260199,   0,   0
zio_data_buf_2560:     2560,      0,     614,      40, 9373726,   0,   0
zio_buf_3072:          3072,      0,   45210,      95,56768804,   0,   0
zio_data_buf_3072:     3072,      0,     393,      51,11084379,   0,   0
zio_buf_3584:          3584,      0,    9291,      16,13062579,   0,   0
zio_data_buf_3584:     3584,      0,     302,      23, 7717123,   0,   0
zio_buf_4096:          4096,      0,    1825,      56,27766009,   0,   0
zio_data_buf_4096:     4096,      0,     474,      15, 5766934,   0,   0
zio_buf_5120:          5120,      0,      14,      18, 3027603,   0,   0
zio_data_buf_5120:     5120,      0,     103,      21, 6085598,   0,   0
zio_buf_6144:          6144,      0,      18,      18, 3454416,   0,   0
zio_data_buf_6144:     6144,      0,      23,      12, 4472920,   0,   0
zio_buf_7168:          7168,      0,       7,      19, 2458628,   0,   0
zio_data_buf_7168:     7168,      0,      42,      18, 2811470,   0,   0
zio_buf_8192:          8192,      0,       4,      19,11385785,   0,   0
zio_data_buf_8192:     8192,      0,      27,       9, 2275252,   0,   0
zio_buf_10240:        10240,      0,       1,      16, 9670402,   0,   0
zio_data_buf_10240:   10240,      0,      63,      16, 3371396,   0,   0
zio_buf_12288:        12288,      0,       3,      13, 2861899,   0,   0
zio_data_buf_12288:   12288,      0,      31,       6, 2257287,   0,   0
zio_buf_14336:        14336,      0,       0,      10, 2040581,   0,   0
zio_data_buf_14336:   14336,      0,      42,       5, 1678085,   0,   0
zio_buf_16384:        16384,      0,  260168,     131,418283474,   0,   0
zio_data_buf_16384:   16384,      0,      32,       4,  970747,   0,   0
zio_buf_20480:        20480,      0,       0,       7, 2518819,   0,   0
zio_data_buf_20480:   20480,      0,      74,       4, 1166612,   0,   0
zio_buf_24576:        24576,      0,       0,      11, 1965132,   0,   0
zio_data_buf_24576:   24576,      0,      66,       9,  709121,   0,   0
zio_buf_28672:        28672,      0,       0,       9, 1713485,   0,   0
zio_data_buf_28672:   28672,      0,     138,       2,  413393,   0,   0
zio_buf_32768:        32768,      0,       0,       8, 3879987,   0,   0
zio_data_buf_32768:   32768,      0,     204,       0,  394874,   0,   0
zio_buf_40960:        40960,      0,       0,       5, 2760733,   0,   0
zio_data_buf_40960:   40960,      0,      22,       4,  567968,   0,   0
zio_buf_49152:        49152,      0,       8,       3, 1979670,   0,   0
zio_data_buf_49152:   49152,      0,      12,       0,  523313,   0,   0
zio_buf_57344:        57344,      0,       8,       1,  935830,   0,   0
zio_data_buf_57344:   57344,      0,      20,       3,  428245,   0,   0
zio_buf_65536:        65536,      0,       0,       4,  859034,   0,   0
zio_data_buf_65536:   65536,      0,      15,       4,  495004,   0,   0
zio_buf_81920:        81920,      0,      21,       3, 1090026,   0,   0
zio_data_buf_81920:   81920,      0,      41,       2, 1113150,   0,   0
zio_buf_98304:        98304,      0,       0,       0,  757293,   0,   0
zio_data_buf_98304:   98304,      0,      80,      12, 3194610,   0,   0
zio_buf_114688:      114688,      0,       0,       1,  961341,   0,   0
zio_data_buf_114688: 114688,      0,      20,      41, 5845432,   0,   0
zio_buf_131072:      131072,      0,     105,      31,33409816,   0,   0
zio_data_buf_131072: 131072,      0,     214,       0,  473527,   0,   0
zio_buf_163840:      163840,      0,       0,       4,  551333,   0,   0
zio_data_buf_163840: 163840,      0,       0,       0,  354686,   0,   0
zio_buf_196608:      196608,      0,       0,       1,  433177,   0,   0
zio_data_buf_196608: 196608,      0,       1,       1,  267530,   0,   0
zio_buf_229376:      229376,      0,       0,       5,  658133,   0,   0
zio_data_buf_229376: 229376,      0,       0,       0,  223489,   0,   0
zio_buf_262144:      262144,      0,       0,       0,  179902,   0,   0
zio_data_buf_262144: 262144,      0,       2,       0,  234087,   0,   0
zio_buf_327680:      327680,      0,       0,       3,  391217,   0,   0
zio_data_buf_327680: 327680,      0,       1,       0,  290371,   0,   0
zio_buf_393216:      393216,      0,       0,       1,  162296,   0,   0
zio_data_buf_393216: 393216,      0,       2,       1,  226970,   0,   0
zio_buf_458752:      458752,      0,       0,       1,  182555,   0,   0
zio_data_buf_458752: 458752,      0,       0,       0,  397721,   0,   0
zio_buf_524288:      524288,      0,       0,       0,  137104,   0,   0
zio_data_buf_524288: 524288,      0,       1,       0,  172398,   0,   0
zio_buf_655360:      655360,      0,       0,       1,  157680,   0,   0
zio_data_buf_655360: 655360,      0,       6,       2,  319532,   0,   0
zio_buf_786432:      786432,      0,       0,       0,  223276,   0,   0
zio_data_buf_786432: 786432,      0,       4,       0, 1285492,   0,   0
zio_buf_917504:      917504,      0,       0,       1,  452642,   0,   0
zio_data_buf_917504: 917504,      0,       2,       5, 1379773,   0,   0
zio_buf_1048576:     1048576,      0,       1,       2,  423567,   0,   0
zio_data_buf_1048576: 1048576,      0,      13,       0,   22693,   0,   0
zio_buf_1310720:     1310720,      0,       0,       0,       0,   0,   0
zio_data_buf_1310720: 1310720,      0,       0,       0,       0,   0,   0
zio_buf_1572864:     1572864,      0,       0,       0,       0,   0,   0
zio_data_buf_1572864: 1572864,      0,       0,       0,       0,   0,   0
zio_buf_1835008:     1835008,      0,       0,       0,       0,   0,   0
zio_data_buf_1835008: 1835008,      0,       0,       0,       0,   0,   0
zio_buf_2097152:     2097152,      0,       0,       0,       0,   0,   0
zio_data_buf_2097152: 2097152,      0,       0,       0,       0,   0,   0
zio_buf_2621440:     2621440,      0,       0,       0,       0,   0,   0
zio_data_buf_2621440: 2621440,      0,       0,       0,       0,   0,   0
zio_buf_3145728:     3145728,      0,       0,       0,       0,   0,   0
zio_data_buf_3145728: 3145728,      0,       0,       0,       0,   0,   0
zio_buf_3670016:     3670016,      0,       0,       0,       0,   0,   0
zio_data_buf_3670016: 3670016,      0,       0,       0,       0,   0,   0
zio_buf_4194304:     4194304,      0,       0,       0,       0,   0,   0
zio_data_buf_4194304: 4194304,      0,       0,       0,       0,   0,   0
zio_buf_5242880:     5242880,      0,       0,       0,       0,   0,   0
zio_data_buf_5242880: 5242880,      0,       0,       0,       0,   0,   0
zio_buf_6291456:     6291456,      0,       0,       0,       0,   0,   0
zio_data_buf_6291456: 6291456,      0,       0,       0,       0,   0,   0
zio_buf_7340032:     7340032,      0,       0,       0,       0,   0,   0
zio_data_buf_7340032: 7340032,      0,       0,       0,       0,   0,   0
zio_buf_8388608:     8388608,      0,       0,       0,       0,   0,   0
zio_data_buf_8388608: 8388608,      0,       0,       0,       0,   0,   0
zio_buf_10485760:    10485760,      0,       0,       0,       0,   0,   0
zio_data_buf_10485760: 10485760,      0,       0,       0,       0,   0,   0
zio_buf_12582912:    12582912,      0,       0,       0,       0,   0,   0
zio_data_buf_12582912: 12582912,      0,       0,       0,       0,   0,   0
zio_buf_14680064:    14680064,      0,       0,       0,       0,   0,   0
zio_data_buf_14680064: 14680064,      0,       0,       0,       0,   0,   0
zio_buf_16777216:    16777216,      0,       0,       0,       0,   0,   0
zio_data_buf_16777216: 16777216,      0,       0,       0,       0,   0,   0
lz4_ctx:              16384,      0,       0,      29,38974174,   0,   0
abd_chunk:             4096,      0,  266103,     181,98261777,   0,   0
sa_cache:               144,      0,  152096,  316624, 3538779,   0,   0
dnode_t:                728,      0,  199451,  177619, 3495451,   0,   0
arc_buf_hdr_t_full:     256,      0,  284660,  239125,3817286007,   0,   0
arc_buf_hdr_t_l2only:     96,      0,       0,       0,       0,   0,   0
arc_buf_t:               64,      0,  264446,  248542,433755940,   0,   0
dmu_buf_impl_t:         240,      0,  460891,  517061,19159842,   0,   0
zil_lwb_cache:          320,      0,    1787,     589, 9166646,   0,   0
zil_zcw_cache:           80,      0,      10,    1640,11532755,   0,   0
sio_cache:              128,      0,       0,       0,       0,   0,   0
zfs_znode_cache:        272,      0,  152096,  276038, 3538779,   0,   0
TMPFS dirent:            64,      0,     100,    2442,     257,   0,   0
TMPFS node:             232,      0,     101,     630,     258,   0,   0
TMPFS dirent:            64,      0,      66,     554,      67,   0,   0
TMPFS node:             232,      0,      67,     137,      68,   0,   0
TMPFS dirent:            64,      0,       1,      61,     184,   0,   0
TMPFS node:             232,      0,       2,      32,     185,   0,   0
pf mtags:                48,      0,       0,       0,       2,   0,   0
pf tags:                104,      0,       0,       0,       0,   0,   0
pf states:              296, 100009,   21069,    1369,15716514,   0,   0
pf state keys:           88,      0,   21069,    3591,15716514,   0,   0
pf source nodes:        136,  10005,       0,       0,       0,   0,   0
pf table entries:       216, 200016,      12,      24,      12,   0,   0
pf frags:               112,      0,       0,       0,       0,   0,   0
pf frag entries:         40,   5000,       0,       0,       0,   0,   0
pf state scrubs:         40,      0,       0,       0,       0,   0,   0

As for the clean import, I also thought of this, but left it out. No, the 
machines were mostly forcefully rebooted. Could it cause effects like this?
------------------------------------------
openzfs: openzfs-developer
Permalink: 
https://openzfs.topicbox.com/groups/developer/T10533b84f9e1cfc5-M147be061b14fc6c8d1d4b70c
Delivery options: https://openzfs.topicbox.com/groups/developer/subscription

Reply via email to