On Fri, Oct 27, 2023 at 02:46:39PM +0200, Ronald Klop wrote:
Mmm. Your pool has a lot of space left. So that is good.
About gstat / iostat, yes during the daily scan would be nice. The numbers
outside of the daily scan can also help as a reference.
NB: There were talks on the ML about vnode re-use problems. But I think that was under
a much higher load on the FS. Like 20 find processes in parallel on millions of files.
Like this:
https://cgit.freebsd.org/src/commit/?id=054f45e026d898bdc8f974d33dd748937dee1d6b and
https://cgit.freebsd.org/src/log/?qt=grep&q=vnode&showmsg=1
These improvements also ended up in 14.
OK. This is on stable/14-n265566-4533fa42ad91 arm64 built on Oct 21st and
I've verified vfs_subr.o was built on that date.
Nothing jumps out at me from sysctl output, but I hardly know a thing about
this in particular. What do you think?
# sysctl -a | grep vnode
kern.maxvnodes: 212370
kern.ipc.umtx_vnode_persistent: 0
vm.vnode_pbufs: 256
vm.stats.vm.v_vnodepgsout: 1825669
vm.stats.vm.v_vnodepgsin: 8165147
vm.stats.vm.v_vnodeout: 59017
vm.stats.vm.v_vnodein: 795355
vfs.wantfreevnodes: 53092
vfs.freevnodes: 95043
vfs.vnodes_created: 40292208
vfs.numvnodes: 102660
vfs.vnode.vnlru.uma_reclaim_calls: 0
vfs.vnode.vnlru.kicks: 0
vfs.vnode.vnlru.max_free_per_call: 10000
vfs.vnode.vnlru.failed_runs: 0
vfs.vnode.vnlru.direct_recycles_free: 12193254
vfs.vnode.vnlru.recycles_free: 13211571
vfs.vnode.vnlru.recycles: 0
vfs.vnode.stats.alloc_sleeps: 0
vfs.vnode.stats.free: 95043
vfs.vnode.stats.skipped_requeues: 1769431
vfs.vnode.stats.created: 40292208
vfs.vnode.stats.count: 102660
vfs.vnode.param.wantfree: 53092
vfs.vnode.param.limit: 212370
vfs.cache.debug.vnodes_cel_3_failures: 0
vfs.cache.stats.heldvnodes: 6383
debug.vnode_domainset: <NULL>
debug.sizeof.vnode: 448
debug.fail_point.status_fill_kinfo_vnode__random_path: off
debug.fail_point.fill_kinfo_vnode__random_path: off
I let iostat run a while and the following seems representative:
device r/s w/s kr/s kw/s ms/r ms/w ms/o ms/t qlen %b
da0 100 1 401.4 4.0 70 126 0 70 10 97
pass0 0 0 0.0 0.0 0 0 0 0 0 0
kw/s gets to 700, kr/s 500. Very bursty
--
