Here's a summary of my problem: When I use p2p applications, the system runs out of buffer space. Network operations do not work; attempting to ping an internal host says no memory buffers available". It is not clear how to free any more space; one time I killed off everything and got the system to work for a short period, while less drastic measures typically have no results at all.
I have attached the "vmstat -m" output when the machine was broken... this time with a .txt extension to make it easy to browse. To summarize, only devbufs seem to be allocated in any great number, totalling 1445K. State table entries are not great in number and dwindle after networking becomes impossible. Note that this machine only has approximately 100MB of RAM. It has but one NIC, a soekris 4-port card. This problem persists independent of tagging and queueing, contrary to my original statements. What are the chances the soekris card has a memory leak, which permanently ties up devbufs? Is that even what uses devbufs? Any help would be greatly appreciated, having one's firewall suddenly go netdead and require a physical reboot from the console is quite the annoyance. -- "Curiousity killed the cat, but for a while I was a suspect" -- Steven Wright Security Guru for Hire http://www.lightconsulting.com/~travis/ -><- GPG fingerprint: 9D3F 395A DAC5 5CCC 9066 151D 0A6B 4098 0C55 1484
Memory Totals: In Use Free Requests 2114K 51K 3299971 Memory resource pool statistics Name Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle extentpl 20 222 0 197 1 0 1 1 0 8 0 phpool 40 696 0 12 7 0 7 7 0 8 0 pmappl 76 3143 0 3112 1 0 1 1 0 8 0 vmsppl 220 3143 0 3112 3 0 3 3 0 8 1 vmmpepl 88 310044 0 307225 72 2 70 70 0 8 7 vmmpekpl 88 7075 0 7048 1 0 1 1 0 8 0 aobjpl 52 1 0 0 1 0 1 1 0 8 0 amappl 40 177363 0 175010 26 0 26 26 0 8 2 bufpl 116 2 0 2 1 0 1 1 0 8 1 mbpl 256 6170973 0 6170290 55 11 44 44 1 8 1 mclpl 2048 1801972 0 1801493 254 0 254 254 4 3072 14 sockpl 204 278 0 239 3 0 3 3 0 8 0 procpl 328 3152 0 3112 4 0 4 4 0 8 0 zombiepl 72 3112 0 3112 1 0 1 1 0 8 1 ucredpl 80 2524 0 2508 1 0 1 1 0 8 0 pgrppl 24 63 0 41 1 0 1 1 0 8 0 sessionpl 48 29 0 10 1 0 1 1 0 8 0 pcredpl 24 3152 0 3112 1 0 1 1 0 8 0 lockfpl 52 6 0 4 1 0 1 1 0 8 0 filepl 48 17901 0 17777 2 0 2 2 0 8 0 fdescpl 292 3153 0 3112 4 0 4 4 0 8 1 pipepl 72 844 0 824 1 0 1 1 0 8 0 sigapl 316 3143 0 3112 4 0 4 4 0 8 1 wdcspl 96 5978 0 5978 1 0 1 1 0 8 1 scxspl 128 19 0 19 1 0 1 1 0 8 1 pfiaddrpl 100 91 0 4 3 0 3 3 0 8 0 namei 1024 36742 0 36742 1 0 1 1 0 8 1 vnodes 160 1310 0 0 53 0 53 53 0 8 0 nchpl 72 1310 0 0 24 0 24 24 0 8 0 ffsino 284 1932 0 626 94 0 94 94 0 8 0 dirhash 1024 75 0 16 15 0 15 15 0 8 0 pfrulepl 628 249 0 70 40 1 39 40 0 8 8 pfstatepl 268 110053 0 107594 219 0 219 219 0 2000 32 pfaltqpl 128 12 0 6 1 0 1 1 0 8 0 pfpooladdrpl 68 31 0 4 1 0 1 1 0 8 0 pfrktable 1240 7 0 4 2 0 2 2 0 334 0 pfrkentry 156 64 0 31 3 0 3 3 0 3847 1 pfosfpen 108 1035 0 690 14 4 10 10 0 8 0 pfosfp 28 564 0 376 2 0 2 2 0 8 0 pffrent 16 1 0 1 1 0 1 1 0 20 1 pffrag 48 1 0 1 1 0 1 1 0 12 1 rtentpl 108 68 0 20 2 0 2 2 0 8 0 rttmrpl 32 1 0 1 1 0 1 1 0 8 1 tcpcbpl 400 19 0 8 2 0 2 2 0 8 0 tcpqepl 16 11 0 11 1 0 1 1 0 13 1 sackhlpl 20 383 0 383 1 0 1 1 0 163 1 synpl 184 5 0 5 1 0 1 1 0 8 1 plimitpl 152 18 0 11 1 0 1 1 0 8 0 inpcbpl 216 190 0 174 2 0 2 2 0 8 1 ipsec policy 212 2 0 0 1 0 1 1 0 8 0 cryptop 52 634 0 634 1 0 1 1 0 8 1 cryptodesc 56 1268 0 1268 1 0 1 1 0 8 1 In use 3100K, total allocated 3684K; utilization 84.1% Memory statistics by bucket size Size In Use Free Requests HighWater Couldfree 16 6681 743 492665 1280 0 32 1234 174 2740814 640 0 64 734 98 33690 320 0 128 421 27 9868 160 0 256 270 18 16860 80 0 512 74 6 4183 40 0 1024 262 6 1744 20 0 2048 545 3 1022 10 0 4096 16 1 500 5 0 8192 10 0 10 5 0 16384 1 0 1 5 0 32768 8 0 18 5 0 Memory usage type by bucket size Size Type(s) 16 devbuf, pcb, routetbl, ifaddr, sysctl, vnodes, namecache, dirhash, in_multi, exec, pfkey data, xform_data, VM swap, UVM amap, UVM aobj, packet tags, temp 32 devbuf, pcb, routetbl, ifaddr, vnodes, UFS mount, sem, dirhash, proc, VFS cluster, ether_multi, pfkey data, xform_data, VM swap, UVM amap, crypto data, IPsec creds, packet tags, temp 64 devbuf, pcb, routetbl, ifaddr, sem, dirhash, in_multi, pfkey data, xform_data, UVM amap, IPsec creds, packet tags, NDP, temp 128 devbuf, routetbl, ifaddr, iov, vnodes, ttys, exec, pfkey data, tdb, UVM amap, crypto data, NDP 256 devbuf, routetbl, ifaddr, sysctl, ioctlops, vnodes, shm, VM map, proc, NFS srvsock, NFS daemon, ttys, pfkey data, newblk, UVM amap, temp 512 devbuf, pcb, ifaddr, ioctlops, mount, UFS mount, shm, dirhash, exec, pfkey data, UVM amap, crypto data, temp 1024 devbuf, ioctlops, namecache, proc, ttys, exec, tdb, UVM amap, UVM aobj, crypto data, temp 2048 devbuf, ifaddr, ioctlops, pagedep, VM swap, UVM amap, temp 4096 devbuf, ioctlops, UFS mount, MSDOSFS mount, temp 8192 devbuf, NFS node, namecache, UFS quota, UFS mount, ISOFS mount, inodedep, VM swap 16384 devbuf 32768 devbuf Memory statistics by type Type Kern Type InUse MemUse HighUse Limit Requests Limit Limit Size(s) devbuf 1212 1444K 1445K 14684K 1323 0 0 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768 pcb 32 4K 4K 14684K 97 0 0 16,32,64,512 routetbl 114 9K 9K 14684K 333 0 0 16,32,64,128,256 ifaddr 81 15K 15K 14684K 83 0 0 16,32,64,128,256,512,2048 sysctl 2 1K 1K 14684K 2 0 0 16,256 ioctlops 0 0K 4K 14684K 10345 0 0 256,512,1024,2048,4096 iov 0 0K 1K 14684K 52 0 0 128 mount 1 1K 1K 14684K 1 0 0 512 NFS node 1 8K 8K 14684K 1 0 0 8192 vnodes 767 30K 44K 14684K 1279 0 0 16,32,128,256 namecache 4 18K 18K 14684K 4 0 0 16,1024,8192 UFS quota 1 8K 8K 14684K 1 0 0 8192 UFS mount 5 17K 17K 14684K 5 0 0 32,512,4096,8192 shm 2 1K 1K 14684K 2 0 0 256,512 VM map 3 1K 1K 14684K 3 0 0 256 sem 2 1K 1K 14684K 2 0 0 32,64 dirhash 48 9K 9K 14684K 60 0 0 16,32,64,512 proc 12 3K 3K 14684K 12 0 0 32,256,1024 VFS cluster 0 0K 1K 14684K 239 0 0 32 NFS srvsock 2 1K 1K 14684K 2 0 0 256 NFS daemon 1 1K 1K 14684K 1 0 0 256 in_multi 46 2K 2K 14684K 46 0 0 16,64 ether_multi 16 1K 1K 14684K 16 0 0 32 ISOFS mount 1 8K 8K 14684K 1 0 0 8192 MSDOSFS mount 1 4K 4K 14684K 1 0 0 4096 ttys 420 245K 245K 14684K 420 0 0 128,256,1024 exec 0 0K 2K 14684K 4107 0 0 16,128,512,1024 pfkey data 8 1K 2K 14684K 271 0 0 16,32,64,128,256,512 tdb 5 3K 6K 14684K 42 0 0 128,1024 xform_data 4 1K 1K 14684K 737 0 0 16,32,64 pagedep 1 2K 2K 14684K 1 0 0 2048 inodedep 1 8K 8K 14684K 1 0 0 8192 newblk 1 1K 1K 14684K 1 0 0 256 VM swap 7 19K 19K 14684K 7 0 0 16,32,2048,8192 UVM amap 7124 238K 258K 14684K 541002 0 0 16,32,64,128,256,512,1024,2048 UVM aobj 2 2K 2K 14684K 2 0 0 16,1024 crypto data 12 3K 5K 14684K 132 0 0 32,128,512,1024 IPsec creds 8 1K 1K 14684K 104 0 0 32,64 packet tags 246 8K 9K 14684K 2653295 0 0 16,32,64 NDP 13 2K 2K 14684K 17 0 0 64,128 temp 56 10K 14K 14684K 87331 0 0 16,32,64,256,512,1024,2048,4096