Hi there, I've got a problem with varnishstat and was hoping to find an answer here.
Basically, today, my varnish server (3.0.2) started acting very weirdly. I suspect a misconfiguration on my part was at the origin of some weirdness (like pages randomly being flushed from the cache, despite the cache being half empty), but, our website was under low traffic (nothing Varnish can't handle), and somehow everything went crazy: - varnishadm would tell me that perfectly valid commands like ban.list, vcl.list, vcl.load were wrong, returning a 105 (?) error. Preventing me from loading a configuration without doing a varnish reload/restart. - varnishstat would report a highly improbable high number of "duplicate bans removed", but the rest of the reported numbers (hit, miss, etc.) seemed pretty normal. The panicked admin that I am decided that, if I was to restart varnish, I should at least use the occasion to upgrade it to 3.0.4.; my dev server and personal machine having been running 3.0.4 for the past few month with no problems. So I run apt-get update varnish, and get the new version. Unfortunately, this made varnishstat even weirder. It now report 0 hits, 0 miss, 0 hit for pass. I also have seen negative numbers for n_wrk_*. I tried restarting varnishd, made sure that varnishstat is 3.0.4, everything is fine, my website is mostly in cache, but still varnishstat reports what I believe are wrong numbers. Has someone ever run into this problem? I can provide my configuration file if needed. Here's a varnishstat -1: client_conn 0 0.00 Client connections accepted client_drop 0 0.00 Connection dropped, no sess/wrk client_req 0 0.00 Client requests received cache_hit 0 0.00 Cache hits cache_hitpass 0 0.00 Cache hits for pass cache_miss 0 0.00 Cache misses backend_conn 0 0.00 Backend conn. success backend_unhealthy 0 0.00 Backend conn. not attempted backend_busy 271072 50.69 Backend conn. too many backend_fail 0 0.00 Backend conn. failures backend_reuse 560452 104.80 Backend conn. reuses backend_toolate 656588 122.77 Backend conn. was closed backend_recycle 0 0.00 Backend conn. recycles backend_retry 53208 9.95 Backend conn. retry fetch_head 9701 1.81 Fetch head fetch_length 0 0.00 Fetch with Length fetch_chunked 0 0.00 Fetch chunked fetch_eof 0 0.00 Fetch EOF fetch_bad 66843 12.50 Fetch had bad headers fetch_close 8116 1.52 Fetch wanted close fetch_oldhttp 74960 14.02 Fetch pre HTTP/1.1 closed fetch_zero 16 0.00 Fetch zero len fetch_failed 12 0.00 Fetch failed fetch_1xx 75267 14.07 Fetch no body (1xx) fetch_204 114 0.02 Fetch no body (204) fetch_304 0 0.00 Fetch no body (304) n_sess_mem 0 . N struct sess_mem n_sess 81 . N struct sess n_object 0 . N struct object n_vampireobject 0 . N unresurrected objects n_objectcore 0 . N struct objectcore n_objecthead 0 . N struct objecthead n_waitinglist 0 . N struct waitinglist n_vbc 772 . N struct vbc n_wrk 299 . N worker threads n_wrk_create 28 0.01 N worker threads created n_wrk_failed 14365 2.69 N worker threads not created n_wrk_max 0 0.00 N worker threads limited n_wrk_lqueue 14394 2.69 work request queue length n_wrk_queued 14644 2.74 N queued work requests n_wrk_drop 29 0.01 N dropped work requests n_backend 1 . N backends n_expired 29 . N expired objects n_lru_nuked 485 . N LRU nuked objects n_lru_moved 0 . N LRU moved objects losthdr 0 0.00 HTTP header overflows n_objsendfile 0 0.00 Objects sent with sendfile n_objwrite 2751 0.51 Objects sent with write n_objoverflow 0 0.00 Objects overflowing workspace s_sess 1 0.00 Total Sessions s_req 38843 7.26 Total Requests s_pipe 0 0.00 Total pipe s_pass 530752 99.24 Total pass s_fetch 64 0.01 Total fetch s_hdrbytes 0 0.00 Total header bytes s_bodybytes 689741 128.97 Total body bytes sess_closed 0 0.00 Session Closed sess_pipeline 271072 50.69 Session Pipeline sess_readahead 560452 104.80 Session Read Ahead sess_linger 255 0.05 Session Linger sess_herd 23065 4.31 Session herd shm_records 76246 14.26 SHM records shm_writes 203311427 38016.35 SHM writes shm_flushes 34338009106 6420719.73 SHM flushes due to overflow shm_cont 26666 4.99 SHM MTX contention shm_cycles 1234 0.23 SHM cycles through buffer sms_nreq 235 0.04 SMS allocator requests sms_nobj 541285 . SMS outstanding allocations sms_nbytes 566363 . SMS outstanding bytes sms_balloc 30696332 . SMS bytes allocated sms_bfree 2279693 . SMS bytes freed backend_req 0 0.00 Backend requests made n_vcl 2756 0.52 N vcl total n_vcl_avail 13 0.00 N vcl available n_vcl_discard 1447 0.27 N vcl discarded n_ban 0 . N total active bans n_ban_add 0 0.00 N new bans added n_ban_retire 1883994 352.28 N old bans deleted n_ban_obj_test 1883994 352.28 N objects tested n_ban_re_test 76246 14.26 N regexps tested against n_ban_dups 6 0.00 N duplicate bans removed hcb_nolock 6 0.00 HCB Lookups without lock hcb_lock 0 0.00 HCB Lookups with lock hcb_insert 11 0.00 HCB Inserts esi_errors 6 0.00 ESI parse errors (unlock) esi_warnings 6723 1.26 ESI parse warnings (unlock) accept_fail 6712 1.26 Accept failures client_drop_late 2054111 384.09 Connection dropped late uptime 23573960 4408.00 Client uptime dir_dns_lookups 5348 1.00 DNS director lookups dir_dns_failed 709796 132.72 DNS director failed lookups dir_dns_hit 50845 9.51 DNS director cached lookups hit dir_dns_cache_full 50844 9.51 DNS director full dnscache vmods 0 . Loaded VMODs n_gzip 0 0.00 Gzip operations n_gunzip 0 0.00 Gunzip operations LCK.sms.creat 0 0.00 Created locks LCK.sms.destroy 0 0.00 Destroyed locks LCK.sms.locks 0 0.00 Lock Operations LCK.sms.colls 0 0.00 Collisions LCK.smp.creat 0 0.00 Created locks LCK.smp.destroy 0 0.00 Destroyed locks LCK.smp.locks 0 0.00 Lock Operations LCK.smp.colls 0 0.00 Collisions LCK.sma.creat 0 0.00 Created locks LCK.sma.destroy 0 0.00 Destroyed locks LCK.sma.locks 0 0.00 Lock Operations LCK.sma.colls 0 0.00 Collisions LCK.smf.creat 0 0.00 Created locks LCK.smf.destroy 0 0.00 Destroyed locks LCK.smf.locks 0 0.00 Lock Operations LCK.smf.colls 0 0.00 Collisions LCK.hsl.creat 0 0.00 Created locks LCK.hsl.destroy 0 0.00 Destroyed locks LCK.hsl.locks 0 0.00 Lock Operations LCK.hsl.colls 0 0.00 Collisions LCK.hcb.creat 0 0.00 Created locks LCK.hcb.destroy 0 0.00 Destroyed locks LCK.hcb.locks 0 0.00 Lock Operations LCK.hcb.colls 0 0.00 Collisions LCK.hcl.creat 0 0.00 Created locks LCK.hcl.destroy 0 0.00 Destroyed locks LCK.hcl.locks 0 0.00 Lock Operations LCK.hcl.colls 0 0.00 Collisions LCK.vcl.creat 0 0.00 Created locks LCK.vcl.destroy 0 0.00 Destroyed locks LCK.vcl.locks 0 0.00 Lock Operations LCK.vcl.colls 0 0.00 Collisions LCK.stat.creat 0 0.00 Created locks LCK.stat.destroy 0 0.00 Destroyed locks LCK.stat.locks 0 0.00 Lock Operations LCK.stat.colls 0 0.00 Collisions LCK.sessmem.creat 0 0.00 Created locks LCK.sessmem.destroy 0 0.00 Destroyed locks LCK.sessmem.locks 0 0.00 Lock Operations LCK.sessmem.colls 0 0.00 Collisions LCK.wstat.creat 0 0.00 Created locks LCK.wstat.destroy 0 0.00 Destroyed locks LCK.wstat.locks 0 0.00 Lock Operations LCK.wstat.colls 0 0.00 Collisions LCK.herder.creat 0 0.00 Created locks LCK.herder.destroy 0 0.00 Destroyed locks LCK.herder.locks 0 0.00 Lock Operations LCK.herder.colls 0 0.00 Collisions LCK.wq.creat 0 0.00 Created locks LCK.wq.destroy 0 0.00 Destroyed locks LCK.wq.locks 0 0.00 Lock Operations LCK.wq.colls 0 0.00 Collisions LCK.objhdr.creat 0 0.00 Created locks LCK.objhdr.destroy 0 0.00 Destroyed locks LCK.objhdr.locks 0 0.00 Lock Operations LCK.objhdr.colls 0 0.00 Collisions LCK.exp.creat 0 0.00 Created locks LCK.exp.destroy 0 0.00 Destroyed locks LCK.exp.locks 0 0.00 Lock Operations LCK.exp.colls 0 0.00 Collisions LCK.lru.creat 0 0.00 Created locks LCK.lru.destroy 0 0.00 Destroyed locks LCK.lru.locks 0 0.00 Lock Operations LCK.lru.colls 0 0.00 Collisions LCK.cli.creat 0 0.00 Created locks LCK.cli.destroy 0 0.00 Destroyed locks LCK.cli.locks 0 0.00 Lock Operations LCK.cli.colls 0 0.00 Collisions LCK.ban.creat 0 0.00 Created locks LCK.ban.destroy 0 0.00 Destroyed locks LCK.ban.locks 0 0.00 Lock Operations LCK.ban.colls 0 0.00 Collisions LCK.vbp.creat 0 0.00 Created locks LCK.vbp.destroy 0 0.00 Destroyed locks LCK.vbp.locks 0 0.00 Lock Operations LCK.vbp.colls 0 0.00 Collisions LCK.vbe.creat 0 0.00 Created locks LCK.vbe.destroy 0 0.00 Destroyed locks LCK.vbe.locks 0 0.00 Lock Operations LCK.vbe.colls 0 0.00 Collisions LCK.backend.creat 0 0.00 Created locks LCK.backend.destroy 0 0.00 Destroyed locks LCK.backend.locks 0 0.00 Lock Operations LCK.backend.colls 0 0.00 Collisions SMA.memory.c_req 0 0.00 Allocator requests SMA.memory.c_fail 0 0.00 Allocator failures SMA.memory.c_bytes 0 0.00 Bytes allocated SMA.memory.c_freed 0 0.00 Bytes freed SMA.memory.g_alloc 0 . Allocations outstanding SMA.memory.g_bytes 0 . Bytes outstanding SMA.memory.g_space 0 . Bytes available SMA.Transient.c_req 0 0.00 Allocator requests SMA.Transient.c_fail 0 0.00 Allocator failures SMA.Transient.c_bytes 0 0.00 Bytes allocated SMA.Transient.c_freed 0 0.00 Bytes freed SMA.Transient.g_alloc 0 . Allocations outstanding SMA.Transient.g_bytes 0 . Bytes outstanding SMA.Transient.g_space 0 . Bytes available VBE.default(127.0.0.1,,8080).vcls 0 . VCL references VBE.default(127.0.0.1,,8080).happy 0 . Happy health probes Thanks for any help! -Hugues
_______________________________________________ varnish-misc mailing list [email protected] https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc
