On 30.10.2014 17:12, Dennis Jacobfeuerborn wrote: > Hi, > I just put haproxy into use on a site and while things seem to work I > noticed that the frontend shows 20 mio. sessions handled total but under > errors/req it shows a number of 5 mio. These 5 mio. seem to correspond > to the number of 4xx reponses shown when i hover over the sessions/total > entry on the stats page. > > When I send "show errors" to the stats socket the output rarely changes > (maybe once every 30 seconds) even though the session rate is 700. Given > the high number of request errors reported and the rate I would expect > the output here to rapidly change. > > I also went ahead and analyzed a tcpdump in wireshark but there I only > see 22 404 responses and one 304 and all others are the expected 200 and > 302. > > Does anyone have an idea what is going on here? Why is haproxy reporting > so many 4xx responses yet I cannot see these on the wire? > What other ways are there to debug this issue? > > Regards, > Dennis >
After getting a bit more intimate with the logging settings I was able to isolate the type of request I think. It looks like this: [30/Oct/2014:18:46:36.035] front-http front-http/<NOSRV> -1/-1/-1/-1/19117 400 187 - - CR-- 49/49/0/0/0 0/0 "<BADREQ>" The documentation says that "C" means the client unexpectedly closed by the client and "R" means that some resource on the haproxy system has been exhausted. I'm not sure what that resource could be though. The system has not firewalling or connection tracking, ss/netstat only shows about 6500 connections and I also increased net.ipv4.ip_local_port_range and set net.ipv4.tcp_tw_reuse to combat any exhaustion there. The system has 2G RAM and of that 1G are free and 300M used for the page cache. Any ideas what the source of this problem could be? Regards, Dennis
