We're using HAProxy 1.6.3 to load balance and route HTTP traffic to hundreds of backend servers. We reload the config often (several times a day), both automatically when a server fails and manually for administrative reasons.
The problem is that running the reload command takes 3 minutes on one of our HAProxy servers (Ubuntu server 16.04). It does not seem to matter whether the server has traffic or not. On our other servers with the same version of OS and HAProxy, the reload takes 1-5 seconds, regardless of load. We have a bunch of long-running requests but as I said it does not seem to matter if the server has traffic or not. We can see that a new process is spawned, but then it takes a few minutes before it starts accepting traffic (or at least until the CPU usage of the new process climbs above 0% and the it emits log messages about starting backends). Questions: - What can cause HAProxy to take so long to reload? - How can we find out what it's doing? For instance, what level of logging do we need to enable and what would we look for in the log? - Do you have a suggestion for a fix? Thanks! ---------------------------- Joel W Kall

