Hi guys I know HW recommendations are based on the type of load. We currently have a LB setup comprised of 3 Internet facing nodes used for transactional requests. Currently around 100k/s HTTP requests (+12k tcp session rate) This is split in 3 nodes and avg session time is 1.5s for HTTP traffic. And these LB's also do TCP relaying to other HAproxy nodes doing TLS termination. They relay around 30k SSL requests/s(12k TCP session rate). We want to keep our latency as low as possible.
Currently we have 3x 4core nodes running as HTTP and TCP load balancers. One of these 3 nodes are older and we are thinking of replacing it or all of the 3 internet facing nodes. The two newer nodes can handle the traffic when they are just two, but it's close to the edge I feel. Especially if we would get more traffic. And we've had cases when HAproxy is in a state where it doesn't work with just two(like when you've done a bunch of reload instead of restarts). They have E3-1280 v6 @ 3.90GHz. I'm having a hard time choosing hardware. One thought is that in the future TLS termination will probably increase, currently its 100k HTTP + 30k TLS(which currently are relayed to the HAproxy TLS LB). But one would perhaps design the machine to be a bit future proof. And 1 socket 4 core nodes feels that it won't be so scalable. At one hand I have to choose a CPU is either +2Ghz with more cores or a CPU with +3Ghz with less cores. And after that I have to choose if I'm going to go with 2 sockets and less nodes or 1 socket with more nodes. One could argue throwing more hardware would solve a bit of the problem that that it causes (problems that comes with multiple cores + sockets). For instance looking at Dell latest generation(G14) CPU offering. If looking at what I consider decently priced CPU. You have the option to go for around +2GHz mult core Intel® Xeon® Gold 6132 2.6G,14C Intel® Xeon® Gold 5120 2.2G,14C - litte bit cheaper Or you can go for +3Ghz with a bit less cores. Intel Xeon Gold 5122 3.6G,4C - little bit cheaper Intel Xeon Gold 6128 3.4G,6C - not available in for PE R440 (only PE R640) Intel Xeon Gold 6136 3.0G,12C - not available in for PE R440 (only PE R640) And then you have the super expensive 3Ghz CPUs. Intel Xeon Gold 6134 3.2G,8C - not available in for PE R440 (only PE R640) Intel Xeon Gold 6154 3.0G,18C - not available in for PE R440 (only PE R640) Intel Xeon Gold 6144 3.5G,8C - not available in for PE R440 (only PE R640) I have a hard time choosing 2ghz or 3ghz? 1 socket or 2 socket? Any advice? Thanks, Elias
