Hi, HAProxy 2.4-dev10 was released on 2021/02/26. It added 78 new commits after version 2.4-dev9.
The number of bugs is shrinking and starting to allow some of us to work on cleanups and documentation, which is always pleasant as it immediately gives a feeling of higher quality. Among the bugs, Dragan addressed a long-standing issue in the way variables are used as arguments to converters. First they were never locked, resulting in bad things when accessing shared variables in the "proc" scope. And the argument was improperly checked: if it didn't parse it was implicitly a variable, but that could die in some circumstances (such as truncated base64 values to "base64"). Dragan had no other option but to add boot-time config checks that may trigger errors on currently invalid configs that silently validate. I know we'll need to backport this, this is always a bit of a pain. If it proves to be problematic in stable releases, we could try to replace the error with a warning and use whatever we find reliable enough. There were a number fixes made to the resolvers and state file, I guess some of them will need to be backported. The cleanups consisting in replacing "free(a->b); a->b = NULL;" with "ha_free(&a->b);" were made. 178 entries were fixed and a few occurrences that could become dangerous in the long run were addressed at the same time; A number of the low-hanging fruits in the scheduler were addressed. First, by making a few variables and lists thread-local instead of shared, we could increase the max request rate by 25% under 16 threads. Second, a progress was made in the long quest to lower the SSL handshake impact on clear text: the total request-response time at 99.9 percentile under 100% handshake traffic was divided by 20. In short, a 8-core machine saturated delivering 12000 RSA2048 key computations per second managed to keep the HTTP response time below 1 millisecond vs 14 avg in dev9. These changes were made so that most of them could be backported with minimal effort, and I think that once sufficiently tested, 2.3 and 2.2 could benefit from them (with a bit less expected returns). Some developers doc was updated or addedd for the HTX API, filters, muxes and scheduler. And the forwardfor and originalto options now support IPv6 in addition to IPv4. I'm aware of more doc and cleanups being in progress, so far so good, let's keep up the good work and we could soon be rewarded by the cleanest dot-zero release in history :-) Please find the usual URLs below : Site index : http://www.haproxy.org/ Discourse : http://discourse.haproxy.org/ Slack channel : https://slack.haproxy.org/ Issue tracker : https://github.com/haproxy/haproxy/issues Wiki : https://github.com/haproxy/wiki/wiki Sources : http://www.haproxy.org/download/2.4/src/ Git repository : http://git.haproxy.org/git/haproxy.git/ Git Web browsing : http://git.haproxy.org/?p=haproxy.git Changelog : http://www.haproxy.org/download/2.4/src/CHANGELOG Cyril's HTML doc : http://cbonte.github.io/haproxy-dconv/ Willy --- Complete changelog : Amaury Denoyelle (1): BUG/MINOR: stats: fix compare of no-maint url suffix Baptiste Assmann (1): BUG/MINOR: resolvers: new callback to properly handle SRV record errors Christopher Faulet (31): BUG/MINOR: resolvers: Fix condition to release received ARs if not assigned BUG/MINOR: resolvers: Only renew TTL for SRV records with an additional record BUG/MEDIUM: resolvers: Reset server address and port for obselete SRV records BUG/MEDIUM: resolvers: Reset address for unresolved servers DOC: Update the module list in MAINTAINERS file MINOR: htx: Add function to reserve the max possible size for an HTX DATA block DOC: Update the HTX API documentation DOC: Update the filters guide MINOR: server: Be more strict on the server-state line parsing MINOR: server: Only fill one array when parsing a server-state line MEDIUM: server: Refactor apply_server_state() to make it more readable CLEANUP: server: Rename state_line node to node instead of name_name CLEANUP: server: Rename state_line structure into server_state_line CLEANUP: server: Use a local eb-tree to store lines of the global server-state file MINOR: server: Be more strict when reading the version of a server-state file MEDIUM: server: Store parsed params of a server-state line in the tree MINOR: server: Remove cached line from global server-state tree when found MINOR: server: Move loading state of servers in a dedicated function MEDIUM: server: Use a tree to store local server-state lines MINOR: server: Parse and store server-state lines in a dedicated function MEDIUM: server: Don't load server-state file if a line is corrupted REORG: server: Export and rename some functions updating server info REORG: server-state: Move functions to deal with server-state in its own file MINOR: server-state: Don't load server-state file for serverless proxies CLEANUP: muxes: Remove useless if condition in show_fd function BUG/MINOR: http-ana: Only consider dst address to process originalto option MINOR: tools: Add net_addr structure describing a network addess MINOR: tools: Add function to compare an address to a network address MEDIUM: http-ana: Add IPv6 support for forwardfor and orignialto options CLEANUP: hlua: Use net_addr structure internally to parse and compare addresses REGTESTS: Add script to test except param for fowardedfor/originalto options Dragan Dosen (3): BUG/MINOR: sample: secure convs that accept base64 string and var name as args BUG/MEDIUM: vars: make functions vars_get_by_{name,desc} thread-safe CLEANUP: vars: make smp_fetch_var() to reuse vars_get_by_desc() Eric Salama (1): BUG/MINOR: ssl: potential null pointer dereference in ckchs_dup() Ilya Shipitsin (1): BUILD: SSL: introduce fine guard for RAND_keep_random_devices_open Tim Duesterhus (1): MINOR: Configure the `cpp` userdiff driver for *.[ch] in .gitattributes William Dauchy (1): BUG/MEDIUM: contrib/prometheus-exporter: fix segfault in listener name dump William Lallemand (1): BUG/MINOR: ssl/cli: potential null pointer dereference in "set ssl cert" Willy Tarreau (37): DOC: muxes: add a diagram of the exchanges between muxes and outer world BUG/MEDIUM: proxy: use thread-safe stream killing on hard-stop BUG/MEDIUM: cli/shutdown sessions: make it thread-safe BUG/MINOR: proxy: wake up all threads when sending the hard-stop signal MINOR: stream: add an "epoch" to figure which streams appeared when MINOR: cli/streams: make "show sess" dump all streams till the new epoch MINOR: streams: use one list per stream instead of a global one MEDIUM: streams: do not use the streams lock anymore BUILD: dns: avoid a build warning when threads are disabled (dss unused) MEDIUM: task: remove the tasks_run_queue counter and have one per thread MINOR: tasks: do not maintain the rqueue_size counter anymore CLEANUP: tasks: use a less confusing name for task_list_size CLEANUP: task: move the tree root detection from __task_wakeup() to task_wakeup() MINOR: task: limit the remote thread wakeup to the global runqueue only MINOR: task: move the allocated tasks counter to the per-thread struct CLEANUP: task: split the large tasklet_wakeup_on() function in two BUG/MINOR: fd: properly wait for !running_mask in fd_set_running_excl() MINOR: task: split the counts of local and global tasks picked MINOR: task: do not use __task_unlink_rq() from process_runnable_tasks() MINOR: task: don't decrement then increment the local run queue CLEANUP: task: re-merge __task_unlink_rq() with task_unlink_rq() MINOR: task: make grq_total atomic to move it outside of the grq_lock MINOR: tasks: also compute the tasklet latency when DEBUG_TASK is set MINOR: task: make tasklet wakeup latency measurements more accurate MINOR: task: limit the number of subsequent heavy tasks with flag TASK_HEAVY MINOR: ssl: mark the SSL handshake tasklet as heavy CLEANUP: server: rename srv_cleanup_{idle,toremove}_connections() MINOR: task: add one extra tasklet class: TL_HEAVY MINOR: task: place the heavy elements in TL_HEAVY MINOR: task: only limit TL_HEAVY tasks but not others DOC: scheduler: add a diagram showing the different queues and their usages CLEANUP: tree-wide: replace free(x);x=NULL with ha_free(&x) CLEANUP: config: replace a few free() with ha_free() CLEANUP: vars: always zero the pointers after a free() CLEANUP: ssl: remove a useless "if" before freeing an error message CLEANUP: ssl: make ssl_sock_free_srv_ctx() zero the pointers after free CLEANUP: ssl: use realloc() instead of free()+malloc() ---

