Hello thefoo, thank you for this excellent an reproducible report.
I can confirm this behavior exists also in rsync 3.4.1 (Debian 13, current stable).
I checked the upstream bug tracker and couldn't find a similiar issue. I suggest you report this to upstream and link both tickets together.
Thank you Christian Buhtz
