FYI CASSANDRA-18665 has been committed. This makes our ci-cassandra.a.o stage jobs on 5.0 and trunk branches build and test with the in-tree script instead of cassandra-builds.
This is a significant change, lots of testing happened, but I'm still expecting some trouble (like everytime we touch ci-cassandra.a.o). Reach out if there's anything. Next step is the standalone Jenkinsfile (which will also fix devbranch on ci-cassandra.a.o on 5.0/trunk) and Jenkinsfile on k8s (repeatable CI, so anyone can repeat ci-cassandra on their own k8s cluster).