I found out - it's the backoff config for the cleaner. Lowering it and the number of keys written causes the test to finish in ~1.5s. Awesome!
[ Full content available at: https://github.com/apache/kafka/pull/5439 ] This message was relayed via gitbox.apache.org for devnull@infra.apache.org