I just found this old thread and a Jira describing what seems to be the same or a very similar issue, but I have been unable to replicate the issue with the method described there:
http://activemq.2283324.n4.nabble.com/Artemis-all-messages-go-to-quot-Delivering-quot-after-a-client-crash-td4702940.html -- Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html