Do you mind to share a dmesg ? If I had to take a guess on why, I would say there is some pretty aggressive USB power-saving powering down the device when there is no activity. Also, it doesn't seem related to your device nor your OS. So a dmesg would give more details on your machine and might help to explain why these detach keep happening.
-- Cordialement, Coues Ludovic +336 148 743 42