I am going to play devils advocate here, with a pinch of genuine ignorance.
Drivers aside, principles aside, what actual harm can non free gpu firmware do? What's the difference than say the software on my calculator? Could it not just be considered some sort of "soft circuit"? I understand the security risks on ethernet, wifi or CPU, but what about GPU?
