Nevertheless, things ought to work slightly better. I still consider network driver failing due to swap to be a bug in the driver. It should lock down memory if it's necessary. Or there is something in the bufcache swap routines or some disk driver that locks other users for inordinately long periods, especially wrt interrupts.
A machine that doesn't run out of swap should work. Not be very responsive, that's fine. Having a network driver that downright FAILS because of that is a bug.

