I'm running i3wm, and RAM shouldn't be an issue (I think I got 8GB).
Supposedly, another X server would provide better performance, but it's indeed troublesome to setup.
I think it's weird because lowering the FPS limit works for a while, and as son as there is some more action onscreen, it lags. Like, instantly.
