That's right, you can only get the normally looking and working volume control dialog with PulseAudio backend. With GStreamer one the volume control dialog is practically useless - especially if GStreamer "ends up using pulse underneath".
If PulseAudio is installed in the system (and it is), you need a PulseAudio-compatible volume control dialog - for example, to manage input/output devices effectively.