How are you starting X in the first place? Are you using a display manager? Are you running startx?
In the former case, this is perfectly normal for many display managers, including SDDM. GDM, if I'm not mistaken, can and does run X as a regular user if possible. Upstream has been talking about adding this functionality to SDDM for a while, but so far it still hasn't been merged.
