Hey Todd, XLib is indeed very difficult to use even from C, and Perl 6 alone doesn't help terribly much.
However, there is a library called xcb that is meant to give you what XLib has, but less terrible. I haven't used it myself, nor really looked at it, but I hear it's much less painful. Hope that helps! - Timo