When yout try plug-in card is there something in dmesg, cfgadm, ::prtusb -v in mdb -k and similar places?
Did you try remove your old configuration for VNC eg. in /export/home folder? SSH connection is working? -- This message posted from opensolaris.org