On Tue, 21 Dec 2010, Shaun Cutts wrote:
ok, but in when I call parse, then my ContentHandler.characters()
callback gets a char [], and this is passed as:
(Pdb) ch
array('c', '\xa9 2010 Crane Data LLC. All rights reserved.')
so when I try unicode I get an error:
(Pdb) ch.tounicode()
*** ValueError: tounicode() may only be called on type 'u' arrays
You sure there isn't a problem with your python-java bridge? All Java
strings are always unicode
So it would seem to me that in fact I'm not getting a unicode string
here. When I try to decode in various codecs, I get problems. One
question is what is the standard name for "UCS-2" -- as when I try to
use that name it fails; is it a subset of utf-16?
UCS-2 is a predecessor to UTF-16, which doesn't handle supplementary code
points so can't hold the whole of the unicode range.
http://en.wikipedia.org/wiki/UTF-16/UCS-2
Nick