----- Original Message ----- From: "Chan Fook Sheng" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Friday, May 07, 2004 10:03 AM Subject: any unicode conversion tools?
> Hi > > I am looking for unicode, utf-8 coonversion tools for windows platform, > but can't find any on the web. > > can anyone direct me to some links? > > for example: the "/" character is 47 in decimal, 2F in hex. > > it can be represented in UTF-8 format as: > 1 byte: still 2F > 2 bytes: C0 AF (illegal) > 3 bytes: E0 80 AF (illegal) How should the conversion tools handle the illegal sequences? If you want them accepted as if they were legal then I think the best way is to pass the text thru a filter before feeding it to a conversion tool. Writing a filter that replaces the illegal sequences by legal ones should not be hard.
