Re[4]: Unicode source files

2005-05-18 Thread Bulat Ziganshin
Hello Simon, Tuesday, May 17, 2005, 5:30:06 PM, you wrote: >>> The question is what Alex should see for a unicode character: Alex >>> currently assumes that characters are in the range 0-255 (you need a >>> fixed range in order to generate the lexer tables). One possibility >>> is to map all Uni

RE: Re[2]: Unicode source files

2005-05-17 Thread Simon Marlow
On 13 May 2005 11:37, Bulat Ziganshin wrote: > Thursday, May 05, 2005, 1:56:12 PM, you wrote: > >>> it is true what to support unicode source files only StringBuffer >>> implementation must be changed? > >> It depends whether you want to support several diff

Fwd: Re[2]: Unicode source files

2005-05-14 Thread Bulat Ziganshin
Sorry, Simon, are you received this message? This is a forwarded message From: Bulat Ziganshin <[EMAIL PROTECTED]> To: "Simon Marlow" <[EMAIL PROTECTED]> Date: Thursday, May 05, 2005, 10:13:37 PM Subject: Unicode source files ===8<==Original message text==

RE: Unicode source files

2005-05-05 Thread Simon Marlow
On 04 May 2005 15:57, Bulat Ziganshin wrote: > it is true what to support unicode source files only StringBuffer > implementation must be changed? It depends whether you want to support several different encodings, or just UTF-8. If we only want to support UTF-8, then we can ke

Unicode source files

2005-05-05 Thread Bulat Ziganshin
Hello it is true what to support unicode source files only StringBuffer implementation must be changed? if so, then task can be simplified by converting any files read by hGetStringBuffer to UTF-32 (PackedString) representation and putting in memory array in this form. After this, we must change