AST Node positions and content incorrect when passing down Multibyte content to
lexer
-------------------------------------------------------------------------------------
Key: JRUBY-2324
URL: http://jira.codehaus.org/browse/JRUBY-2324
Project: JRuby
Issue Type: Bug
Components: Parser
Affects Versions: JRuby 1.1RC2
Reporter: Chris Williams
Assignee: Thomas E Enebo
Priority: Blocker
In previous versions of JRuby I'd be able to pass in a Reader to the
LexerSource. Then it'd read from that. Now it takes in an InputStream and reads
one byte at a time casting the read byte to char. This breaks multibyte string
encodings. I'm getting lots of problems with Japanese users. I'm basically
passing down a ByteArrayInputStream with the string content as bytes. The
problem seems to be that the lexer is no longer multibyte aware.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe from this list, please visit:
http://xircles.codehaus.org/manage_email
