On Thu, Dec 27, 2018 at 5:18 PM venkatram.akkin...@gmail.com <
venkatram.akkin...@gmail.com> wrote:
> First of all, thank you for the detailed answer.
>
> > LexerInput returns a primitive int. It cannot return null.
>
> Yes sir, so I get a integer value zero. EOF as you know would be a -1. I
>
First of all, thank you for the detailed answer.
> LexerInput returns a primitive int. It cannot return null.
Yes sir, so I get a integer value zero. EOF as you know would be a -1. I
believe it is returning a null character '\0'.
> The editor's lexer plumbing insists that tokens be returned
On Wed, Dec 26, 2018 at 11:35 PM venkatram.akkin...@gmail.com <
venkatram.akkin...@gmail.com> wrote:
> I have the following string which I am trying to read through
> LexerInput.read().
>
> quote
> టోకెన్
> quote
>
> ట ో క ె న ్
>
> 5 (quote) + 6(టోకెన్) + 5 (quote) + 2 new line characters that
I have the following string which I am trying to read through
LexerInput.read().
quote
టోకెన్
quote
ట ో క ె న ్
5 (quote) + 6(టోకెన్) + 5 (quote) + 2 new line characters that is a total of 18
characters. LexerInput.read() returns all the characters as expected. But it
keeps going and
