I have the following string which I am trying to read through 
LexerInput.read(). 

quote
టోకెన్
quote

ట ో క ె న ్

5 (quote) + 6(టోకెన్) + 5 (quote) + 2 new line characters that is a total of 18 
characters. LexerInput.read() returns all the characters as expected. But it 
keeps going and returns null characters for each call to LexerInput.read().  

I tried to stop at the first null character, backup one character and return a 
null. But this is the error I see.

I guess it makes sense since LexerInputOperation doesn't allow resetting the 
offsets,

> returned null token but lexerInput.readLength()=1
> lexer-state: DEFAULT_STATE
> tokenStartOffset=18, readOffset=19, lookaheadOffset=19
> Chars: "


I realise this may not actually have anything to do with netbeans. Since there 
is a decent chance people may have seen this behaviour before, any insight 
would be helpful. 

Thanks

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists



Reply via email to