Re: [julia-users] Grammar for Julia (whitespace)

[Jake Bolewski]

There are some cases when you cannot just consume the tokenized source but have 
to drop down and do character look ahead to disambiguate at a certain point.  I 
don't know know how common that is in other languages and it happens in a 
couple of cases when parsing julia (mostly with characters which are overloaded 
to have meanings in different contexts) but would love to find out.  But as 
Stephan said it is all look ahead.. I believe there is only one place where you 
consume a token and backtrack if a condition does not hold.