> What do you think? If you agree I will implement it as part of my
> type4+tokeniser patch.
It looks good to me.
The easiest way to implement it in the token reader would probably
be to replace the "reader->state = X" statements with calls to a
private function (e.g. enter_state) that would also store the
token's starting position. Then in flush_token, store this value
when emitting a token.
Many thanks for the hints :)
I just merged the type4+tokeniser patch in the trunk. All the unit
tests for the type 4 functions are passing.
--
Jose E. Marchesi <[email protected]>
http://www.jemarch.net
GNU Project http://www.gnu.org
