> Apart from that I really don't like to pull the "actually what you are asking > is not what you want" card, but this is not how you should write a lexer.
I'd like to, but it's for a class assignment, so I have to do it by hand. Also, I want to learn how it can be done on lower level of abstraction. No problem pulling this card. It's always nice to show the other way.
