I'm trying to build an HTML5 Parser in Smalltalk and as a first step I'm 
implementing the tokenizer and everything happens there. I think this is the 
case only when we have scripts that add characters to the HTML document which 
is out of the scope of the project I am working on at the moment. Is this true 
or not ?
Thanks
Mohammad


-----Original Message-----
From: Bjoern Hoehrmann [mailto:[email protected]] 
Sent: Friday, March 15, 2013 11:30 PM
To: Mohammad Al Houssami (Alumni)
Cc: [email protected]
Subject: Re: [whatwg] Tokenizor PseudoCode

* Mohammad Al Houssami (Alumni) wrote:
>I just want to make sure that in places where no state change is called 
>it means we stay in the same state right?

You missed "When a token is emitted, it must immediately be handled by the tree 
construction stage. The tree construction stage can affect the state of the 
tokenization stage ..." but if that does not result in a change of state 
either, then yes, as far as I am aware.
--
Björn Höhrmann · mailto:[email protected] · http://bjoern.hoehrmann.de Am 
Badedeich 7 · Telefon: +49(0)160/4415681 · http://www.bjoernsworld.de
25899 Dagebüll · PGP Pub. KeyID: 0xA4357E78 · http://www.websitedev.de/ 


Reply via email to