Comment #1 on issue 200 by mikesamuel: Format control characters should be stripped before evaluating http://code.google.com/p/v8/issues/detail?id=200
EcmaScript 5 says that format control characters are not stripped. The BOM is treated as whitespace outside string literals. And some other kinds of format control character are allowed in identifiers after the start. In no case are format control characters simply removed from the input stream as under ES 262 3rd edition. From http://www.ecmascript.org/docs/tc39-2009-043.pdf 7.1 Unicode Format-Control Characters The Unicode format-control characters (i.e., the characters in category --Cf|| in the Unicode Character Database such as LEFT-TO-RIGHT MARK or RIGHT-TO-LEFT MARK) are control codes used to control the formatting of a range of text in the absence of higher-level protocols for this (such as mark-up languages). It is useful to allow format-control characters in source text to facilitate editing and display. All format control characters may be used within comments, and within string literals and regular expression literals. <ZWNJ> and <ZWJ> are format-control characters that are used to make necessary distinctions when forming words or phrases in certain languages. In ECMAScript source text, <ZWNJ> and <ZWJ> may also be used in an identifier after the first character. <BOM> is a format-control character used primarily at the start of a text to mark it as Unicode and to allow detection of the text's encoding and byte order. <BOM> characters intended for this purpose can sometimes also appear after the start of a text, for example as a result of concatenating files. <BOM> characters are treated as white space characters (see 7.2). The special treatment of certain format-control characters outside of comments, string literals, and regular expression literals is summarized in Table 1. Table 1 -- Format-Control Character Usage Code Unit Value Name Formal Name Usage \u200C Zero width non-joiner <ZWNJ> IdentifierPart \u200C Zero width joiner <ZWJ> IdentifierPart \uFEFF Byte Order Mark <BOM> Whitespace -- You received this message because you are listed in the owner or CC fields of this issue, or because you starred this issue. You may adjust your issue notification preferences at: http://code.google.com/hosting/settings --~--~---------~--~----~------------~-------~--~----~ v8-dev mailing list [email protected] http://groups.google.com/group/v8-dev -~----------~----~----~----~------~----~------~--~---
