Kein-Hong Man wrote:
For CVS version:
             | MB/sec
lua1.lua     | 5.8
Editor.cxx   | 5.5
perlfunc.pod | 8.3    # a simple file is very fast
CPAN.pm      | 1.3    # new perf not so good...
...
For 1.64 version:
...
CPAN.pm      | 5.8    # old perf comparable to Lua/C lexer

Sorry about replying to my own posts. Just a brief note: A change to the unoptimized lookback/lookforward logic can probably speed things up a lot. This involves grabbing the entire word first, then testing if it's a keyword. If it is not a keyword, then lookback/lookforward scanning does not have to be performed as there is no ambiguity. Basically, the lexer is scanning too promiscuously, so we want to perform additional scanning only when there is an ambiguity that needs to be resolved. There are probably other optimization opportunities too, so I think the performance hit isn't going to be that bad.

--
Cheers,
Kein-Hong Man (esq.)
Kuala Lumpur, Malaysia

_______________________________________________
Scintilla-interest mailing list
[email protected]
http://mailman.lyra.org/mailman/listinfo/scintilla-interest

Reply via email to