Marc Weber wrote: > I've spent the last 2 hours trying to find a way to benchmark syntax. > > The easiest way I found to reproduce the speed regression is [1] > included patches: 1148 > > results: > engine 0 0.568 total > engine 1 0.194 total (1/3 of time) > engine 2 0.564 total > > $COLUMS = 146 > $LINES = 40 > > (same happens increasing range from 1-10 to 1-100)
Did you verify that every time it runs the patterns are executed and match the same number of times? I found some variation depending on how the tests were run. > You can find a repository I started to benchmark regressions here, its > using a very similar test now. The first attemps I tried did not show > this bad expected result: > https://github.com/MarcWeber/vim-regex2-regression-tests > > results (first number is regexpengine) > > ruby 0 3.20776391029 > ruby 1 0.86368894577 > ruby 2 3.3688378334 > improvement: -290.052211 (almost 3 times slower !!) Please try again after patch 7.3.1153. > vim 0 0.0999271869659 > vim 1 0.104474067688 > vim 2 0.0911228656769 > improvement: 12.779441 (12 % faster) > > This also uses syntime and dumps the results to a file. > > @Bram: If you send me the list of files you got for testing I'll add them. I haven't kept track of what files are free to distribute and which ones are not. Please make your own collection of files. > @Bram: the patch level in source.c is not up to date? I have no source.c. > Which is the best way to submit such regression tests to Vim? I think it's better kept separately. There is no need to distribute this with Vim. For someone writing a syntax file the :syntime command should be all he needs. -- hundred-and-one symptoms of being an internet addict: 120. You ask a friend, "What's that big shiny thing?" He says, "It's the sun." /// Bram Moolenaar -- [email protected] -- http://www.Moolenaar.net \\\ /// sponsor Vim, vote for features -- http://www.Vim.org/sponsor/ \\\ \\\ an exciting new programming language -- http://www.Zimbu.org /// \\\ help me help AIDS victims -- http://ICCF-Holland.org /// -- -- You received this message from the "vim_dev" maillist. Do not top-post! Type your reply below the text you are replying to. For more information, visit http://www.vim.org/maillist.php --- You received this message because you are subscribed to the Google Groups "vim_dev" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/groups/opt_out.
