luigi scarso <luigi.sca...@gmail.com> writes: > It's not a huge difference, but it can integrated better with mkiv; see > http://meeting.contextgarden.net/2011/talks/day1_05_luigi_graphicmagick/ > (if you like these kind of things)
I think I'll have to run some benchmark to see if it can save some resources and speed up the testing. I don't care too much for the mkiv integration. The other Marco's idea was exactly to make conTeXt run the tests. I prefer to let ConTeXt do the typesetting and do the dirty stuff with perl. So far I've included the testfiles from contexttest, parking the failing ones in a dedicated directory. There are 62 files now, and the test takes 13 minutes to run on my humble machine. These are the results for version 2012.10.16 23:38 against TeXlive2012: | File name | Success | Differs Avg | Worst value | Pages | Time | | arrows-001 | OK | 6.105634 | 6.105634 | 1 | 5 | | catcodes-001 | OK | 50.219512 | 50.219512 | 1 | 3 | | columnsets-001 | OK | 0.000000 | 0.000000 | 10 | 7 | | core-des-001 | OK | 0.324862 | 0.658451 | 23 | 9 | | core-des-002 | OK | 1.527666 | 2.651408 | 7 | 8 | | core-itm-001 | OK | 11.947183 | 13.753521 | 5 | 5 | | core-mat-001 | OK | 0.070423 | 0.070423 | 1 | 5 | | core-mat-002 | OK | 0.000000 | 0.000000 | 1 | 5 | | core-mat-003 | OK | 1.788732 | 1.788732 | 1 | 5 | | core-mat-004 | OK | 0.000000 | 0.000000 | 2 | 5 | | core-mat-005 | OK | 0.000000 | 0.000000 | 1 | 3 | | core-rul-001 | OK | 0.151408 | 0.151408 | 1 | 4 | | core-sec-001 | OK | 0.000000 | 0.000000 | 1 | 3 | | core-ver-001 | OK | 0.000000 | 0.000000 | 1 | 4 | | core-ver-002 | OK | 0.000000 | 0.000000 | 1 | 4 | | core-ver-003 | OK | 0.131162 | 0.524648 | 4 | 5 | | core-ver-004 | OK | 0.000000 | 0.000000 | 1 | 4 | | core-ver-005 | OK | 0.000000 | 0.000000 | 1 | 4 | | core-ver-007 | OK | 0.000000 | 0.000000 | 1 | 4 | | date-002 | OK | 0.000000 | 0.000000 | 1 | 3 | | dates-001 | OK | 3.880282 | 3.880282 | 1 | 4 | | dates-002 | OK | 0.359155 | 0.359155 | 1 | 4 | | enco-pfr-001 | OK | 0.095070 | 0.095070 | 1 | 4 | | floats-001 | OK | 31.651408 | 31.651408 | 1 | 4 | | floats-002 | OK | 31.651408 | 31.651408 | 1 | 5 | | hsv-001 | OK | 0.000000 | 0.000000 | 8 | 14 | | inclusion | OK | 0.000000 | 0.000000 | 1 | 4 | | math-pln-001 | OK | 0.049296 | 0.049296 | 1 | 4 | | meta-ini-001 | OK | 0.000000 | 0.000000 | 2 | 4 | | metapost-001 | OK | 0.000000 | 0.000000 | 1 | 4 | | metapost-002 | OK | 0.000000 | 0.000000 | 1 | 3 | | mixed-001 | OK | 21.327465 | 37.492958 | 2 | 4 | | narrower-bidi-001 | OK | 0.000000 | 0.000000 | 4 | 4 | | page-run-001 | OK | 0.000000 | 0.000000 | 1 | 4 | | page-txt-001 | OK | 0.445171 | 0.496479 | 7 | 5 | | ppchtex-001 | OK | 1.573944 | 1.573944 | 1 | 4 | | ppchtex-005 | OK | 1.169014 | 1.169014 | 1 | 4 | | ppchtex-006 | OK | 0.000000 | 0.000000 | 1 | 4 | | spacing-grid-001 | OK | 10.443662 | 10.531690 | 3 | 5 | | spacing-grid-005 | OK | 11.602993 | 14.975352 | 8 | 9 | | spacing-space-001 | OK | 0.000000 | 0.000000 | 1 | 3 | | spacing-space-002 | OK | 0.000000 | 0.000000 | 2 | 4 | | spacing-space-003 | OK | 0.000000 | 0.000000 | 1 | 4 | | spacing-space-004 | OK | 0.000000 | 0.000000 | 1 | 4 | | spec-mis-001 | FAILED | 0.000000 | 0.000000 | 0 | 0 | | spot-001 | OK | 0.000000 | 0.000000 | 1 | 4 | |struc-allkind-tex-001 | OK | 0.292254 | 0.292254 | 1 | 5 | |struc-allkind-xml-001 | OK | 1.471831 | 1.471831 | 1 | 6 | | struc-itemize-001 | OK | 0.176056 | 0.176056 | 1 | 4 | | struc-itemize-002 | OK | 0.000000 | 0.000000 | 1 | 3 | | struc-page-001 | OK | 6.237676 | 7.066901 | 4 | 14 | | struc-sections-002 | OK | 0.161972 | 0.161972 | 1 | 4 | |struc-sections-xml-002 | OK | 0.000000 | 0.000000 | 1 | 4 | | supp-mps-001 | OK | 0.000000 | 0.000000 | 1 | 4 | | supp-mps-002 | OK | 0.000000 | 0.000000 | 1 | 4 | | supp-mps-003 | OK | 0.000000 | 0.000000 | 1 | 3 | | supp-mps-004 | OK | 0.000000 | 0.000000 | 1 | 4 | | supp-mps-005 | OK | 0.000000 | 0.000000 | 1 | 3 | | tables-001 | OK | 0.577465 | 0.577465 | 1 | 4 | | widgets-fields-001 | OK | 0.000000 | 0.000000 | 1 | 5 | | x-res-00-001 | OK | 0.000000 | 0.000000 | 1 | 5 | | xml-chain-001 | OK | 0.000000 | 0.000000 | 1 | 4 | Looking at the diffs, many of the differences are really tiny, but differences exist nevertheless. It will take me some time to sort out which ones are just tiny space shifting, and which ones give really different output. To run the tests yourself it's extremely easy: git clone git://github.com/melmothx/context-unofficial-test-suite.git cd context-unofficial-test-suite ./run-test.pl --run 2>&1 | tee test.log Have a coffee and that's it. I always keep the repo on github synced with mine. Cheers P.S. When on-line, I'm logged into the #context channel on freenode as "melmothX". -- Marco ___________________________________________________________________________________ If your question is of interest to others as well, please add an entry to the Wiki! maillist : ntg-context@ntg.nl / http://www.ntg.nl/mailman/listinfo/ntg-context webpage : http://www.pragma-ade.nl / http://tex.aanhet.net archive : http://foundry.supelec.fr/projects/contextrev/ wiki : http://contextgarden.net ___________________________________________________________________________________
