>> Would you become interested to configure a representative test environment >> for safe comparisons of corresponding run time characteristics >> of the affected software? > > In what sense could the comparison possibly be unsafe?
* Our test systems are obviously different. Thus concerns can be considered for reproducibility of test results on other possible configurations. * We share only a tiny fraction of technical information which would probably be needed for “benchmarks”. > Just use time and run spatch on whatever machine you want. fring@Sonne:~/Projekte/Linux/next-patched> elfring@Sonne:~/Projekte/Linux/next-patched> git checkout next-20201023 && XX=$(date) && time spatch -D patch --timeout 9 --jobs 4 --chunksize 1 --include-headers --no-includes --dir . scripts/coccinelle/null/eno.cocci > ~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno1.diff 2> ~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno1-errors.txt; YY=$(date) && echo "$XX | $YY" … real 2m54,266s user 10m15,553s sys 0m4,004s So 25. Okt 20:53:56 CET 2020 | So 25. Okt 20:56:51 CET 2020 elfring@Sonne:~/Projekte/Linux/next-patched> git checkout next-20201023 && XX=$(date) && time spatch -D context --timeout 9 --jobs 4 --chunksize 1 --include-headers --no-includes --dir . scripts/coccinelle/null/eno.cocci > ~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno2.txt 2> ~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno2-errors.txt; YY=$(date) && echo "$XX | $YY" … real 2m38,494s user 9m39,364s sys 0m4,094s So 25. Okt 20:58:05 CET 2020 | So 25. Okt 21:00:44 CET 2020 elfring@Sonne:~/Projekte/Linux/next-patched> git checkout optimise_disjunction_in_eno.cocci-1 && XX=$(date) && time spatch -D patch --timeout 9 --jobs 4 --chunksize 1 --include-headers --no-includes --dir . scripts/coccinelle/null/eno.cocci > ~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno3.diff 2> ~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno3-errors.txt; YY=$(date) && echo "$XX | $YY" … real 2m46,097s user 10m15,467s sys 0m3,984s So 25. Okt 21:00:56 CET 2020 | So 25. Okt 21:03:42 CET 2020 elfring@Sonne:~/Projekte/Linux/next-patched> git checkout optimise_disjunction_in_eno.cocci-1 && XX=$(date) && time spatch -D context --timeout 9 --jobs 4 --chunksize 1 --include-headers --no-includes --dir . scripts/coccinelle/null/eno.cocci > ~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno4.txt 2> ~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno4-errors.txt; YY=$(date) && echo "$XX | $YY" … real 2m41,472s user 9m37,492s sys 0m3,834s So 25. Okt 21:03:56 CET 2020 | So 25. Okt 21:06:37 CET 2020 > Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz AMD Phenom(tm) II X4 850 Processor Will any other aspects become relevant? Regards, Markus _______________________________________________ Cocci mailing list Cocci@systeme.lip6.fr https://systeme.lip6.fr/mailman/listinfo/cocci