>> Would you become interested to configure a representative test environment
>> for safe comparisons of corresponding run time characteristics
>> of the affected software?
>
> In what sense could the comparison possibly be unsafe?

* Our test systems are obviously different.
  Thus concerns can be considered for reproducibility of test results
  on other possible configurations.

* We share only a tiny fraction of technical information which would probably
  be needed for “benchmarks”.


> Just use time and run spatch on whatever machine you want.

fring@Sonne:~/Projekte/Linux/next-patched>
elfring@Sonne:~/Projekte/Linux/next-patched> git checkout next-20201023 && 
XX=$(date) && time spatch -D patch --timeout 9 --jobs 4 --chunksize 1 
--include-headers --no-includes --dir . scripts/coccinelle/null/eno.cocci > 
~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno1.diff 2> 
~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno1-errors.txt; 
YY=$(date) && echo "$XX | $YY"
…
real    2m54,266s
user    10m15,553s
sys     0m4,004s
So 25. Okt 20:53:56 CET 2020 | So 25. Okt 20:56:51 CET 2020
elfring@Sonne:~/Projekte/Linux/next-patched> git checkout next-20201023 && 
XX=$(date) && time spatch -D context --timeout 9 --jobs 4 --chunksize 1 
--include-headers --no-includes --dir . scripts/coccinelle/null/eno.cocci > 
~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno2.txt 2> 
~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno2-errors.txt; 
YY=$(date) && echo "$XX | $YY"
…
real    2m38,494s
user    9m39,364s
sys     0m4,094s
So 25. Okt 20:58:05 CET 2020 | So 25. Okt 21:00:44 CET 2020
elfring@Sonne:~/Projekte/Linux/next-patched> git checkout 
optimise_disjunction_in_eno.cocci-1 && XX=$(date) && time spatch -D patch 
--timeout 9 --jobs 4 --chunksize 1 --include-headers --no-includes --dir . 
scripts/coccinelle/null/eno.cocci > 
~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno3.diff 2> 
~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno3-errors.txt; 
YY=$(date) && echo "$XX | $YY"
…
real    2m46,097s
user    10m15,467s
sys     0m3,984s
So 25. Okt 21:00:56 CET 2020 | So 25. Okt 21:03:42 CET 2020
elfring@Sonne:~/Projekte/Linux/next-patched> git checkout 
optimise_disjunction_in_eno.cocci-1 && XX=$(date) && time spatch -D context 
--timeout 9 --jobs 4 --chunksize 1 --include-headers --no-includes --dir . 
scripts/coccinelle/null/eno.cocci > 
~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno4.txt 2> 
~/Projekte/Bau/Linux/scripts/Coccinelle/call_checks/20201023/eno4-errors.txt; 
YY=$(date) && echo "$XX | $YY"
…
real    2m41,472s
user    9m37,492s
sys     0m3,834s
So 25. Okt 21:03:56 CET 2020 | So 25. Okt 21:06:37 CET 2020


> Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz

AMD Phenom(tm) II X4 850 Processor

Will any other aspects become relevant?

Regards,
Markus
_______________________________________________
Cocci mailing list
Cocci@systeme.lip6.fr
https://systeme.lip6.fr/mailman/listinfo/cocci

Reply via email to