I'm back with some tests that I made with the U-S test suite.
2010/1/30 Scott Dial
<scott+python-...@scottdial.com<scott%2bpython-...@scottdial.com>
>
> Cesare, just FYI, your Hg repository has lost the execute bits on some
> files (namely "./configure" and "./Parser/asdl_c.py"), so it does not
> quite build out-of-the-box.
>
Unfortunately, I haven't found a solution to this problem. If somebody
working with Windows and Mercurial (I use TortoiseHg graphical client) can
give help on this issue, I'll release wpython 1.1 final.
> I took the liberty of cloning your repo into my laptop's VirtualBox
> instance of Ubuntu. I ran the default performance tests from the U-S
> repo, with VirtualBox at highest priority. As a sanity check, I ran it
> against the U-S trunk. I think the numbers speak for themselves.
>
> --
> Scott Dial
> sc...@scottdial.com
> scod...@cs.indiana.edu
>
I downloaded U-S test suite, and made some benchmarks with my machine.
Django and Spambayes tests didn't run:
Running django...
INFO:root:Running D:\Projects\wpython\wpython10_test\PCbuild\python
performance/bm_django.py -n 100
Traceback (most recent call last):
File "perf.py", line 1938, in <module>
main(sys.argv[1:])
File "perf.py", line 1918, in main
options)))
File "perf.py", line 1193, in BM_Django
return SimpleBenchmark(MeasureDjango, *args, **kwargs)
File "perf.py", line 590, in SimpleBenchmark
*args, **kwargs)
File "perf.py", line 1189, in MeasureDjango
return MeasureGeneric(python, options, bm_path, bm_env)
File "perf.py", line 960, in MeasureGeneric
inherit_env=options.inherit_env)
File "perf.py", line 916, in CallAndCaptureOutput
raise RuntimeError("Benchmark died: " + err)
RuntimeError: Benchmark died: Traceback (most recent call last):
File "performance/bm_django.py", line 25, in <module>
from django.template import Context, Template
ImportError: No module named template
Running spambayes...
INFO:root:Running D:\Projects\wpython\wpython10_test\PCbuild\python
performance/bm_spambayes.py -n 50
Traceback (most recent call last):
File "perf.py", line 1938, in <module>
main(sys.argv[1:])
File "perf.py", line 1918, in main
options)))
File "perf.py", line 1666, in BM_spambayes
return SimpleBenchmark(MeasureSpamBayes, *args, **kwargs)
File "perf.py", line 590, in SimpleBenchmark
*args, **kwargs)
File "perf.py", line 1662, in MeasureSpamBayes
return MeasureGeneric(python, options, bm_path, bm_env)
File "perf.py", line 960, in MeasureGeneric
inherit_env=options.inherit_env)
File "perf.py", line 916, in CallAndCaptureOutput
raise RuntimeError("Benchmark died: " + err)
RuntimeError: Benchmark died: Traceback (most recent call last):
File "performance/bm_spambayes.py", line 18, in <module>
from spambayes import hammie, mboxutils
ImportError: No module named spambayes
Anyway, I run all others with wpython 1.0 final:
C:\Temp\unladen-swallow-tests>C:\temp\Python-2.6.4\PCbuild\python perf.py -r
-b default,-django,-spambayes C:\temp\Python-2.6.4\PCbuild\python
D:\Projects\wpython\wpython10_test\PCbuild\python
Report on Windows Conan post2008Server 6.1.7600 x86 AMD64 Family 15 Model 12
Stepping 0, AuthenticAMD
Total CPU cores: 1
### 2to3 ###
Min: 43.408000 -> 38.528000: 1.1267x faster
Avg: 44.448600 -> 39.391000: 1.1284x faster
Significant (t=10.582185)
Stddev: 0.84415 -> 0.65538: 1.2880x smaller
Timeline: http://tinyurl.com/ybdwese
### nbody ###
Min: 1.124000 -> 1.109000: 1.0135x faster
Avg: 1.167630 -> 1.148190: 1.0169x faster
Not significant
Stddev: 0.09607 -> 0.09544: 1.0065x smaller
Timeline: http://tinyurl.com/yex7dfv
### slowpickle ###
Min: 1.237000 -> 1.067000: 1.1593x faster
Avg: 1.283800 -> 1.109070: 1.1575x faster
Significant (t=11.393574)
Stddev: 0.11086 -> 0.10596: 1.0462x smaller
Timeline: http://tinyurl.com/y8t5ess
### slowspitfire ###
Min: 2.079000 -> 1.928000: 1.0783x faster
Avg: 2.148920 -> 1.987540: 1.0812x faster
Significant (t=7.731224)
Stddev: 0.15384 -> 0.14108: 1.0904x smaller
Timeline: http://tinyurl.com/yzexcqa
### slowunpickle ###
Min: 0.617000 -> 0.568000: 1.0863x faster
Avg: 0.645420 -> 0.590790: 1.0925x faster
Significant (t=7.087322)
Stddev: 0.05478 -> 0.05422: 1.0103x smaller
Timeline: http://tinyurl.com/ycsoouq
I also made some tests with wpython 1.1, leaving bytecode peepholer enabled:
C:\Temp\unladen-swallow-tests>C:\temp\Python-2.6.4\PCbuild\python perf.py -r
-b default,-django,-spambayes C:\temp\Python-2.6.4\PCbuild\python
D:\Projects\wpython\wpython_test\PCbuild\python
Report on Windows Conan post2008Server 6.1.7600 x86 AMD64 Family 15 Model 12
Stepping 0, AuthenticAMD
Total CPU cores: 1
### 2to3 ###
Min: 43.454000 -> 39.912000: 1.0887x faster
Avg: 44.301000 -> 40.766800: 1.0867x faster
Significant (t=8.188533)
Stddev: 0.65325 -> 0.71041: 1.0875x larger
Timeline: http://tinyurl.com/ya5z9mg
### nbody ###
Min: 1.125000 -> 1.070000: 1.0514x faster
Avg: 1.169270 -> 1.105530: 1.0577x faster
Significant (t=4.774702)
Stddev: 0.09655 -> 0.09219: 1.0473x smaller
Timeline: http://tinyurl.com/y8udjmk
### slowpickle ###
Min: 1.235000 -> 1.094000: 1.1289x faster
Avg: 1.275860 -> 1.132740: 1.1263x faster
Significant (t=10.080562)
Stddev: 0.10247 -> 0.09827: 1.0428x smaller
Timeline: http://tinyurl.com/y9p6lmt
### slowspitfire ###
Min: 2.053000 -> 1.927000: 1.0654x faster
Avg: 2.130690 -> 1.993580: 1.0688x faster
Significant (t=6.065325)
Stddev: 0.16818 -> 0.15105: 1.1134x smaller
Timeline: http://tinyurl.com/yfyo53w
### slowunpickle ###
Min: 0.616000 -> 0.583000: 1.0566x faster
Avg: 0.643100 -> 0.606650: 1.0601x faster
Significant (t=4.304239)
Stddev: 0.05675 -> 0.06286: 1.1076x larger
Timeline: http://tinyurl.com/yzlyo3d
Also I run wpython 1.1 with bytecode peepholer disabled (wpython 1.1 has all
peepholer ported to compiler.c, working with instr struct):
C:\Temp\unladen-swallow-tests>C:\temp\Python-2.6.4\PCbuild\python perf.py -r
-b default,-django,-spambayes C:\temp\Python-2.6.4\PCbuild\python
D:\Projects\wpython\wpython_test\PCbuild\python
Report on Windows Conan post2008Server 6.1.7600 x86 AMD64 Family 15 Model 12
Stepping 0, AuthenticAMD
Total CPU cores: 1
### 2to3 ###
Min: 44.128000 -> 39.575000: 1.1150x faster
Avg: 45.231400 -> 40.455600: 1.1181x faster
Significant (t=10.515725)
Stddev: 0.67464 -> 0.75905: 1.1251x larger
Timeline: http://tinyurl.com/ye4un63
### nbody ###
Min: 1.126000 -> 1.065000: 1.0573x faster
Avg: 1.161410 -> 1.093630: 1.0620x faster
Significant (t=6.344257)
Stddev: 0.08324 -> 0.06697: 1.2429x smaller
Timeline: http://tinyurl.com/ykyoflv
### slowpickle ###
Min: 1.245000 -> 1.121000: 1.1106x faster
Avg: 1.282420 -> 1.154450: 1.1108x faster
Significant (t=10.719276)
Stddev: 0.09569 -> 0.07139: 1.3404x smaller
Timeline: http://tinyurl.com/y85m3wa
### slowspitfire ###
Min: 2.081000 -> 1.964000: 1.0596x faster
Avg: 2.148110 -> 2.033300: 1.0565x faster
Significant (t=5.089408)
Stddev: 0.16229 -> 0.15669: 1.0357x smaller
Timeline: http://tinyurl.com/ydruyqf
### slowunpickle ###
Min: 0.621000 -> 0.600000: 1.0350x faster
Avg: 0.649120 -> 0.624950: 1.0387x faster
Significant (t=3.057153)
Stddev: 0.05377 -> 0.05796: 1.0780x larger
Timeline: http://tinyurl.com/yd2sy5v
Albeit some tests are missing, I think the numbers speak for themselves,
too.
Cesare
_______________________________________________
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe:
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
