On 26.09.2013 02:08, Gary Oberbrunner wrote:
[...]
I think this is excellent work! Solid analysis. I know there's been
some thought given to caching subst() before; it's trickier than one
might think but in many cases it should work, and it definitely speeds
things up. I'm also impressed by a 30% memory reduction -- interested
to hear how that comes out.
I continued my work on reducing the overall memory consumption in SCons.
By combining my old branch (where I switched the core to using slots)
with some additional patches, I am now able to save up to 50%
memory...depending on the project.
Please find some results attached (a comparison between the current
default "tip" and my experimental branch), the code can be cloned from:
hg clone http://bitbucket.org/dirkbaechle/scons_experimental -r
reduced_memory_updated
I also achieved up to 20% speed improvements on updates, by a first
version of a caching for the env.subst() method.
Best regards,
Dirk
Title: Comparing default to lowmem
wonderbuild
Times
| Run | run [s] | update [s] | update_implicit [s] |
|---|
| Previous | 1172.3 | 25.6 | 19.4 |
| Current | 1131.6 | 22.0 | 15.5 |
| Factor | 0.97 | 0.86 | 0.80 |
Memory
| Run | run [MByte] | update [MByte] |
|---|
| Previous | 451.4 | 424.2 |
| Current | 251.5 | 197.8 |
| Factor | 0.56 | 0.47 |
sconsbld
Times
| Run | run [s] | update [s] | update_implicit [s] |
|---|
| Previous | 440.3 | 35.0 | 26.1 |
| Current | 343.8 | 28.7 | 19.8 |
| Factor | 0.78 | 0.82 | 0.76 |
Memory
| Run | run [MByte] | update [MByte] |
|---|
| Previous | 538.6 | 554.4 |
| Current | 231.6 | 238.7 |
| Factor | 0.43 | 0.43 |
questfperf
Times
| Run | run [s] | update [s] | update_implicit [s] |
|---|
| Previous | 1022.4 | 24.2 | 16.9 |
| Current | 984.8 | 20.4 | 12.9 |
| Factor | 0.96 | 0.84 | 0.77 |
Memory
| Run | run [MByte] | update [MByte] |
|---|
| Previous | 378.9 | 391.1 |
| Current | 210.9 | 196.3 |
| Factor | 0.56 | 0.50 |
mapnik
Times
| Run | run [s] | update [s] | update_implicit [s] |
|---|
| Previous | 867.2 | 12.5 | 4.7 |
| Current | 867.5 | 9.4 | 4.1 |
| Factor | 1.00 | 0.75 | 0.87 |
Memory
| Run | run [MByte] | update [MByte] |
|---|
| Previous | 151.5 | 144.1 |
| Current | 110.9 | 110.7 |
| Factor | 0.73 | 0.77 |
_______________________________________________
Scons-dev mailing list
[email protected]
http://two.pairlist.net/mailman/listinfo/scons-dev
