Hi All,
Congratulations are due to all those who prepared the 0.5.0 release.
However, I am somewhat confused by the new release's performance. Out of
interest I did a single run of Base.runtests() using both release 0.5.0 and
release 0.4.6 with some rather surprising and disappointing results. Of
the 117 tests which produced results from both releases, 66 of those took
longer to run in release 0.5.0 ranging from 1.037 times (insignificant) to
a whopping 103.000 times (staggering). I have include a text file of these
results brt-0.5.0:0.4.6.txt.
For information I ran the tests on:
MacBook Pro (15-inch, Late 2008)
Processor 2,8 GHz Intel Core 2 Duo
Memory 8 GB 1067 MHz DDR3
Graphics NVIDIA GeForce 9400M 256 MB
I would be interested in any comments which could explain these differences.
+-----------------------+-----------------------------------+-----------------------------------+------------+
| Test | Julia-0.5.0 | Julia-0.4.6
| 0.50/0.4.6 |
+-----------------------+-----------------------------------+-----------------------------------+------------+
| abstractarray | 106.65 seconds, maxrss 2090.21 MB | 38.22 seconds,
maxrss 1479.01 MB | + 2.790 |
| ambiguous | 0.95 seconds, maxrss 2938.52 MB |
| | W:0.5.0
| arrayops | 47.28 seconds, maxrss 2084.36 MB | 39.21 seconds,
maxrss 1123.30 MB | + 1.206 |
| backtrace | 0.88 seconds, maxrss 2532.14 MB | 0.49 seconds,
maxrss 1774.17 MB | + 1.796 |
| base64 | 0.32 seconds, maxrss 2723.07 MB | 0.65 seconds,
maxrss 1903.61 MB | - 0.492 |
| bigfloat | 0.08 seconds, maxrss 2461.48 MB | 0.23 seconds,
maxrss 1664.69 MB | - 0.348 |
| bigint | 3.82 seconds, maxrss 2461.48 MB | 2.65 seconds,
maxrss 1664.69 MB | + 1.442 |
| bitarray | 626.38 seconds, maxrss 2360.39 MB | 98.39 seconds,
maxrss 1608.53 MB | + 6.366 |
| blas | 35.81 seconds, maxrss 2090.21 MB | 5.68 seconds,
maxrss 1479.01 MB | + 6.305 |
| boundscheck | 2.64 seconds, maxrss 2938.52 MB |
| |
| broadcast | 28.41 seconds, maxrss 2584.33 MB | 13.71 seconds,
maxrss 1806.70 MB | + 2.072 |
| cartesian | 0.01 seconds, maxrss 2938.52 MB |
| |
| ccall | 5.60 seconds, maxrss 2460.93 MB | 4.15 seconds,
maxrss 1664.51 MB | + 1.349 |
| char | 1.11 seconds, maxrss 1708.20 MB | 0.94 seconds,
maxrss 861.35 MB | + 1.181 |
| checked | 13.32 seconds, maxrss 2938.52 MB |
| |
| cmdlineargs | 132.04 seconds, maxrss 2938.52 MB | 31.42 seconds,
maxrss 2020.79 MB | + 4.202 |
| combinatorics | 0.25 seconds, maxrss 2607.80 MB | 3.37 seconds,
maxrss 1845.82 MB | - 0.074 |
| compile | 19.59 seconds, maxrss 2938.52 MB | 21.53 seconds,
maxrss 2035.11 MB | - 0.910 |
| complex | 6.75 seconds, maxrss 2594.77 MB | 4.14 seconds,
maxrss 1811.77 MB | + 1.630 |
| copy | 1.75 seconds, maxrss 2361.82 MB | 2.97 seconds,
maxrss 1609.28 MB | - 0.589 |
| core | 47.93 seconds, maxrss 1498.30 MB | 21.39 seconds,
maxrss 781.67 MB | + 2.241 | W:0.5.0
| datafmt | 4.94 seconds, maxrss 2595.79 MB |
| |
| dates | 47.43 seconds, maxrss 1791.71 MB | 66.83 seconds,
maxrss 940.82 MB | - 0.710 |
| dict | 12.53 seconds, maxrss 1800.05 MB | 12.55 seconds,
maxrss 964.26 MB | - 0.998 |
| docs | 5.27 seconds, maxrss 2723.07 MB | 5.77 seconds,
maxrss 1900.33 MB | - 0.913 |
| dsp | 10.40 seconds, maxrss 2938.52 MB | 23.33 seconds,
maxrss 2024.52 MB | - 0.446 |
| enums | 2.00 seconds, maxrss 2930.43 MB | 2.59 seconds,
maxrss 2020.79 MB | - 0.772 |
| env | 0.53 seconds, maxrss 2610.49 MB |
| |
| error | 0.73 seconds, maxrss 2938.52 MB |
| |
| euler | 0.75 seconds, maxrss 2626.07 MB | 0.94 seconds,
maxrss 1872.93 MB | - 0.798 |
| examples | 23.98 seconds, maxrss 2938.52 MB | 44.63 seconds,
maxrss 2032.55 MB | - 0.537 |
| fastmath | 3.53 seconds, maxrss 2404.50 MB | 4.39 seconds,
maxrss 1662.73 MB | - 0.804 |
| fft | 22.44 seconds, maxrss 2938.52 MB | 28.79 seconds,
maxrss 2020.79 MB | - 0.779 |
| file | 52.76 seconds, maxrss 2535.20 MB | 40.65 seconds,
maxrss 1778.29 MB | + 1.298 |
| float16 | 0.96 seconds, maxrss 2607.77 MB | 1.60 seconds,
maxrss 1843.30 MB | - 0.600 |
| floatapprox | 0.31 seconds, maxrss 2595.06 MB | 0.38 seconds,
maxrss 1812.14 MB | - 0.816 |
| floatfuncs | 3.08 seconds, maxrss 2938.52 MB | 1.20 seconds,
maxrss 2020.79 MB | + 2.567 |
| functional | 35.94 seconds, maxrss 2443.03 MB | 2.00 seconds,
maxrss 1662.87 MB | + 17.970 |
| goto | 0.09 seconds, maxrss 2670.83 MB | 0.08 seconds,
maxrss 1892.93 MB | + 1.125 |
| grisu | 2.97 seconds, maxrss 2671.96 MB | 7.04 seconds,
maxrss 1898.23 MB | - 0.422 |
| hashing | 5.25 seconds, maxrss 1808.02 MB | 4.86 seconds,
maxrss 970.21 MB | + 1.080 |
| i18n | 0.02 seconds, maxrss 2938.52 MB | 0.03 seconds,
maxrss 2020.79 MB | - 0.667 |
| inference | 0.82 seconds, maxrss 1500.55 MB |
| |
| inline | 0.27 seconds, maxrss 2938.52 MB | 0.13 seconds,
maxrss 2020.79 MB | + 2.077 |
| int | 3.10 seconds, maxrss 2938.52 MB | 1.28 seconds,
maxrss 2020.79 MB | + 2.422 |
| intfuncs | 0.82 seconds, maxrss 2090.21 MB | 0.67 seconds,
maxrss 1479.01 MB | + 1.224 |
| intset | 0.41 seconds, maxrss 2938.52 MB | 0.85 seconds,
maxrss 2020.79 MB | - 0.482 |
| iobuffer | 0.84 seconds, maxrss 1811.07 MB | 1.43 seconds,
maxrss 972.14 MB | - 0.587 |
| keywordargs | 1.55 seconds, maxrss 1502.54 MB | 1.46 seconds,
maxrss 782.20 MB | + 1.062 |
| libdl | 3.68 seconds, maxrss 2938.52 MB | 3.36 seconds,
maxrss 2020.79 MB | + 1.095 |
| libgit2 | 16.48 seconds, maxrss 2722.23 MB | 0.16 seconds,
maxrss 1899.13 MB | + 103.000 |
| linalg|arnoldi | 28.83 seconds, maxrss 1096.27 MB | 9.88 seconds,
maxrss 762.49 MB | + 2.918 |
| linalg|bidiag | 20.61 seconds, maxrss 919.20 MB | 9.58 seconds,
maxrss 634.41 MB | + 2.151 |
| linalg|bunchkaufman | 18.44 seconds, maxrss 864.34 MB | 0.88 seconds,
maxrss 592.78 MB | + 20.955 |
| linalg|cholesky | 21.32 seconds, maxrss 1019.89 MB | 6.65 seconds,
maxrss 730.52 MB | + 3.206 |
| linalg|dense | 29.18 seconds, maxrss 810.24 MB | 27.83 seconds,
maxrss 546.90 MB | + 1.049 |
| linalg|diagonal | 28.82 seconds, maxrss 943.88 MB | 11.20 seconds,
maxrss 652.52 MB | + 2.573 |
| linalg|eigen | 22.55 seconds, maxrss 862.70 MB | 1.72 seconds,
maxrss 592.78 MB | + 13.110 |
| linalg|generic | 4.70 seconds, maxrss 1046.73 MB | 2.47 seconds,
maxrss 731.79 MB | + 1.903 |
| linalg|givens | 4.62 seconds, maxrss 1019.89 MB | 1.82 seconds,
maxrss 730.52 MB | + 2.538 |
| linalg|hessenberg | 0.67 seconds, maxrss 1084.30 MB |
| |
| linalg|lapack | 25.49 seconds, maxrss 880.02 MB | 15.65 seconds,
maxrss 599.55 MB | + 1.629 |
| linalg|lq | 39.20 seconds, maxrss 1084.20 MB |
| |
| linalg|lu | 21.39 seconds, maxrss 1035.65 MB | 12.69 seconds,
maxrss 730.52 MB | + 1.686 |
| linalg|matmul | 118.79 seconds, maxrss 848.16 MB | 10.58 seconds,
maxrss 574.24 MB | + 11.228 |
| linalg|pinv | 6.28 seconds, maxrss 1019.89 MB | 6.25 seconds,
maxrss 730.52 MB | + 1.005 |
| linalg|qr | 55.09 seconds, maxrss 777.81 MB | 33.92 seconds,
maxrss 511.85 MB | + 1.624 |
| linalg|schur | 6.10 seconds, maxrss 850.53 MB | 5.88 seconds,
maxrss 575.92 MB | + 1.037 |
| linalg|special | 2.21 seconds, maxrss 850.53 MB | 3.25 seconds,
maxrss 582.98 MB | - 0.680 |
| linalg|svd | 10.74 seconds, maxrss 866.73 MB | 5.37 seconds,
maxrss 594.88 MB | + 2.000 |
| linalg|symmetric | 8.94 seconds, maxrss 1045.64 MB | 6.17 seconds,
maxrss 731.75 MB | + 1.449 |
| linalg|triangular | 300.73 seconds, maxrss 690.53 MB | 115.27 seconds,
maxrss 428.32 MB | + 2.609 |
| linalg|tridiag | 18.91 seconds, maxrss 896.32 MB | 6.30 seconds,
maxrss 605.44 MB | + 3.002 |
| linalg|uniformscaling | 31.82 seconds, maxrss 1051.67 MB | 1.20 seconds,
maxrss 731.79 MB | + 26.517 |
| lineedit | 3.58 seconds, maxrss 2652.41 MB | 4.76 seconds,
maxrss 1880.56 MB | - 0.752 |
| llvmcall | 0.14 seconds, maxrss 2670.88 MB | 0.18 seconds,
maxrss 1893.08 MB | - 0.778 |
| loading | 0.09 seconds, maxrss 2461.38 MB | 0.09 seconds,
maxrss 1664.69 MB | 1.000 |
| markdown | 4.60 seconds, maxrss 2723.07 MB | 8.32 seconds,
maxrss 1903.13 MB | - 0.553 |
| math | 56.43 seconds, maxrss 2392.43 MB | 13.36 seconds,
maxrss 1650.06 MB | + 4.224 |
| meta | 0.35 seconds, maxrss 2680.48 MB | 0.65 seconds,
maxrss 1899.13 MB | - 0.538 |
| misc | 43.35 seconds, maxrss 2930.05 MB | 41.81 seconds,
maxrss 2019.76 MB | + 1.037 |
| mmap | 49.57 seconds, maxrss 2570.22 MB | 15.20 seconds,
maxrss 1778.29 MB | + 3.261 |
| mod2pi | 0.15 seconds, maxrss 2625.51 MB | 0.24 seconds,
maxrss 1861.81 MB | - 0.625 |
| mpfr | 2.01 seconds, maxrss 2570.22 MB | 5.04 seconds,
maxrss 1786.66 MB | - 0.399 |
| nullable | 13.96 seconds, maxrss 2680.36 MB | 3.49 seconds,
maxrss 1899.13 MB | + 4.000 |
| numbers | 113.96 seconds, maxrss 1678.94 MB | 87.58 seconds,
maxrss 860.80 MB | + 1.301 |
| offsetarray | 68.41 seconds, maxrss 1906.93 MB |
| |
| operators | 0.58 seconds, maxrss 2443.03 MB | 0.59 seconds,
maxrss 1662.93 MB | - 0.983 |
| parallel | 103.09 seconds, maxrss 2938.52 MB | 33.04 seconds,
maxrss 2020.79 MB | + 3.120 |
| parse | 1.78 seconds, maxrss 2461.35 MB | 1.82 seconds,
maxrss 1664.69 MB | - 0.978 |
| path | 5.03 seconds, maxrss 2459.73 MB | 5.62 seconds,
maxrss 1664.07 MB | - 0.895 |
| pollfd | 3.65 seconds, maxrss 2570.22 MB | 3.67 seconds,
maxrss 1783.07 MB | - 0.995 |
| printf | 16.74 seconds, maxrss 1703.40 MB | 4.37 seconds,
maxrss 861.20 MB | + 3.831 |
| priorityqueue | 1.68 seconds, maxrss 2535.20 MB | 1.52 seconds,
maxrss 1775.86 MB | + 1.102 |
| profile | 3.80 seconds, maxrss 2690.81 MB | 7.39 seconds,
maxrss 1899.13 MB | - 0.514 |
| random | 12.10 seconds, maxrss 2090.21 MB | 15.21 seconds,
maxrss 1479.01 MB | - 0.796 |
| ranges | 31.80 seconds, maxrss 2625.47 MB | 77.62 seconds,
maxrss 1861.70 MB | - 0.410 |
| read | 33.28 seconds, maxrss 2570.22 MB |
| |
| readdlm | | 31.61 seconds,
maxrss 1839.07 MB | |
| reduce | 4.15 seconds, maxrss 2090.21 MB | 4.74 seconds,
maxrss 1479.01 MB | - 0.876 | W:0.5.0
| reducedim | 15.84 seconds, maxrss 2090.21 MB | 19.74 seconds,
maxrss 1479.01 MB | - 0.802 |
| reflection | 7.24 seconds, maxrss 2605.66 MB | 1.39 seconds,
maxrss 1840.73 MB | + 5.209 | W:0.4.6
| regex | 0.53 seconds, maxrss 2607.49 MB | 1.74 seconds,
maxrss 1841.72 MB | - 0.305 |
| repl | 5.31 seconds, maxrss 2652.84 MB | 6.17 seconds,
maxrss 1888.30 MB | - 0.861 |
| replcompletions | 4.30 seconds, maxrss 2652.41 MB | 5.13 seconds,
maxrss 1885.03 MB | - 0.838 |
| replutil | 5.29 seconds, maxrss 2657.66 MB | 2.18 seconds,
maxrss 1890.35 MB | + 2.427 |
| resolve | 4.80 seconds, maxrss 2570.22 MB | 8.69 seconds,
maxrss 1782.48 MB | - 0.552 |
| rounding | 0.75 seconds, maxrss 2610.62 MB | 1.05 seconds,
maxrss 1854.75 MB | - 0.714 |
| serialize | 6.08 seconds, maxrss 2723.07 MB | 4.36 seconds,
maxrss 1907.82 MB | + 1.394 |
| sets | 2.96 seconds, maxrss 2658.43 MB | 3.31 seconds,
maxrss 1892.83 MB | - 0.894 |
| show | 20.08 seconds, maxrss 2652.41 MB | 10.12 seconds,
maxrss 1877.19 MB | + 1.984 |
| simdloop | 1.43 seconds, maxrss 2090.21 MB | 1.19 seconds,
maxrss 1479.01 MB | + 1.202 |
| socket | 3.09 seconds, maxrss 2595.06 MB | 2.63 seconds,
maxrss 1812.14 MB | + 1.175 |
| sorting | 42.69 seconds, maxrss 2502.43 MB | 28.44 seconds,
maxrss 1736.37 MB | + 1.501 |
| sparse | 400.58 seconds, maxrss 2287.71 MB | 103.86 seconds,
maxrss 1548.94 MB | + 3.857 |
| spawn | 24.95 seconds, maxrss 2524.35 MB | 13.10 seconds,
maxrss 1753.82 MB | + 1.905 |
| stacktraces | 1.16 seconds, maxrss 2682.85 MB |
| |
| staged | 0.77 seconds, maxrss 1811.59 MB | 0.70 seconds,
maxrss 972.94 MB | + 1.100 |
| statistics | 8.23 seconds, maxrss 2506.17 MB | 7.29 seconds,
maxrss 1742.30 MB | + 1.129 |
| string | 26.13 seconds, maxrss 1720.10 MB | 18.39 seconds,
maxrss 936.61 MB | + 1.421 |
| subarray | 358.09 seconds, maxrss 1445.27 MB | 498.81 seconds,
maxrss 1475.84 MB | - 0.718 |
| sysinfo | 0.54 seconds, maxrss 2610.41 MB | 1.65 seconds,
maxrss 1854.30 MB | - 0.327 |
| test | 8.48 seconds, maxrss 2670.82 MB | 0.53 seconds,
maxrss 1892.93 MB | + 16.000 |
| threads | 5.54 seconds, maxrss 2930.05 MB |
| | W:0.5.0
| triplequote | 0.02 seconds, maxrss 1720.10 MB | 0.20 seconds,
maxrss 936.83 MB | - 0.100 |
| tuple | 2.07 seconds, maxrss 2084.36 MB | 1.15 seconds,
maxrss 1123.30 MB | + 1.800 |
| unicode | 5.15 seconds, maxrss 1728.02 MB | 17.31 seconds,
maxrss 937.10 MB | - 0.298 |
| vecelement | 2.43 seconds, maxrss 2090.21 MB |
| |
| version | 1.16 seconds, maxrss 2570.22 MB | 2.97 seconds,
maxrss 1778.29 MB | - 0.391 |
| workspace | 1.06 seconds, maxrss 2938.52 MB | 0.38 seconds,
maxrss 2020.79 MB | + 2.789 |
+-----------------------+-----------------------------------+-----------------------------------+------------+
note: + 0.5 takes
more time to run ^
- 0.5 takes
less time to run |
Warnings indicated where thrown
either by W:0.5.0 or W:0.4.6
