Re: [PATCH RFC] perf: add asv benchmarks
On Wed, Oct 12, 2016 at 4:35 AM, Philippe Pepiot wrote: > +"show_commit_url": "https://www.selenic.com/hg/rev/";, Not a review, but I believe this should be: https://www.mercurial-scm.org/repo/hg/ ___ Mercurial-devel mailing list Mercurial-devel@mercurial-scm.org https://www.mercurial-scm.org/mailman/listinfo/mercurial-devel
Re: [PATCH RFC] perf: add asv benchmarks
On 10/12/2016 10:35 AM, Philippe Pepiot wrote: # HG changeset patch # User Philippe Pepiot # Date 1475136994 -7200 # Thu Sep 29 10:16:34 2016 +0200 # Node ID f7847ea1b58780e3508d57376c4fdd63d6aedfcd # Parent b85fa6bf298be07804a74d8fdec0d19fdbc6d740 # EXP-Topic hgperf perf: add asv benchmarks For the record, this is unlikely that we reaches the point were we can review this to the point of acceptance before the freeze on Tuesday. Unless another reviewer pick this, You'll have to resend this when 4.0 is released on November 1st. Airspeed velocity (ASV) is a python framework for benchmarking Python packages over their lifetime. The results are displayed in an interactive web frontend. Add ASV benchmarks for mercurial that use contrib/perf.py extension that could be run against multiple reference repositories. The benchmark suite now includes revsets from contrib/base-revsets.txt with variants, perftags, perfstatus, perfmanifest and perfheads. Installation requires ASV (not yet released https://github.com/spacetelescope/asv master branch), python-hglib and virtualenv. This is part of PerformanceTrackingSuitePlan https://www.mercurial-scm.org/wiki/PerformanceTrackingSuitePlan diff --git a/.hgignore b/.hgignore --- a/.hgignore +++ b/.hgignore @@ -49,6 +49,7 @@ mercurial.egg-info tags cscope.* .idea/* +.asv/* i18n/hg.pot locale/*/LC_MESSAGES/hg.mo hgext/__index__.py diff --git a/contrib/asv.conf.json b/contrib/asv.conf.json new file mode 100644 --- /dev/null +++ b/contrib/asv.conf.json @@ -0,0 +1,127 @@ +{ +// The version of the config file format. Do not change, unless +// you know what you are doing. +"version": 1, + +// The name of the project being benchmarked +"project": "mercurial", + +// The project's homepage +"project_url": "http://mercurial-scm.org/";, + +// The URL or local path of the source code repository for the +// project being benchmarked +"repo": "..", + +// List of branches to benchmark. If not provided, defaults to "master" +// (for git) or "default" (for mercurial). +// "branches": ["master"], // for git +// "branches": ["default"],// for mercurial +"branches": ["default", "stable"], + +// The DVCS being used. If not set, it will be automatically +// determined from "repo" by looking at the protocol in the URL +// (if remote), or by looking for special directories, such as +// ".git" (if local). +// "dvcs": "git", + +// The tool to use to create environments. May be "conda", +// "virtualenv" or other value depending on the plugins in use. +// If missing or the empty string, the tool will be automatically +// determined by looking for tools on the PATH environment +// variable. +"environment_type": "virtualenv", + +// the base URL to show a commit for the project. +"show_commit_url": "https://www.selenic.com/hg/rev/";, + +// The Pythons you'd like to test against. If not provided, defaults +// to the current version of Python used to run `asv`. +// "pythons": ["2.7", "3.3"], + +// The matrix of dependencies to test. Each key is the name of a +// package (in PyPI) and the values are version numbers. An empty +// list or empty string indicates to just test against the default +// (latest) version. null indicates that the package is to not be +// installed. If the package to be tested is only available from +// PyPi, and the 'environment_type' is conda, then you can preface +// the package name by 'pip+', and the package will be installed via +// pip (with all the conda available packages installed first, +// followed by the pip installed packages). +// +// "matrix": { +// "numpy": ["1.6", "1.7"], +// "six": ["", null],// test with and without six installed +// "pip+emcee": [""], // emcee is only available for install with pip. +// }, + +// Combinations of libraries/python versions can be excluded/included +// from the set to test. Each entry is a dictionary containing additional +// key-value pairs to include/exclude. +// +// An exclude entry excludes entries where all values match. The +// values are regexps that should match the whole string. +// +// An include entry adds an environment. Only the packages listed +// are installed. The 'python' key is required. The exclude rules +// do not apply to includes. +// +// In addition to package names, the following keys are available: +// +// - python +// Python version, as in the *pythons* variable above. +// - environment_type +// Environment type, as above. +// - sys_platform +// Platform, as in sys.platform. Possible values for the common +// cases: 'linux2', 'win32', 'cygwin', 'darwin'. +// +// "exclude": [ +// {"python": "3.2", "sys_platform": "win32"}, // skip py3.2 on windows +//
[PATCH RFC] perf: add asv benchmarks
# HG changeset patch # User Philippe Pepiot # Date 1475136994 -7200 # Thu Sep 29 10:16:34 2016 +0200 # Node ID f7847ea1b58780e3508d57376c4fdd63d6aedfcd # Parent b85fa6bf298be07804a74d8fdec0d19fdbc6d740 # EXP-Topic hgperf perf: add asv benchmarks Airspeed velocity (ASV) is a python framework for benchmarking Python packages over their lifetime. The results are displayed in an interactive web frontend. Add ASV benchmarks for mercurial that use contrib/perf.py extension that could be run against multiple reference repositories. The benchmark suite now includes revsets from contrib/base-revsets.txt with variants, perftags, perfstatus, perfmanifest and perfheads. Installation requires ASV (not yet released https://github.com/spacetelescope/asv master branch), python-hglib and virtualenv. This is part of PerformanceTrackingSuitePlan https://www.mercurial-scm.org/wiki/PerformanceTrackingSuitePlan diff --git a/.hgignore b/.hgignore --- a/.hgignore +++ b/.hgignore @@ -49,6 +49,7 @@ mercurial.egg-info tags cscope.* .idea/* +.asv/* i18n/hg.pot locale/*/LC_MESSAGES/hg.mo hgext/__index__.py diff --git a/contrib/asv.conf.json b/contrib/asv.conf.json new file mode 100644 --- /dev/null +++ b/contrib/asv.conf.json @@ -0,0 +1,127 @@ +{ +// The version of the config file format. Do not change, unless +// you know what you are doing. +"version": 1, + +// The name of the project being benchmarked +"project": "mercurial", + +// The project's homepage +"project_url": "http://mercurial-scm.org/";, + +// The URL or local path of the source code repository for the +// project being benchmarked +"repo": "..", + +// List of branches to benchmark. If not provided, defaults to "master" +// (for git) or "default" (for mercurial). +// "branches": ["master"], // for git +// "branches": ["default"],// for mercurial +"branches": ["default", "stable"], + +// The DVCS being used. If not set, it will be automatically +// determined from "repo" by looking at the protocol in the URL +// (if remote), or by looking for special directories, such as +// ".git" (if local). +// "dvcs": "git", + +// The tool to use to create environments. May be "conda", +// "virtualenv" or other value depending on the plugins in use. +// If missing or the empty string, the tool will be automatically +// determined by looking for tools on the PATH environment +// variable. +"environment_type": "virtualenv", + +// the base URL to show a commit for the project. +"show_commit_url": "https://www.selenic.com/hg/rev/";, + +// The Pythons you'd like to test against. If not provided, defaults +// to the current version of Python used to run `asv`. +// "pythons": ["2.7", "3.3"], + +// The matrix of dependencies to test. Each key is the name of a +// package (in PyPI) and the values are version numbers. An empty +// list or empty string indicates to just test against the default +// (latest) version. null indicates that the package is to not be +// installed. If the package to be tested is only available from +// PyPi, and the 'environment_type' is conda, then you can preface +// the package name by 'pip+', and the package will be installed via +// pip (with all the conda available packages installed first, +// followed by the pip installed packages). +// +// "matrix": { +// "numpy": ["1.6", "1.7"], +// "six": ["", null],// test with and without six installed +// "pip+emcee": [""], // emcee is only available for install with pip. +// }, + +// Combinations of libraries/python versions can be excluded/included +// from the set to test. Each entry is a dictionary containing additional +// key-value pairs to include/exclude. +// +// An exclude entry excludes entries where all values match. The +// values are regexps that should match the whole string. +// +// An include entry adds an environment. Only the packages listed +// are installed. The 'python' key is required. The exclude rules +// do not apply to includes. +// +// In addition to package names, the following keys are available: +// +// - python +// Python version, as in the *pythons* variable above. +// - environment_type +// Environment type, as above. +// - sys_platform +// Platform, as in sys.platform. Possible values for the common +// cases: 'linux2', 'win32', 'cygwin', 'darwin'. +// +// "exclude": [ +// {"python": "3.2", "sys_platform": "win32"}, // skip py3.2 on windows +// {"environment_type": "conda", "six": null}, // don't run without six on conda +// ], +// +// "include": [ +// // additional env for python2.7 +// {"python": "2.7", "numpy": "1.8"}, +// // additional env if run on windows+conda +// {"platform": "win32", "