[OE-core] [PATCH 2/2] sysklogd and busybox: ignore return code from init script stop

2016-10-11 Thread Markus Lehtonen
The init script will return '1' if we try to stop the service and it is not currently running. The prerm scriptlet must not fail because of this because it will cause package deinstallation of upgrade fail if opkg package manager is used. [YOCTO #10299] Signed-off-by: Markus Lehtonen

[OE-core] [PATCH 1/2] update-rc.d.bbclass: ignore init script return code

2016-10-11 Thread Markus Lehtonen
; if you try to stop a service that is not running which, in turn, causes the scriptlet to fail which, in turn, causes the package (de-)installation to fail. [YOCTO #10299] Signed-off-by: Markus Lehtonen --- meta/classes/update-rc.d.bbclass | 4 ++-- 1 file changed, 2 insertions(+), 2 deleti

Re: [OE-core] [PATCH] update-rc.d.bbclass: check that init script exists before running it

2016-10-06 Thread Markus Lehtonen
On Thu, 2016-10-06 at 11:12 +0100, Phil Blundell wrote: > On Thu, 2016-10-06 at 11:49 +0300, Markus Lehtonen wrote: > > On Wed, 2016-10-05 at 16:51 +0200, Andreas Oberritter wrote: > > > Hello Markus, > > > > > > On 05.10.2016 16:11, Markus Lehtonen wrote: >

[OE-core] [PATCH v3] update-rc.d.bbclass: check that init script is executable before running it

2016-10-06 Thread Markus Lehtonen
Check that the init script that is going to be called in the prerm() script really exists and is executable. There might be a packaging bug or the script might've been removed already earlier in prerm(). [YOCTO #10299] Signed-off-by: Markus Lehtonen --- meta/classes/update-rc.d.bbclas

Re: [OE-core] [PATCH] update-rc.d.bbclass: check that init script exists before running it

2016-10-06 Thread Markus Lehtonen
On Wed, 2016-10-05 at 16:51 +0200, Andreas Oberritter wrote: > Hello Markus, > > On 05.10.2016 16:11, Markus Lehtonen wrote: > > Check that the init script that is going to be called in the prerm() > > script really exists. There might be a packaging bug or the script >

[OE-core] [PATCH] update-rc.d.bbclass: check that init script exists before running it

2016-10-05 Thread Markus Lehtonen
Check that the init script that is going to be called in the prerm() script really exists. There might be a packaging bug or the script might've been removed already earlier in prerm(). [YOCTO #10299] Signed-off-by: Markus Lehtonen --- meta/classes/update-rc.d.bbclass | 2 +- 1 file chang

[OE-core] [PATCH v2] oeqa.buildperf: measure apparent size instead of real disk usage

2016-10-05 Thread Markus Lehtonen
This change aligns disk usage measurements of the eSDK test with the old build-perf-test.sh script. And thus, also makes the results between the old and the new script comparable. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 9 +++-- meta/lib/oeqa/buildperf

[OE-core] [PATCH] oeqa.buildperf: measure apparent size instead of real disk usage

2016-10-04 Thread Markus Lehtonen
This change aligns disk usage measurements with the old build-perf-test.sh script. And thus, also makes the results between the old and the new script comparable. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git

[OE-core] [PATCH 1/2] oe-build-perf-test: return 2 if some tests failed

2016-09-30 Thread Markus Lehtonen
Add a new return value '2' that indicates that some tests failed but there were no fatal errors (i.e. configuration mistakes or bugs in the tests themselves). Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) di

[OE-core] [PATCH 2/2] build-perf-test-wrapper.sh: accept test case failures

2016-09-30 Thread Markus Lehtonen
so test failures shouldn't affect the results of successful tests. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapper.sh | 23 ++- 1 file changed, 14 insertions(+), 9 deletions(-) diff --git a/scripts/contrib/build-perf-test-wrapper.sh b/sc

[OE-core] [PATCH 0/2] build-perf-test: improve handling of test case failures

2016-09-30 Thread Markus Lehtonen
prematurely with an error. This patch makes the wrapper script to "tolerate" test case failures, allowing it to display and archive the results even in their presence. Markus Lehtonen (2): oe-build-perf-test: return 2 if some tests failed build-perf-test-wrapper.sh: accept test cas

[OE-core] [PATCH 2/2] build-perf-test-wrapper.sh: show defaults for '-a' and '-w'

2016-09-29 Thread Markus Lehtonen
Display default values for '-a' and '-w' command line arguments in the usage help text. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapper.sh | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/scripts/contrib/build-perf-test-w

[OE-core] [PATCH 1/2] build-perf-test-wrapper.sh: check for positional arguments

2016-09-29 Thread Markus Lehtonen
Stricter checking of command line arguments. The script doesn't use any positional arguments so don't accept any and error out if those are found. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapper.sh | 8 1 file changed, 8 insertions(+) diff --git

[OE-core] [PATCH 0/2] build-perf-test: usability improvements

2016-09-29 Thread Markus Lehtonen
Two small patches that slightly improve the usability of build-perf-test-wrapper.sh script. Markus Lehtonen (2): build-perf-test-wrapper.sh: check for positional arguments build-perf-test-wrapper.sh: show defaults for '-a' and '-w' scripts/contrib/build-perf-

[OE-core] [PATCH 11/11] scripts/buildstats-diff: implement --multi option

2016-09-29 Thread Markus Lehtonen
ng that no differences in package versions or tasks are allowed. Otherwise, the script will exit with an error. Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 99 - 1 file changed, 73 insertions(+), 26 deletions(-) diff --git a/scripts/

[OE-core] [PATCH 10/11] scripts/buildstats-diff: make logger msg format a bit more readable

2016-09-29 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/buildstats-diff b/scripts/buildstats-diff index 3c6cb1e..c5c48d3 100755 --- a/scripts/buildstats-diff +++ b/scripts/buildstats-diff @@ -26,7 +26,7 @@ from

[OE-core] [PATCH 09/11] scripts/buildstats-diff: use exception for internal error handling

2016-09-29 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 38 +- 1 file changed, 21 insertions(+), 17 deletions(-) diff --git a/scripts/buildstats-diff b/scripts/buildstats-diff index f26a6c1..3c6cb1e 100755 --- a/scripts/buildstats-diff +++ b/scripts

[OE-core] [PATCH 08/11] scripts/buildstats-diff: add walltime to --diff-attr

2016-09-29 Thread Markus Lehtonen
For comparing the elapsed wall clock time of tests. Default values for --min-val and --min-absdiff are 5 seconds and 2 seconds. Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 13 ++--- 1 file changed, 10 insertions(+), 3 deletions(-) diff --git a/scripts/buildstats-diff b

[OE-core] [PATCH 07/11] scripts/buildstats-diff: add read_ops and write_ops to --diff-attr

2016-09-29 Thread Markus Lehtonen
Two new options, making it possible to compare the number of filesystem operations of tasks. Defaults for --min-val and --min-absdiff are set to more or less arbitrary 500 and 50 operations, respectively. Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 27

[OE-core] [PATCH 05/11] scripts/buildstats-diff: introduce --diff-attr

2016-09-29 Thread Markus Lehtonen
A new command line option for choosing which "attribute" of the buildstats to compare. At first, the already supported 'cputime' is the only available option. But, refactoring done in this patch should make it easy to add new attribute types. Signed-off-by: Markus Le

[OE-core] [PATCH 06/11] scripts/buildstats-diff: add read_bytes and write_bytes to --diff-attr

2016-09-29 Thread Markus Lehtonen
These are I/O counter values from /proc//io and represent the number of bytes read from / written to the storage layer. Default values for --min-val and --min-absdiff limits are set to 512kB and 128kB, respectively. Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 46

[OE-core] [PATCH 04/11] scripts/buildstats-diff: do not hardcode field widths in output

2016-09-29 Thread Markus Lehtonen
Dynamically adjust the width of all fields in task diff output. Makes it easier to print other units than cputime, too. Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 60 ++--- 1 file changed, 32 insertions(+), 28 deletions(-) diff

[OE-core] [PATCH 01/11] scripts/buildstats-diff: check that the given directory exists

2016-09-29 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 5 - 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/scripts/buildstats-diff b/scripts/buildstats-diff index 8ee2aaf..d0cd766 100755 --- a/scripts/buildstats-diff +++ b/scripts/buildstats-diff @@ -115,11 +115,14 @@ def

[OE-core] [PATCH 03/11] scripts/buildstats-diff: implement BSTask class

2016-09-29 Thread Markus Lehtonen
New class representing buildstats data of a single task. Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 51 +++-- 1 file changed, 32 insertions(+), 19 deletions(-) diff --git a/scripts/buildstats-diff b/scripts/buildstats-diff index

[OE-core] [PATCH 02/11] scripts/buildstats-diff: rename --min-time and --min-timediff args

2016-09-29 Thread Markus Lehtonen
Rename these arguments to --min-val and --min-absdiff in preparation for supporting other "quantities" than just cputime. Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 24 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/scripts/

[OE-core] [PATCH 00/11] Improvements to scripts/buildstats-diff

2016-09-29 Thread Markus Lehtonen
://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildstats-diff Markus Lehtonen (11): scripts/buildstats-diff: check that the given directory exists scripts/buildstats-diff: rename --min-time and --min-timediff args scripts/buildstats-diff: implement BSTask class scripts/buildstats-diff

[OE-core] [PATCH 0/2] Reduce dependency on Python v2

2016-09-26 Thread Markus Lehtonen
Two simple patches to reduce our dependency on python2. Markus Lehtonen (2): autotools.bbclass: use python3 instead of python (v2) glibc-initial: use python3 instead of python (v2) meta/classes/autotools.bbclass| 2 +- meta/recipes-core/glibc/glibc-initial.inc | 2 +- 2 files

[OE-core] [PATCH 2/2] glibc-initial: use python3 instead of python (v2)

2016-09-26 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/recipes-core/glibc/glibc-initial.inc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-core/glibc/glibc-initial.inc b/meta/recipes-core/glibc/glibc-initial.inc index 0c8bd64..ec21f10 100644 --- a/meta/recipes-core/glibc

[OE-core] [PATCH 1/2] autotools.bbclass: use python3 instead of python (v2)

2016-09-26 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/classes/autotools.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/classes/autotools.bbclass b/meta/classes/autotools.bbclass index e5f527e..ecbba9f 100644 --- a/meta/classes/autotools.bbclass +++ b/meta/classes

[OE-core] [PATCH] sanity.bbclass: split out config re-parse check

2016-09-15 Thread Markus Lehtonen
parsed (after ConfigParsed event). However, previously BB_INVALIDCONF was set in SanityCheck event handler which caused re-parsing never to happen. [YOCTO #10188] Signed-off-by: Markus Lehtonen --- meta/classes/sanity.bbclass | 27 --- 1 file changed, 12 insertions(+), 15

Re: [OE-core] [PATCH] scripts: introduce buildstats-diff

2016-09-14 Thread Markus Lehtonen
From: "Burton, Ross" Date: Wednesday 14 September 2016 at 19:38 To: Markus Lehtonen Cc: OE-core Subject: Re: [OE-core] [PATCH] scripts: introduce buildstats-diff On 14 September 2016 at 12:24, Markus Lehtonen wrote: > +if not tasks1: > +pkg_op = 

[OE-core] [PATCH] scripts: introduce buildstats-diff

2016-09-14 Thread Markus Lehtonen
to alter the sort criteria of the data and to filter out insignificant differences and/or short tasks. Signed-off-by: Markus Lehtonen --- scripts/buildstats-diff | 411 1 file changed, 411 insertions(+) create mode 100755 scripts/buildstats-diff

[OE-core] [PATCH v2] python-smartpm: use md5 as the digest for rpm_sys channel

2016-09-14 Thread Markus Lehtonen
ons (smart install / remove commands) are fired in quick succession. As a consequence smartpm cache and rpm db get out of sync. [YOCTO #10244] Signed-off-by: Markus Lehtonen --- ...m_sys-use-md5sum-instead-of-mtime-as-the-.patch | 38 ++ meta/recipes-devtools/python/python-smar

[OE-core] [PATCH v2] python-smartpm: use md5 as the digest for rpm_sys channel

2016-09-14 Thread Markus Lehtonen
patch did. Markus Lehtonen (1): python-smartpm: use md5 as the digest for rpm_sys channel ...m_sys-use-md5sum-instead-of-mtime-as-the-.patch | 38 ++ meta/recipes-devtools/python/python-smartpm_git.bb | 1 + 2 files changed, 39 insertions(+) create mode 100644 meta/recipes

[OE-core] [PATCH] python-smartpm: use md5 as the digest for rpm_sys channel

2016-09-13 Thread Markus Lehtonen
ons (smart install / remove commands) are fired in quick succession. As a consequence smartpm cache and rpm db get out of sync. [YOCTO #10244] Signed-off-by: Markus Lehtonen --- ...m_sys-use-md5sum-instead-of-mtime-as-the-.patch | 33 ++ meta/recipes-devtools/python/python-smar

[OE-core] [PATCH v2] gst-player: specify PV

2016-09-12 Thread Markus Lehtonen
Define PV in order to avoid package version being plain "git". Use the version number found from configure.ac plus the git revision. Signed-off-by: Markus Lehtonen --- meta/recipes-multimedia/gstreamer/gst-player_git.bb | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/recipes-

Re: [OE-core] [PATCH] gst-player: include SRCPV in PV

2016-09-12 Thread Markus Lehtonen
On Fri, 2016-09-09 at 11:51 +0100, Burton, Ross wrote: > > On 9 September 2016 at 06:57, Markus Lehtonen < > markus.lehto...@linux.intel.com> wrote: > > +PV = "git${SRCPV}" > > > This breaks packaging for me, throwing interesting python exceptions. Hmm,

[OE-core] [PATCH] gst-player: include SRCPV in PV

2016-09-08 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/recipes-multimedia/gstreamer/gst-player_git.bb | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/recipes-multimedia/gstreamer/gst-player_git.bb b/meta/recipes-multimedia/gstreamer/gst-player_git.bb index 00ad941..4f9aa84 100644 --- a/meta/recipes

[OE-core] [PATCH] oeqa.buildperf: another fix for splitting 'nevr' string

2016-09-08 Thread Markus Lehtonen
version starting with a number is not found, fall back to the "old" method of just taking the second-last dash-delimited part (the one before revision). Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 5 + 1 file changed, 5 insertions(+) diff --git a/meta/lib/oeqa

Re: [OE-core] Speed regression in the 4.8 kernel?

2016-09-07 Thread Markus Lehtonen
On Wed, 2016-09-07 at 08:44 -0400, Bruce Ashfield wrote: > On 2016-09-07 8:33 AM, Markus Lehtonen wrote: > > On Wed, 2016-09-07 at 07:56 -0400, Bruce Ashfield wrote: > > > On 2016-09-07 5:27 AM, Richard Purdie wrote: > > > > Hi Bruce, > > > > >

Re: [OE-core] Speed regression in the 4.8 kernel?

2016-09-07 Thread Markus Lehtonen
On Wed, 2016-09-07 at 08:44 -0400, Bruce Ashfield wrote: > On 2016-09-07 8:33 AM, Markus Lehtonen wrote: > > On Wed, 2016-09-07 at 07:56 -0400, Bruce Ashfield wrote: > > > On 2016-09-07 5:27 AM, Richard Purdie wrote: > > > > Hi Bruce, > > > > >

Re: [OE-core] Speed regression in the 4.8 kernel?

2016-09-07 Thread Markus Lehtonen
On Wed, 2016-09-07 at 07:56 -0400, Bruce Ashfield wrote: > On 2016-09-07 5:27 AM, Richard Purdie wrote: > > Hi Bruce, > > > > I deliberately spaced out the merges of various things so we could get > > performance measurements of the system as it happened. Unfortunately > > the 4.8 kernel appears t

[OE-core] [PATCH 1/2] oeqa.buildperf: try harder when splitting 'nevr' string

2016-09-07 Thread Markus Lehtonen
number. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 2325cd1..7dfb2bf 100644 --- a/meta/lib/oeqa/buildperf/base.py +++ b/meta/lib

[OE-core] [PATCH 2/2] oeqa.buildperf: be sure to use the latest buildstats

2016-09-07 Thread Markus Lehtonen
Be sure to take the latest buildstats if multiple buildstats are found. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 7dfb2bf..9700c05

[OE-core] [PATCH 0/2] Fixes for oe-build-perf-test

2016-09-07 Thread Markus Lehtonen
Two small miscellanious fixes to build perf tests. Markus Lehtonen (2): oeqa.buildperf: try harder when splitting 'nevr' string oeqa.buildperf: be sure to use the latest buildstats meta/lib/oeqa/buildperf/base.py | 8 +--- 1 file changed, 5 insertions(+), 3 deletions(-)

[OE-core] [PATCH] oeqa.buildperf: correct globalres time format

2016-09-05 Thread Markus Lehtonen
Always use two digits for (integer part of) seconds, i.e. show '1:02.34' instead of '1:2.34'. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oe

[OE-core] [PATCH] oe-build-perf-test: fix log file path

2016-09-05 Thread Markus Lehtonen
The --log-file command line argument was slightly broken as {out_dir} string replacement was not working as expected. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/oe-build-perf-test b/scripts/oe-build

[OE-core] [PATCH] build-perf-test-wrapper.sh: fix handling of -C argument

2016-09-02 Thread Markus Lehtonen
Not specifying -C caused oe-build-perf-test to try to commit results to the build directory. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapper.sh | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/scripts/contrib/build-perf-test-wrapper.sh b

[OE-core] [PATCH 11/12] oeqa.buildperf: include buildstats file name in results.json

2016-08-29 Thread Markus Lehtonen
No need to do lsdir magic for finding buildstats when reading results. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 18 ++ meta/lib/oeqa/buildperf/test_basic.py | 7 +++ 2 files changed, 17 insertions(+), 8 deletions(-) diff --git a/meta/lib

[OE-core] [PATCH 07/12] oeqa.buildperf: don't use Gnu time

2016-08-29 Thread Markus Lehtonen
collected through the resource module of Python. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 72 ++--- 1 file changed, 39 insertions(+), 33 deletions(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index

[OE-core] [PATCH 10/12] oeqa.buildperf: show skipped tests in results, too

2016-08-29 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index c716220..49da8f6 100644 --- a/meta/lib/oeqa/buildperf/base.py +++ b/meta/lib/oeqa

[OE-core] [PATCH 09/12] oeqa.buildperf: convert buildstats into json format

2016-08-29 Thread Markus Lehtonen
Instead of archiving buildstats in raw text file format convert all buildstats into one json-formatted file. Some redundant information, i.e. 'Event:', 'utime:', 'stime:', 'cutime:' and 'cstime:' fields, are dropped. Signed-off-by: Markus L

[OE-core] [PATCH 04/12] oeqa.buildperf: strip date from buildstats directory path

2016-08-29 Thread Markus Lehtonen
Archive buildstats in a directory like 'buildstats' instead of something like 'buildstats/2016051312'. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/bas

[OE-core] [PATCH 05/12] oeqa.buildperf: separate output dir for each test

2016-08-29 Thread Markus Lehtonen
Store the output data of each test in an individual subdirectory instead of storing everything in the root output directory. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b

[OE-core] [PATCH 03/12] oe-build-perf-test: rename log file and implement --log-file

2016-08-29 Thread Markus Lehtonen
the output directory. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 5 - 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/scripts/oe-build-perf-test b/scripts/oe-build-perf-test index 3dab070..8d7fdf2 100755 --- a/scripts/oe-build-perf-test +++ b/scripts/oe-build

[OE-core] [PATCH 12/12] oeqa.buildperf: include commands log file name in results.json

2016-08-29 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 14 +- 1 file changed, 9 insertions(+), 5 deletions(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 0b2c0f8..be3a946 100644 --- a/meta/lib/oeqa/buildperf/base.py +++ b/meta

[OE-core] [PATCH 08/12] oeqa.buildperf: measure io stat

2016-08-29 Thread Markus Lehtonen
Add data from /proc//io to system resource measurements. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 5987bfb..95a0abf

[OE-core] [PATCH 06/12] oeqa.buildperf: rename buildstats directories

2016-08-29 Thread Markus Lehtonen
Change directory name from 'buildstats-' to just 'buildstats'. However, this patch adds the possibility to label buildstats directory name with a postfix which makes it possible to save multiple buildstats per test, for example. Signed-off-by: Markus Lehtonen --- meta/lib/oe

[OE-core] [PATCH 01/12] oeqa.buildperf: add 'product' to test result data

2016-08-29 Thread Markus Lehtonen
This defaults to 'oe-core' but can be defined using the OE_BUILDPERF_PRODUCT environment variable. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/bas

[OE-core] [PATCH 02/12] oeqa.buildperf: enable json-formatted results

2016-08-29 Thread Markus Lehtonen
Automatically create a json.formatted file (results.json) in the results directory that contains results from all tests. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 40 1 file changed, 40 insertions(+) diff --git a/meta/lib/oeqa

[OE-core] [PATCH 00/12] oe-build-perf-test: new format for test output data

2016-08-29 Thread Markus Lehtonen
nd git even if tests failed (2016-08-26 10:11:38 +0300) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/buildperf/new-result-fmt http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/new-result-fmt

[OE-core] [PATCH 2/4] oeqa.buildperf: make tests independent

2016-08-26 Thread Markus Lehtonen
in total execution time of the full suite - caused by the additional set-up steps - is insignificant because normally no additional tasks need to be run. The previous test has already done all set-up work. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 7 +++ meta

[OE-core] [PATCH 0/4] oe-build-perf-test: remove inter-dependencies of tests

2016-08-26 Thread Markus Lehtonen
-tests Markus Lehtonen (4): oeqa.buildperf: fix checking of invalid results oeqa.buildperf: make tests independent oeqa.buildperf: treat failed measurements as errors oe-build-perf-test: update globalres and git even if tests failed meta/lib/oeqa/buildperf/base.py | 45

[OE-core] [PATCH 3/4] oeqa.buildperf: treat failed measurements as errors

2016-08-26 Thread Markus Lehtonen
Now failed measurements correctly cause a test failure (recorded as an error). There should be no need to continue the test if one step fails, especially now that the tests don't depend on each other. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py

[OE-core] [PATCH 1/4] oeqa.buildperf: fix checking of invalid results

2016-08-26 Thread Markus Lehtonen
The test status check done when writing globalres log was incorrect. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 97be58f..e4a7948

[OE-core] [PATCH 4/4] oe-build-perf-test: update globalres and git even if tests failed

2016-08-26 Thread Markus Lehtonen
Write globalres log file and commit results to Git even if some tests failed. Now that tests do not depend on each other there should be no risk of bogus results caused by test failures. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 12 ++-- 1 file changed, 6

[OE-core] [PATCH v2 0/9] oe-build-perf-test: use Python unittest framework

2016-08-24 Thread Markus Lehtonen
/buildperf/unittest http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/unittest Markus Lehtonen (9): oeqa.buildperf: rename module containing basic tests oeqa.buildperf: derive BuildPerfTestCase class from unitest.TestCase oeqa.buildperf: add BuildPerfTestLoader

[OE-core] [PATCH 19/19] build-perf-test-wrapper.sh: make workdir configurable

2016-08-24 Thread Markus Lehtonen
New command line argument '-w' may be used to specify work dir other than the default /build-perf-test. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapper.sh | 12 +--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/scripts/contrib/build

[OE-core] [PATCH 16/19] build-perf-test-wrapper.sh: parse args with getopts

2016-08-24 Thread Markus Lehtonen
Use getopts for parsing the command line. This changes the usage so that if a commit (to-be-tested) is defined it must be given by using '-c', instead of a positional argument. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapper.sh | 30 +++

[OE-core] [PATCH 14/19] oeqa.buildperf: add git commit count to result data

2016-08-24 Thread Markus Lehtonen
This number represents the number of commits since the beginning of git history until the tested revision. This helps e.g. in ordering results. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 18 +++--- 1 file changed, 11 insertions(+), 7 deletions(-) diff

[OE-core] [PATCH 12/19] oe-build-perf-test: tag results committed to Git

2016-08-24 Thread Markus Lehtonen
commit being tested - {tester_host} - hostname of the tester machine Tagging can be disabled by giving an empty string to --commit-results-tag. The option has no effect if --commit-results is not defined. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 11 ++- scripts

[OE-core] [PATCH 09/19] oe-build-perf-test: implement --commit-results-branch

2016-08-24 Thread Markus Lehtonen
effect if --commit-results is not used. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 5 + scripts/oe-build-perf-test | 6 +- 2 files changed, 10 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index

[OE-core] [PATCH 06/19] oeqa.utils.git.GitRepo: new arg to require topdir

2016-08-24 Thread Markus Lehtonen
directory of this repository) which may have undesired in some cases. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/git.py | 9 +++-- 1 file changed, 7 insertions(+), 2 deletions(-) diff --git a/meta/lib/oeqa/utils/git.py b/meta/lib/oeqa/utils/git.py index 0fc8112..ca84680 100644

[OE-core] [PATCH 05/19] oeqa.utils.git: implement GitRepo.get_current_branch()

2016-08-24 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 7 ++- meta/lib/oeqa/utils/git.py | 8 2 files changed, 10 insertions(+), 5 deletions(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 6a8d9fe..adc3da3 100644 --- a/meta

[OE-core] [PATCH 17/19] build-perf-test-wrapper.sh: allow saving results in Git

2016-08-24 Thread Markus Lehtonen
Add new command line argument '-C' that allows saving results in a Git repository. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapper.sh | 14 +++--- 1 file changed, 11 insertions(+), 3 deletions(-) diff --git a/scripts/contrib/build-perf-test-wra

[OE-core] [PATCH 18/19] build-perf-test-wrapper.sh: make archive dir configurable

2016-08-24 Thread Markus Lehtonen
Add new command line argument '-a' that can be used to define the directory where results (tarballs) are archived. Giving an empty string disables archiving which makes sense if you store results in Git. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapp

[OE-core] [PATCH 11/19] oe-build-perf-test: pre-check Git repo when using --commit-results

2016-08-24 Thread Markus Lehtonen
. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 27 +++ 1 file changed, 27 insertions(+) diff --git a/scripts/oe-build-perf-test b/scripts/oe-build-perf-test index 390e4c9..437611c 100755 --- a/scripts/oe-build-perf-test +++ b/scripts/oe-build-perf-test

[OE-core] [PATCH 13/19] oe-build-perf-test: new {tag_num} keyword for --commit-results-tag

2016-08-24 Thread Markus Lehtonen
git_commit}/{tag_num} would give you tags something like: myhost/decb3119dffd3fd38b800bebc1e510f9217a152e/0 myhost/decb3119dffd3fd38b800bebc1e510f9217a152e/1 ... The default tag format is updated to use this new keyword in order to prevent unintentional tag name clashes. Signed-off-by: Marku

[OE-core] [PATCH 10/19] oeqa.utils.git: implement init() method

2016-08-24 Thread Markus Lehtonen
Method for doing 'git init'. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/git.py | 6 ++ 1 file changed, 6 insertions(+) diff --git a/meta/lib/oeqa/utils/git.py b/meta/lib/oeqa/utils/git.py index ca84680..ae85d27 100644 --- a/meta/lib/oeqa/utils/git.py +++ b/meta/lib/

[OE-core] [PATCH 15/19] oe-build-perf-test: add {git_commit_count} keyword for --commit-results-tag

2016-08-24 Thread Markus Lehtonen
Makes it possible to create easily sortable tags. Also, the default tag format is updated to use the new keyword. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 1 + scripts/oe-build-perf-test | 2 +- 2 files changed, 2 insertions(+), 1 deletion(-) diff --git a/meta

[OE-core] [PATCH 07/19] oeqa.buildperf: use term commit instead of revision

2016-08-24 Thread Markus Lehtonen
This is basically a internal change, at this point. Term 'commit' better represents the data we actually have. Term 'revision' is more vague and could be understood to point to a tag object, for example. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/bu

[OE-core] [PATCH 08/19] oe-build-perf-test: support committing results data to Git

2016-08-24 Thread Markus Lehtonen
Implement a new command line option '--commit-results' which commits the test results data into a Git repository. The given path must be an existing initialized local Git repository. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/ba

[OE-core] [PATCH 01/19] oe-build-perf-test: implement --run-tests option

2016-08-24 Thread Markus Lehtonen
Makes it possible to run only a subset of tests. NOTE: The tests currently have (unwritten) dependencies on each other so use this option with care. Mainly for debugging. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 7 ++- 1 file changed, 6 insertions(+), 1 deletion

[OE-core] [PATCH 00/19] oe-build-pef-test: support saving results in a Git repo

2016-08-24 Thread Markus Lehtonen
available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/buildperf/git http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/git Markus Lehtonen (19): oe-build-perf-test: implement --run-tests option oe-build-perf-test: use

[OE-core] [PATCH 04/19] oeqa.utils.git: introduce GitRepo.rev_parse()

2016-08-24 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 2 +- meta/lib/oeqa/utils/git.py | 7 +++ 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 30b8e47..6a8d9fe 100644 --- a/meta/lib

[OE-core] [PATCH 03/19] oeqa.utils.git: support git commands with updated env

2016-08-24 Thread Markus Lehtonen
Extend GitRepo.run_cmd so that the caller may redefine and/or define additional environment variables that will be used when the git command is run. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/git.py | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/meta/lib

[OE-core] [PATCH 02/19] oe-build-perf-test: use absolute paths in cmdline args

2016-08-24 Thread Markus Lehtonen
This is safer as the current working directory may change. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/scripts/oe-build-perf-test b/scripts/oe-build-perf-test index 808531e..21759c6 100755 --- a/scripts/oe

[OE-core] [PATCH 2/2] oeqa.buildperf: fix crash when creating globalres.log

2016-08-19 Thread Markus Lehtonen
Fix a bug that was introduced when converting to unittest framework. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index c1dc86e..30b8e47

[OE-core] [PATCH 0/2] Fixes to oe-build-perf-test

2016-08-19 Thread Markus Lehtonen
repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/buildperf/unittest http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/unittest Markus Lehtonen (2): oe-build-perf-test: align log message format with testrunner output oeqa.buildperf

[OE-core] [PATCH 1/2] oe-build-perf-test: align log message format with testrunner output

2016-08-19 Thread Markus Lehtonen
The previous attempt on this was a bit erroneous, dropping time stamps completely although only the timestamp format should've been changed. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/scripts/oe-

[OE-core] [PATCH v2 0/9] oe-build-perf-test: use Python unittest framework

2016-08-16 Thread Markus Lehtonen
/buildperf/unittest http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/unittest Markus Lehtonen (9): oeqa.buildperf: rename module containing basic tests oeqa.buildperf: derive BuildPerfTestCase class from unitest.TestCase oeqa.buildperf: add BuildPerfTestLoader

[OE-core] [PATCH v2] oeqa.buildperf: use oe.path.remove()

2016-08-12 Thread Markus Lehtonen
Drop the self-baked force_rm() method. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 15 --- meta/lib/oeqa/buildperf/test_basic.py | 5 +++-- 2 files changed, 7 insertions(+), 13 deletions(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa

[OE-core] [PATCH v2] oeqa.buildperf: use oe.path.remove()

2016-08-12 Thread Markus Lehtonen
Rebased on top of my "unittest refactor" patchset. No other changes. Markus Lehtonen (1): oeqa.buildperf: use oe.path.remove() meta/lib/oeqa/buildperf/base.py | 15 --- meta/lib/oeqa/buildperf/test_basic.py | 5 +++-- 2 files changed, 7 insertions(+), 13

[OE-core] [PATCH 9/9] oeqa.buildperf: be more verbose about failed commands

2016-08-12 Thread Markus Lehtonen
Log failures of commands whose output is stored. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 12 +--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 7ea3183..af169e1 100644

[OE-core] [PATCH 7/9] oeqa.buildperf: introduce runCmd2()

2016-08-12 Thread Markus Lehtonen
lds for certain measurement results. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/__init__.py | 3 ++- meta/lib/oeqa/buildperf/base.py | 15 ++- 2 files changed, 12 insertions(+), 6 deletions(-) diff --git a/meta/lib/oeqa/buildperf/__init__.py b/meta/lib/oeqa/buildp

[OE-core] [PATCH 6/9] oe-build-perf-test: use new unittest based framework

2016-08-12 Thread Markus Lehtonen
Convert scripts/oe-build-perf-test to be compatible with the new Python unittest based buildperf test framework. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 19 +-- 1 file changed, 13 insertions(+), 6 deletions(-) diff --git a/scripts/oe-build-perf-test b

[OE-core] [PATCH 8/9] oe-build-perf-test: write logger output into file only

2016-08-12 Thread Markus Lehtonen
Write the output from the Python logger only into the log file. This way the console output from the script is cleaner and not mixed with the logger records. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 25 + 1 file changed, 13 insertions(+), 12

[OE-core] [PATCH 5/9] oeqa.buildperf: convert test cases to unittest

2016-08-12 Thread Markus Lehtonen
This commit converts the actual tests to be compatible with the new Python unittest based framework. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/test_basic.py | 50 +-- 1 file changed, 19 insertions(+), 31 deletions(-) diff --git a/meta/lib/oeqa

[OE-core] [PATCH 4/9] oeqa.buildperf: add BuildPerfTestResult class

2016-08-12 Thread Markus Lehtonen
The new class is derived from unittest.TextTestResult class. It is actually implemented by modifying the old BuildPerfTestRunner class which, in turn, is replaced by a totally new simple implementation derived from unittest.TestRunner. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf

[OE-core] [PATCH 2/9] oeqa.buildperf: derive BuildPerfTestCase class from unitest.TestCase

2016-08-12 Thread Markus Lehtonen
Rename BuildPerfTest to BuildPerfTestCase and convert it to be derived from TestCase class from the unittest framework of the Python standard library. This doesn't work with our existing testcases or test runner class and these need to be modified, too. Signed-off-by: Markus Lehtonen ---

<    1   2   3   4   5   6   7   >