Re: [OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-14 Thread Bruce Ashfield 

On 2018-03-14 8:50 AM, Burton, Ross wrote:
On 14 March 2018 at 12:46, Bruce Ashfield > wrote:


I'll revert this for now (or see if I can quickly move it to a debug
kernel build), and yes, there is a better way to do this. I'm just not
sure I can get it done in time for the release.


Thanks.  I'm desperately trying to be able to tell RP we can fire the M3 
build so I'm +1 on reverting now, fixing later.


revert sent. I put all the details in the commit log about how
to build systemtap with the relevant options enabled. So there's
still a way to build with the options that were the intent of that
change, and with this revert the standard kernel should go back
to normal.

Bruce



Ross


--
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-14 Thread Burton, Ross 
On 14 March 2018 at 12:46, Bruce Ashfield 
wrote:

> I'll revert this for now (or see if I can quickly move it to a debug
> kernel build), and yes, there is a better way to do this. I'm just not
> sure I can get it done in time for the release.
>

Thanks.  I'm desperately trying to be able to tell RP we can fire the M3
build so I'm +1 on reverting now, fixing later.

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-14 Thread Bruce Ashfield 

On 2018-03-14 8:41 AM, Burton, Ross wrote:
On 6 March 2018 at 18:11, Bruce Ashfield > wrote:


Integrating a configuration change for systemtap:

   features/systemtap/systemtap.cfg: enable CONFIG_KERNEL_DEBUG


I noticed that all the performance machines had a big spike in kernel 
build time and build directory size, and annoyingly spent too long 
bisecting builds before noticing this in the commit message for the 
offending commit.  If I re-read the logs I might have spotted this 
sooner. :)


Agreed. I should have realized this as well, we went through a process
about a year ago of moving all of the debug configs with the split into
a production/debug set of kernel configurations.



$ buildstats-diff 20180314122002-3a8cce8b5c2 20180314122610-a7c9bc7020a/
Ignoring tasks less than 00:03.0 (3.0s)
Ignoring differences less than 00:01.0 (1.0s)

   PKG            TASK                      ABSDIFF   RELDIFF  CPUTIME1 
-> CPUTIME2
   linux-yocto    do_package                  20.2s   +153.0%     13.2s 
-> 33.3s
   linux-yocto    do_deploy                   29.9s  +1502.8%      2.0s 
-> 31.9s
   linux-yocto    do_package_write_ipk       125.5s   +310.2%     40.5s 
-> 166.0s
   linux-yocto    do_compile_kernelmodules   142.6s    +17.8%    800.3s 
-> 942.9s
   linux-yocto    do_package_write_rpm       156.0s   +563.6%     27.7s 
-> 183.7s
   linux-yocto    do_compile                 174.8s    +18.7%    934.3s 
-> 1109.1s


Cumulative cputime:
   649.5s    +35.0%    30:56.0 (1856.0s) -> 41:45.5 (2505.5s)

$ buildhistory-diff | grep SIZE
packages/qemux86-poky-linux/linux-yocto/kernel-vmlinux: PKGSIZE changed 
from 19587044 to 300944172 (+1436%)


Is this really what we want out of the box?  Can the kernel have the 
debugging bits stripped out into a separate package so even if we have 
the build time hit, we don't have the kernel size change?


I'll revert this for now (or see if I can quickly move it to a debug
kernel build), and yes, there is a better way to do this. I'm just not
sure I can get it done in time for the release.

Bruce



Ross


--
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-14 Thread Burton, Ross 
On 6 March 2018 at 18:11, Bruce Ashfield 
wrote:

> Integrating a configuration change for systemtap:
>
>   features/systemtap/systemtap.cfg: enable CONFIG_KERNEL_DEBUG
>

I noticed that all the performance machines had a big spike in kernel build
time and build directory size, and annoyingly spent too long bisecting
builds before noticing this in the commit message for the offending
commit.  If I re-read the logs I might have spotted this sooner. :)

$ buildstats-diff 20180314122002-3a8cce8b5c2 20180314122610-a7c9bc7020a/
Ignoring tasks less than 00:03.0 (3.0s)
Ignoring differences less than 00:01.0 (1.0s)

  PKGTASK  ABSDIFF   RELDIFF  CPUTIME1 ->
CPUTIME2
  linux-yoctodo_package  20.2s   +153.0% 13.2s ->
33.3s
  linux-yoctodo_deploy   29.9s  +1502.8%  2.0s ->
31.9s
  linux-yoctodo_package_write_ipk   125.5s   +310.2% 40.5s ->
166.0s
  linux-yoctodo_compile_kernelmodules   142.6s+17.8%800.3s ->
942.9s
  linux-yoctodo_package_write_rpm   156.0s   +563.6% 27.7s ->
183.7s
  linux-yoctodo_compile 174.8s+18.7%934.3s ->
1109.1s

Cumulative cputime:
  649.5s+35.0%30:56.0 (1856.0s) -> 41:45.5 (2505.5s)

$ buildhistory-diff | grep SIZE
packages/qemux86-poky-linux/linux-yocto/kernel-vmlinux: PKGSIZE changed
from 19587044 to 300944172 (+1436%)

Is this really what we want out of the box?  Can the kernel have the
debugging bits stripped out into a separate package so even if we have the
build time hit, we don't have the kernel size change?

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-07 Thread Burton, Ross 
On 7 March 2018 at 15:06, Bruce Ashfield 
wrote:

>
> Odd. My merge of standard/tiny/base -> tiny* didn't go automatically.
> Could have been the new branch naming. Either way, that SRCREV is
> now valid for 4.14, and there's no patch to resend.
>
> Bruce
>
> --
>
> [/home/bruc...-yocto.git]> kgit-merge v4.14/standard/tiny/base
> :v4.14/standard/tiny
> Already up-to-date.
> Already up-to-date!
> Merge made by the 'recursive' strategy.
> Already up-to-date!
> Merge made by the 'recursive' strategy.
> Switched to branch 'v4.14/standard/tiny/base'
> [/home/bruc...-yocto.git]> git branch --contains
> 09828ddd8d8c91b2d68afdcd8eb99a48e0253582
> * v4.14/standard/tiny/base
>   v4.14/standard/tiny/common-pc
>   v4.14/standard/tiny/intel
> [/home/bruc...-yocto.git]> git push origin
> Counting objects: 2, done.
> Delta compression using up to 4 threads.
> Compressing objects: 100% (2/2), done.
> Writing objects: 100% (2/2), 336 bytes | 0 bytes/s, done.
> Total 2 (delta 1), reused 0 (delta 0)
> To ssh://g...@git.yoctoproject.org/linux-yocto.git
>69908a02e1e9..59628e3129a3  v4.14/standard/tiny/common-pc ->
> v4.14/standard/tiny/common-pc
>23d712fdbb9b..6a5e7b08591d  v4.14/standard/tiny/intel ->
> v4.14/standard/tiny/intel
>

Great, thanks.

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-07 Thread Bruce Ashfield 

On 03/07/2018 03:38 AM, Burton, Ross wrote:
On 6 March 2018 at 18:11, Bruce Ashfield > wrote:


diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb

b/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb

index ae9e7691367d..1ccbf6283e43 100644
--- a/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb

+++ b/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb

@@ -9,8 +9,8 @@ LINUX_VERSION ?= "4.14.24"
  KMETA = "kernel-meta"
  KCONF_BSP_AUDIT_LEVEL = "2"

-SRCREV_machine ?= "fccf7693fe5dd00d7b6d391b7405b5d58eb959f2"
-SRCREV_meta ?= "426c8aa4862f95e84ec163b942b92726d3ef978f"
+SRCREV_machine ?= "09828ddd8d8c91b2d68afdcd8eb99a48e0253582"
+SRCREV_meta ?= "54b3e9b768651ca15bf65ae1c72dfe6d957285f0"


ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0 
do_fetch: Fetcher failure: Unable to find revision 
09828ddd8d8c91b2d68afdcd8eb99a48e0253582 in branch 
v4.14/standard/tiny/common-pc even from upstream
ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0 
do_fetch: Fetcher failure for URL: 
'git://git.yoctoproject.org/linux-yocto.git;branch=v4.14/standard/tiny/common-pc;name=machine 
'. 
Unable to fetch URL from any source.
ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0 
do_fetch: Function failed: base_do_fetch


Odd. My merge of standard/tiny/base -> tiny* didn't go automatically.
Could have been the new branch naming. Either way, that SRCREV is
now valid for 4.14, and there's no patch to resend.

Bruce

--

[/home/bruc...-yocto.git]> kgit-merge v4.14/standard/tiny/base 
:v4.14/standard/tiny

Already up-to-date.
Already up-to-date!
Merge made by the 'recursive' strategy.
Already up-to-date!
Merge made by the 'recursive' strategy.
Switched to branch 'v4.14/standard/tiny/base'
[/home/bruc...-yocto.git]> git branch --contains 
09828ddd8d8c91b2d68afdcd8eb99a48e0253582

* v4.14/standard/tiny/base
  v4.14/standard/tiny/common-pc
  v4.14/standard/tiny/intel
[/home/bruc...-yocto.git]> git push origin
Counting objects: 2, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (2/2), done.
Writing objects: 100% (2/2), 336 bytes | 0 bytes/s, done.
Total 2 (delta 1), reused 0 (delta 0)
To ssh://g...@git.yoctoproject.org/linux-yocto.git
   69908a02e1e9..59628e3129a3  v4.14/standard/tiny/common-pc -> 
v4.14/standard/tiny/common-pc
   23d712fdbb9b..6a5e7b08591d  v4.14/standard/tiny/intel -> 
v4.14/standard/tiny/intel





Ross


--
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-07 Thread Bruce Ashfield 
On Wed, Mar 7, 2018 at 3:38 AM, Burton, Ross  wrote:
> On 6 March 2018 at 18:11, Bruce Ashfield 
> wrote:
>>
>> diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
>> b/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
>> index ae9e7691367d..1ccbf6283e43 100644
>> --- a/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
>> +++ b/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
>> @@ -9,8 +9,8 @@ LINUX_VERSION ?= "4.14.24"
>>  KMETA = "kernel-meta"
>>  KCONF_BSP_AUDIT_LEVEL = "2"
>>
>> -SRCREV_machine ?= "fccf7693fe5dd00d7b6d391b7405b5d58eb959f2"
>> -SRCREV_meta ?= "426c8aa4862f95e84ec163b942b92726d3ef978f"
>> +SRCREV_machine ?= "09828ddd8d8c91b2d68afdcd8eb99a48e0253582"
>> +SRCREV_meta ?= "54b3e9b768651ca15bf65ae1c72dfe6d957285f0"
>
>
> ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0
> do_fetch: Fetcher failure: Unable to find revision
> 09828ddd8d8c91b2d68afdcd8eb99a48e0253582 in branch
> v4.14/standard/tiny/common-pc even from upstream
> ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0
> do_fetch: Fetcher failure for URL:
> 'git://git.yoctoproject.org/linux-yocto.git;branch=v4.14/standard/tiny/common-pc;name=machine'.
> Unable to fetch URL from any source.
> ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0
> do_fetch: Function failed: base_do_fetch

Interesting. I'll see what script has gone insane and re-submit a v2.

Bruce

>
> Ross
>
> --
> ___
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-core
>



-- 
"Thou shalt not follow the NULL pointer, for chaos and madness await
thee at its end"
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-07 Thread Burton, Ross 
On 6 March 2018 at 18:11, Bruce Ashfield 
wrote:

> diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
> b/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
> index ae9e7691367d..1ccbf6283e43 100644
> --- a/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
> +++ b/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
> @@ -9,8 +9,8 @@ LINUX_VERSION ?= "4.14.24"
>  KMETA = "kernel-meta"
>  KCONF_BSP_AUDIT_LEVEL = "2"
>
> -SRCREV_machine ?= "fccf7693fe5dd00d7b6d391b7405b5d58eb959f2"
> -SRCREV_meta ?= "426c8aa4862f95e84ec163b942b92726d3ef978f"
> +SRCREV_machine ?= "09828ddd8d8c91b2d68afdcd8eb99a48e0253582"
> +SRCREV_meta ?= "54b3e9b768651ca15bf65ae1c72dfe6d957285f0"
>

ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0
do_fetch: Fetcher failure: Unable to find revision
09828ddd8d8c91b2d68afdcd8eb99a48e0253582 in branch
v4.14/standard/tiny/common-pc even from upstream
ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0
do_fetch: Fetcher failure for URL: 'git://
git.yoctoproject.org/linux-yocto.git;branch=v4.14/standard/tiny/common-pc;name=machine'.
Unable to fetch URL from any source.
ERROR: linux-yocto-tiny-4.14.24+gitAUTOINC+54b3e9b768_09828ddd8d-r0
do_fetch: Function failed: base_do_fetch

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 7/9] linux-yocto: aufs and systemtap

2018-03-06 Thread Bruce Ashfield 
Integrating a configuration change for systemtap:

  features/systemtap/systemtap.cfg: enable CONFIG_KERNEL_DEBUG

And porting the aufs warning fix to 4.14 and 4.15:

  aufs: fix compile warning

Signed-off-by: Bruce Ashfield 
---
 meta/recipes-kernel/linux/linux-yocto-rt_4.12.bb   |  2 +-
 meta/recipes-kernel/linux/linux-yocto-rt_4.14.bb   |  4 ++--
 meta/recipes-kernel/linux/linux-yocto-rt_4.15.bb   |  2 +-
 meta/recipes-kernel/linux/linux-yocto-tiny_4.12.bb |  2 +-
 meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb |  4 ++--
 meta/recipes-kernel/linux/linux-yocto-tiny_4.15.bb |  2 +-
 meta/recipes-kernel/linux/linux-yocto_4.12.bb  |  2 +-
 meta/recipes-kernel/linux/linux-yocto_4.14.bb  | 18 +-
 meta/recipes-kernel/linux/linux-yocto_4.15.bb  |  2 +-
 9 files changed, 19 insertions(+), 19 deletions(-)

diff --git a/meta/recipes-kernel/linux/linux-yocto-rt_4.12.bb 
b/meta/recipes-kernel/linux/linux-yocto-rt_4.12.bb
index d6ffcc86a5ca..3f2a1ef7afa7 100644
--- a/meta/recipes-kernel/linux/linux-yocto-rt_4.12.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-rt_4.12.bb
@@ -12,7 +12,7 @@ python () {
 }
 
 SRCREV_machine ?= "27c21aed67a28d08b13c5cc1fe4287b2cf389ede"
-SRCREV_meta ?= "6d6037cc054350140df49c309e155f5a7b48f480"
+SRCREV_meta ?= "5a06598524482b43b9e502bf02c1f4fd5c2e598b"
 
 SRC_URI = 
"git://git.yoctoproject.org/linux-yocto-4.12.git;branch=${KBRANCH};name=machine 
\

git://git.yoctoproject.org/yocto-kernel-cache;type=kmeta;name=meta;branch=yocto-4.12;destsuffix=${KMETA}"
diff --git a/meta/recipes-kernel/linux/linux-yocto-rt_4.14.bb 
b/meta/recipes-kernel/linux/linux-yocto-rt_4.14.bb
index 7d2812fafe8f..fd003e4d2bec 100644
--- a/meta/recipes-kernel/linux/linux-yocto-rt_4.14.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-rt_4.14.bb
@@ -11,8 +11,8 @@ python () {
 raise bb.parse.SkipRecipe("Set PREFERRED_PROVIDER_virtual/kernel to 
linux-yocto-rt to enable it")
 }
 
-SRCREV_machine ?= "6c699ea6debe70c60d41d9df23f558ffea2de7cb"
-SRCREV_meta ?= "426c8aa4862f95e84ec163b942b92726d3ef978f"
+SRCREV_machine ?= "4832801a14130645d2251a368cba79d937a775ab"
+SRCREV_meta ?= "54b3e9b768651ca15bf65ae1c72dfe6d957285f0"
 
 SRC_URI = 
"git://git.yoctoproject.org/linux-yocto.git;branch=${KBRANCH};name=machine \

git://git.yoctoproject.org/yocto-kernel-cache;type=kmeta;name=meta;branch=yocto-4.14;destsuffix=${KMETA}"
diff --git a/meta/recipes-kernel/linux/linux-yocto-rt_4.15.bb 
b/meta/recipes-kernel/linux/linux-yocto-rt_4.15.bb
index a4dd17d1cb3a..38589927037d 100644
--- a/meta/recipes-kernel/linux/linux-yocto-rt_4.15.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-rt_4.15.bb
@@ -12,7 +12,7 @@ python () {
 }
 
 SRCREV_machine ?= "3247d5a26cab529bd4acc137c119bcdf71c3d5ae"
-SRCREV_meta ?= "03267fd15a97748105bfec2866820a8c1512fe70"
+SRCREV_meta ?= "40cef533a17de9d7a1de9b6e3578ac9125486a4a"
 
 SRC_URI = 
"git://git.yoctoproject.org/linux-yocto.git;branch=${KBRANCH};name=machine \

git://git.yoctoproject.org/yocto-kernel-cache;type=kmeta;name=meta;branch=yocto-4.15;destsuffix=${KMETA}"
diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_4.12.bb 
b/meta/recipes-kernel/linux/linux-yocto-tiny_4.12.bb
index 860b68cda6af..2ecb1cd70d49 100644
--- a/meta/recipes-kernel/linux/linux-yocto-tiny_4.12.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-tiny_4.12.bb
@@ -10,7 +10,7 @@ KMETA = "kernel-meta"
 KCONF_BSP_AUDIT_LEVEL = "2"
 
 SRCREV_machine ?= "073873cb152cf254d229d548c3bdcc57460a4ff0"
-SRCREV_meta ?= "6d6037cc054350140df49c309e155f5a7b48f480"
+SRCREV_meta ?= "5a06598524482b43b9e502bf02c1f4fd5c2e598b"
 
 PV = "${LINUX_VERSION}+git${SRCPV}"
 
diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb 
b/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
index ae9e7691367d..1ccbf6283e43 100644
--- a/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-tiny_4.14.bb
@@ -9,8 +9,8 @@ LINUX_VERSION ?= "4.14.24"
 KMETA = "kernel-meta"
 KCONF_BSP_AUDIT_LEVEL = "2"
 
-SRCREV_machine ?= "fccf7693fe5dd00d7b6d391b7405b5d58eb959f2"
-SRCREV_meta ?= "426c8aa4862f95e84ec163b942b92726d3ef978f"
+SRCREV_machine ?= "09828ddd8d8c91b2d68afdcd8eb99a48e0253582"
+SRCREV_meta ?= "54b3e9b768651ca15bf65ae1c72dfe6d957285f0"
 
 PV = "${LINUX_VERSION}+git${SRCPV}"
 
diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_4.15.bb 
b/meta/recipes-kernel/linux/linux-yocto-tiny_4.15.bb
index 858a318f3d7b..0c0abf38f286 100644
--- a/meta/recipes-kernel/linux/linux-yocto-tiny_4.15.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-tiny_4.15.bb
@@ -19,7 +19,7 @@ SRCREV_machine_qemux86 ?= 
"9c2e6c0fc71526c45fc7ddf3ec91e2e2f27e3da0"
 SRCREV_machine_qemux86-64 ?= "9c2e6c0fc71526c45fc7ddf3ec91e2e2f27e3da0"
 SRCREV_machine_qemumips64 ?= "f9a3a72209bde080e4ecb4fbe7a0f99954643131"
 SRCREV_machine ?= "3247d5a26cab529bd4acc137c119bcdf71c3d5ae"
-SRCREV_meta ?= "03267fd15a97748105bfec2866820a8c1512fe70"
+SRCREV_meta ?=