[OE-core] rust in SDK

2021-11-23 Thread Peter Bergin

Hi,

I'm looking for information about how mature and tested it is to have 
rust tools in the SDK. In README-rust.md [1] there is a phrase "Once the 
Rust SDK support is added to oe-core..." which can be read that it is 
not ready yet. In the first bullet "What works:" it states "-buildsdk 
and -crosssdk" which I can't connect to oe-core terms.


I have suceeded to add rust tools to a SDK by adding 
'TOOLCHAIN_HOST_TASK:append = " 
packagegroup-rust-cross-canadian-${MACHINE}"' to my config. With this I 
have succeeded to cross-compile the simplest hello-world example for 
aarch64. Is this the way to go or is there work to do (reffering to 
README info)?


Any information around rust and the status in oe-core are appreciated.

Thanks,
/Peter


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158655): 
https://lists.openembedded.org/g/openembedded-core/message/158655
Mute This Topic: https://lists.openembedded.org/mt/87277113/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCHv2] native/cross: Add ar wrapper for determinism

2021-11-23 Thread Jacob Kroon
Add a wrapper around ar calls for native/cross recipes. This wrapper adds
the -D option so that deterministic archives are built for native/cross
output. This improves the changes of hash equivalence matches and hence
build artefact reuse.

We don't need this in the target case since we compile binutils-cross
with an option making this the default. We need a wrapper since we need
to remove the "u" option and replace it with "D" but also allow things like
"--version" to continue to work too.

Signed-off-by: Jacob Kroon 
---

Changes in v2:
 * Don't modify arguments if 'U' is given, instead print a message to
   stderr that non-deterministic mode is requested

 meta/classes/cross.bbclass  |  2 ++
 scripts/cross-intercept/ar  |  1 +
 scripts/native-intercept/ar | 32 
 3 files changed, 35 insertions(+)
 create mode 12 scripts/cross-intercept/ar
 create mode 100755 scripts/native-intercept/ar

diff --git a/meta/classes/cross.bbclass b/meta/classes/cross.bbclass
index 3e6a2f60b9..9d951076a7 100644
--- a/meta/classes/cross.bbclass
+++ b/meta/classes/cross.bbclass
@@ -93,3 +93,5 @@ python do_addto_recipe_sysroot () {
 }
 addtask addto_recipe_sysroot after do_populate_sysroot
 do_addto_recipe_sysroot[deptask] = "do_populate_sysroot"
+
+PATH:prepend = "${COREBASE}/scripts/cross-intercept:"
diff --git a/scripts/cross-intercept/ar b/scripts/cross-intercept/ar
new file mode 12
index 00..bc68ffd7a2
--- /dev/null
+++ b/scripts/cross-intercept/ar
@@ -0,0 +1 @@
+../native-intercept/ar
\ No newline at end of file
diff --git a/scripts/native-intercept/ar b/scripts/native-intercept/ar
new file mode 100755
index 00..dcc623e3ed
--- /dev/null
+++ b/scripts/native-intercept/ar
@@ -0,0 +1,32 @@
+#!/usr/bin/env python3
+#
+# Wrapper around 'ar' that defaults to deterministic archives
+
+import os
+import shutil
+import sys
+
+# calculate path to the real 'ar'
+path = os.environ['PATH']
+path = path.replace(os.path.dirname(sys.argv[0]), '')
+real_ar = shutil.which('ar', path=path)
+
+if len(sys.argv) == 1:
+os.execl(real_ar, 'ar')
+
+# modify args to mimic 'ar' configured with --default-deterministic-archives
+argv = sys.argv
+if argv[1].startswith('--'):
+# No modifier given
+None
+else:
+# remove the optional '-'
+if argv[1][0] == '-':
+argv[1] = argv[1][1:]
+if 'U' in argv[1]:
+sys.stderr.write("ar: non-deterministic mode requested\n")
+else:
+argv[1] = argv[1].replace('u', '')
+argv[1] = 'D' + argv[1]
+
+os.execv(real_ar, argv)

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158654): 
https://lists.openembedded.org/g/openembedded-core/message/158654
Mute This Topic: https://lists.openembedded.org/mt/87275969/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 2/2] dnf: Backport bugfix for upgrade

2021-11-23 Thread Jate Sujjavanich
Meant to add a [dunfell] to the subject.

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158653): 
https://lists.openembedded.org/g/openembedded-core/message/158653
Mute This Topic: https://lists.openembedded.org/mt/87274566/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/2] libdnf: Backport bugfix for upgrade calc

2021-11-23 Thread Jate Sujjavanich
Meant to add a [dunfell] to the subject.

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158652): 
https://lists.openembedded.org/g/openembedded-core/message/158652
Mute This Topic: https://lists.openembedded.org/mt/87274565/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 2/2] dnf: Backport bugfix for upgrade

2021-11-23 Thread Jate Sujjavanich
Keep installed packages in upgrade job

This prevents duplicate identical packages from being reinstalled
with each upgrade

Signed-off-by: Jate Sujjavanich 
---
 ...ackages-in-upgrade-job-RhBug-1728252.patch | 60 +++
 meta/recipes-devtools/dnf/dnf_4.2.2.bbappend  |  3 +
 2 files changed, 63 insertions(+)
 create mode 100644 
meta/recipes-devtools/dnf/dnf/0040-Keep-installed-packages-in-upgrade-job-RhBug-1728252.patch
 create mode 100644 meta/recipes-devtools/dnf/dnf_4.2.2.bbappend

diff --git 
a/meta/recipes-devtools/dnf/dnf/0040-Keep-installed-packages-in-upgrade-job-RhBug-1728252.patch
 
b/meta/recipes-devtools/dnf/dnf/0040-Keep-installed-packages-in-upgrade-job-RhBug-1728252.patch
new file mode 100644
index 00..57c2375a54
--- /dev/null
+++ 
b/meta/recipes-devtools/dnf/dnf/0040-Keep-installed-packages-in-upgrade-job-RhBug-1728252.patch
@@ -0,0 +1,60 @@
+From c88a77198c0156e425c2725f30e481207de5162f Mon Sep 17 00:00:00 2001
+From: Jaroslav Mracek 
+Date: Tue, 3 Sep 2019 11:01:51 +0200
+Subject: [PATCH] Keep installed packages in upgrade job
+ (RhBug:1728252,1644241,1741381)
+
+In combination with marking of job as TARGETED it prevents from
+reinstalling of modified packages with same NEVRA.
+
+https://bugzilla.redhat.com/show_bug.cgi?id=1728252
+https://bugzilla.redhat.com/show_bug.cgi?id=1644241
+https://bugzilla.redhat.com/show_bug.cgi?id=1741381
+
+Closes: #1474
+Approved by: m-blaha
+
+
+Backport to fix bug in dnf in oe-core
+from https://github.com/rpm-software-management/dnf
+
+Removed spec file portion of patch
+
+Upstream-Status: Backport
+Signed-off-by: Jate Sujjavanich 
+---
+ dnf.spec  | 4 ++--
+ dnf/base.py   | 3 ---
+ dnf/module/module_base.py | 2 +-
+ 3 files changed, 3 insertions(+), 6 deletions(-)
+
+diff --git a/dnf/base.py b/dnf/base.py
+index b2ced61..628c154 100644
+--- a/dnf/base.py
 b/dnf/base.py
+@@ -1968,9 +1968,6 @@ class Base(object):
+ obsoletes=q.installed().union(q.upgrades()))
+ # add obsoletes into transaction
+ q = q.union(obsoletes)
+-# provide only available packages to solver otherwise selection of 
available
+-# possibilities will be ignored
+-q = q.available()
+ if reponame is not None:
+ q.filterm(reponame=reponame)
+ q = self._merge_update_filters(q, pkg_spec=pkg_spec)
+diff --git a/dnf/module/module_base.py b/dnf/module/module_base.py
+index 976d730..ce70f63 100644
+--- a/dnf/module/module_base.py
 b/dnf/module/module_base.py
+@@ -214,7 +214,7 @@ class ModuleBase(object):
+ 
+ if not upgrade_package_set:
+ logger.error(_("Unable to match profile in argument 
{}").format(spec))
+-query = 
self.base.sack.query().available().filterm(name=upgrade_package_set)
++query = self.base.sack.query().filterm(name=upgrade_package_set)
+ if query:
+ sltr = dnf.selector.Selector(self.base.sack)
+ sltr.set(pkg=query)
+-- 
+2.7.4
+
diff --git a/meta/recipes-devtools/dnf/dnf_4.2.2.bbappend 
b/meta/recipes-devtools/dnf/dnf_4.2.2.bbappend
new file mode 100644
index 00..3811db604b
--- /dev/null
+++ b/meta/recipes-devtools/dnf/dnf_4.2.2.bbappend
@@ -0,0 +1,3 @@
+FILESEXTRAPATHS_prepend := "${THISDIR}/${PN}:"
+
+SRC_URI += 
"file://0040-Keep-installed-packages-in-upgrade-job-RhBug-1728252.patch"
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158651): 
https://lists.openembedded.org/g/openembedded-core/message/158651
Mute This Topic: https://lists.openembedded.org/mt/87274566/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 1/2] libdnf: Backport bugfix for upgrade calc

2021-11-23 Thread Jate Sujjavanich
Mark goal.upgrade with sltr as targeted

This allows a bugfix in dnf to work

Signed-off-by: Jate Sujjavanich 
---
 ...job-goal.upgrade-with-sltr-as-target.patch | 58 +++
 .../libdnf/libdnf_0.28.1.bbappend |  3 +
 2 files changed, 61 insertions(+)
 create mode 100644 
meta/recipes-devtools/libdnf/libdnf/0040-Mark-job-goal.upgrade-with-sltr-as-target.patch
 create mode 100644 meta/recipes-devtools/libdnf/libdnf_0.28.1.bbappend

diff --git 
a/meta/recipes-devtools/libdnf/libdnf/0040-Mark-job-goal.upgrade-with-sltr-as-target.patch
 
b/meta/recipes-devtools/libdnf/libdnf/0040-Mark-job-goal.upgrade-with-sltr-as-target.patch
new file mode 100644
index 00..61d255581b
--- /dev/null
+++ 
b/meta/recipes-devtools/libdnf/libdnf/0040-Mark-job-goal.upgrade-with-sltr-as-target.patch
@@ -0,0 +1,58 @@
+From b4c5a3312287f31a2075a235db846ff611586d2c Mon Sep 17 00:00:00 2001
+From: Jaroslav Mracek 
+Date: Tue, 3 Sep 2019 11:01:23 +0200
+Subject: [PATCH] Mark job goal.upgrade with sltr as targeted
+
+It allows to keep installed packages in upgrade set.
+
+It also prevents from reinstalling of modified packages with same NEVRA.
+
+
+Backport commit b4c5a3312287f31a2075a235db846ff611586d2c from
+https://github.com/rpm-software-management/libdnf
+
+This bug is present in oe-core's dnf
+
+Remove changes to spec file from upstream
+
+Upstream-Status: Backport
+Signed-off-by: Jate Sujjavanich 
+---
+ libdnf.spec  | 4 ++--
+ libdnf/goal/Goal.cpp | 2 +-
+ libdnf/goal/Goal.hpp | 6 --
+ 3 files changed, 7 insertions(+), 5 deletions(-)
+
+diff --git a/libdnf/goal/Goal.cpp b/libdnf/goal/Goal.cpp
+index b69be19..a38cbb4 100644
+--- a/libdnf/goal/Goal.cpp
 b/libdnf/goal/Goal.cpp
+@@ -767,7 +767,7 @@ void
+ Goal::upgrade(HySelector sltr)
+ {
+ pImpl->actions = static_cast(pImpl->actions | 
DNF_UPGRADE);
+-sltrToJob(sltr, >staging, SOLVER_UPDATE);
++sltrToJob(sltr, >staging, SOLVER_UPDATE|SOLVER_TARGETED);
+ }
+ 
+ void
+diff --git a/libdnf/goal/Goal.hpp b/libdnf/goal/Goal.hpp
+index f33dfa2..d701317 100644
+--- a/libdnf/goal/Goal.hpp
 b/libdnf/goal/Goal.hpp
+@@ -86,8 +86,10 @@ public:
+ /**
+ * @brief If selector ill formed, it rises std::runtime_error()
+ *
+-* @param sltr p_sltr: It should contain only upgrades with obsoletes 
otherwise it can try to
+-* reinstall installonly packages.
++* @param sltr p_sltr: It contains upgrade-to packages and obsoletes. The 
presence of installed
++* packages prevents reinstalling packages with the same NEVRA but changed 
contant. To honor repo
++* priority all relevant packages must be present. To upgrade package foo 
from priority repo, all
++* installed and available packages of the foo must be in selector plus 
obsoletes of foo.
+ */
+ void upgrade(HySelector sltr);
+ void userInstalled(DnfPackage *pkg);
+-- 
+2.7.4
+
diff --git a/meta/recipes-devtools/libdnf/libdnf_0.28.1.bbappend 
b/meta/recipes-devtools/libdnf/libdnf_0.28.1.bbappend
new file mode 100644
index 00..569a77496d
--- /dev/null
+++ b/meta/recipes-devtools/libdnf/libdnf_0.28.1.bbappend
@@ -0,0 +1,3 @@
+FILESEXTRAPATHS_prepend := "${THISDIR}/${PN}:"
+
+SRC_URI += "file://0040-Mark-job-goal.upgrade-with-sltr-as-target.patch"
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158650): 
https://lists.openembedded.org/g/openembedded-core/message/158650
Mute This Topic: https://lists.openembedded.org/mt/87274565/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH v3] image: Include psplash only when screen machine feature is enabled

2021-11-23 Thread Khem Raj
base-image boots in degraded mode when using systems without display
system since there is no fb device detected and pslash service would
fail to start. Removing this image feature means that core-image-base is
complete for headless devices

Signed-off-by: Khem Raj 
---
v3: Remove a typo '0'

 meta/classes/image.bbclass | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/classes/image.bbclass b/meta/classes/image.bbclass
index 6c759fdf700..8a46b4852cd 100644
--- a/meta/classes/image.bbclass
+++ b/meta/classes/image.bbclass
@@ -53,7 +53,7 @@ FEATURE_INSTALL_OPTIONAL[vardepvalue] = 
"${FEATURE_INSTALL_OPTIONAL}"
 
 # Define some very basic feature package groups
 FEATURE_PACKAGES_package-management = "${ROOTFS_PKGMANAGE}"
-SPLASH ?= "psplash"
+SPLASH ?= "${@bb.utils.contains("MACHINE_FEATURES", "screen", "psplash", "", 
d)}"
 FEATURE_PACKAGES_splash = "${SPLASH}"
 
 IMAGE_INSTALL_COMPLEMENTARY = '${@complementary_globs("IMAGE_FEATURES", d)}'
-- 
2.34.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158649): 
https://lists.openembedded.org/g/openembedded-core/message/158649
Mute This Topic: https://lists.openembedded.org/mt/87272713/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 00/20] kernel/kernel-yocto: consolidated pull request

2021-11-23 Thread Bruce Ashfield
On Tue, Nov 23, 2021 at 6:59 PM Khem Raj  wrote:
>
> dont forget to send removal patch for meta-python once they are in core.

Definitely!

This may take a while to sort out, but I have one ready and will send
when required.

Bruce

>
> On Tue, Nov 23, 2021 at 1:57 PM Bruce Ashfield  
> wrote:
> >
> > From: Bruce Ashfield 
> >
> > Richard,
> >
> > There's a few routine -stable updates at the start of this, and then some
> > more painful (and RFC) commits.
> >
> > As part of this series, we fix one pkg-config issue that was preventing
> > x86 from doing stack valildation during build. At one point it was
> > increasing my build times signficantly, but that seems to have gone
> > away now. If we see something like this on the AB, we'll have to keep
> > the fix, but disable it by default.
> >
> > The next big chunk of changes are the ones we talked about during the
> > tech call today. The 5.16 kernel has introduced mandatory dtschema
> > checking for device trees built through the kernel.
> >
> > That checking pulls in a reasonably large amount of dependencies to
> > the kernel build: libyaml, dtschema, jsonschema, etc.
> >
> > We weren't able to even run the validation at all, due to the kernel
> > calling pkg-config directly to check for libyaml, which is the target
> > pkgconfig and failing on missing dependencies. Rather than patching
> > the kernel, I've finally given in and made the do_compile task set
> > the PKG_CONFIG variables to point to our native-sysroot. Since the
> > kenrel doesn't use pkgconfig for target decisions, and has quite
> > a few calls directly to pkgconfig, this is the best short term way
> > to get all those checks working.
> >
> > Once we are past yaml, we need to create the dtschema recipe, and
> > bring in the dependencies from meta-python. I've put myself down as
> > the maintainer for all the new recipes, but otherwise, I haven't
> > changed or modified them.
> >
> > BUT! there are scenarios where a non-conformant dts file is being
> > built, or we just don't want those dependencies in the built. To
> > work around that, I took the suggestion from this morning and
> > created a python3-dtschema-wrappers recipe. It contains three
> > scripts of the same name as the ones from the real package. When
> > put in the dependency for a kernel build, it can pass the dtschema
> > steps.
> >
> > Finally, I created a reference PACKAGECONFIG for linux-yocto-dev
> > to enable/disable the main package and wrappers (the wrappers are
> > used by default). I haven't put this into kernel.bbclass yet, since
> > it is version specific, and it needs to soak for a bit. But if
> > there's demand, it is something that can be moved to kernel.bclass
> > (along with a few other version specific dependencies).
> >
> > Note: I haven't done an AB run with these yet, so I could be
> > missing some python dependencies, etc, but I wanted to get this
> > out to the list in case others are running into this with
> > v5.16+.
> >
> > Cheers,
> >
> > Bruce
> >
> >
> > The following changes since commit 60409917ea3e7353f5b7ee831fe4ffaff0957d94:
> >
> >   glibc-tests: Do not set SYSTEMD_SERVICE (2021-11-23 14:04:02 +)
> >
> > are available in the Git repository at:
> >
> >   git://git.yoctoproject.org/poky-contrib zedd/kernel
> >   http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=zedd/kernel
> >
> > Bruce Ashfield (18):
> >   linux-yocto/5.15: update to v5.15.2
> >   linux-yocto/5.14: update to v5.14.18
> >   linux-yocto/5.10: update to v5.10.79
> >   kernel-yocto: conditionally enable stack protection checking on x86-64
> >   linux-yocto-dev: bump to v5.16+
> >   kernel: export native PKGCONFIG variables
> >   python: introduce python3-dtschema
> >   python: import jsonpointer from meta-python
> >   python: import jsonschema from meta-python
> >   python: import idna from meta-python
> >   python: import rfc3339-validator from meta-python
> >   python: import rfc3986-validator from meta-python
> >   python: import webcolors from meta-python
> >   python: import ruamel-yaml from meta-python
> >   maintainers: update for kernel dtschema checking dependencies
> >   linux-yocto: export pkgconfig variables to devshell
> >   kernel: introduce python3-dtschema-wrapper
> >   linux-yocto-dev: introduce dt-validation PACKAGECONFIG
> >
> > Max Krummenacher (2):
> >   perf: sort-pmuevents: don't drop elements
> >   perf: sort-pmuevents: allow for additional type qualifiers and storage
> > class
> >
> >  meta/classes/kernel.bbclass   |  7 +++
> >  meta/conf/distro/include/maintainers.inc  |  9 
> >  ...e-pytest-runner-to-test_requirements.patch | 32 +
> >  .../python/python3-dtschema_2021.10.bb| 15 ++
> >  .../python/python3-idna_3.3.bb| 19 
> >  .../python/python3-jsonpointer/run-ptest  |  3 ++
> >  .../python/python3-jsonpointer_2.1.bb | 26 ++
> >  .../python/python3-jsonschema_3.2.0.bb| 48 +++

Re: [OE-core] [PATCH 00/20] kernel/kernel-yocto: consolidated pull request

2021-11-23 Thread Khem Raj
dont forget to send removal patch for meta-python once they are in core.

On Tue, Nov 23, 2021 at 1:57 PM Bruce Ashfield  wrote:
>
> From: Bruce Ashfield 
>
> Richard,
>
> There's a few routine -stable updates at the start of this, and then some
> more painful (and RFC) commits.
>
> As part of this series, we fix one pkg-config issue that was preventing
> x86 from doing stack valildation during build. At one point it was
> increasing my build times signficantly, but that seems to have gone
> away now. If we see something like this on the AB, we'll have to keep
> the fix, but disable it by default.
>
> The next big chunk of changes are the ones we talked about during the
> tech call today. The 5.16 kernel has introduced mandatory dtschema
> checking for device trees built through the kernel.
>
> That checking pulls in a reasonably large amount of dependencies to
> the kernel build: libyaml, dtschema, jsonschema, etc.
>
> We weren't able to even run the validation at all, due to the kernel
> calling pkg-config directly to check for libyaml, which is the target
> pkgconfig and failing on missing dependencies. Rather than patching
> the kernel, I've finally given in and made the do_compile task set
> the PKG_CONFIG variables to point to our native-sysroot. Since the
> kenrel doesn't use pkgconfig for target decisions, and has quite
> a few calls directly to pkgconfig, this is the best short term way
> to get all those checks working.
>
> Once we are past yaml, we need to create the dtschema recipe, and
> bring in the dependencies from meta-python. I've put myself down as
> the maintainer for all the new recipes, but otherwise, I haven't
> changed or modified them.
>
> BUT! there are scenarios where a non-conformant dts file is being
> built, or we just don't want those dependencies in the built. To
> work around that, I took the suggestion from this morning and
> created a python3-dtschema-wrappers recipe. It contains three
> scripts of the same name as the ones from the real package. When
> put in the dependency for a kernel build, it can pass the dtschema
> steps.
>
> Finally, I created a reference PACKAGECONFIG for linux-yocto-dev
> to enable/disable the main package and wrappers (the wrappers are
> used by default). I haven't put this into kernel.bbclass yet, since
> it is version specific, and it needs to soak for a bit. But if
> there's demand, it is something that can be moved to kernel.bclass
> (along with a few other version specific dependencies).
>
> Note: I haven't done an AB run with these yet, so I could be
> missing some python dependencies, etc, but I wanted to get this
> out to the list in case others are running into this with
> v5.16+.
>
> Cheers,
>
> Bruce
>
>
> The following changes since commit 60409917ea3e7353f5b7ee831fe4ffaff0957d94:
>
>   glibc-tests: Do not set SYSTEMD_SERVICE (2021-11-23 14:04:02 +)
>
> are available in the Git repository at:
>
>   git://git.yoctoproject.org/poky-contrib zedd/kernel
>   http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=zedd/kernel
>
> Bruce Ashfield (18):
>   linux-yocto/5.15: update to v5.15.2
>   linux-yocto/5.14: update to v5.14.18
>   linux-yocto/5.10: update to v5.10.79
>   kernel-yocto: conditionally enable stack protection checking on x86-64
>   linux-yocto-dev: bump to v5.16+
>   kernel: export native PKGCONFIG variables
>   python: introduce python3-dtschema
>   python: import jsonpointer from meta-python
>   python: import jsonschema from meta-python
>   python: import idna from meta-python
>   python: import rfc3339-validator from meta-python
>   python: import rfc3986-validator from meta-python
>   python: import webcolors from meta-python
>   python: import ruamel-yaml from meta-python
>   maintainers: update for kernel dtschema checking dependencies
>   linux-yocto: export pkgconfig variables to devshell
>   kernel: introduce python3-dtschema-wrapper
>   linux-yocto-dev: introduce dt-validation PACKAGECONFIG
>
> Max Krummenacher (2):
>   perf: sort-pmuevents: don't drop elements
>   perf: sort-pmuevents: allow for additional type qualifiers and storage
> class
>
>  meta/classes/kernel.bbclass   |  7 +++
>  meta/conf/distro/include/maintainers.inc  |  9 
>  ...e-pytest-runner-to-test_requirements.patch | 32 +
>  .../python/python3-dtschema_2021.10.bb| 15 ++
>  .../python/python3-idna_3.3.bb| 19 
>  .../python/python3-jsonpointer/run-ptest  |  3 ++
>  .../python/python3-jsonpointer_2.1.bb | 26 ++
>  .../python/python3-jsonschema_3.2.0.bb| 48 +++
>  .../python/python3-rfc3339-validator_0.1.4.bb | 20 
>  .../python/python3-rfc3986-validator_0.1.1.bb | 23 +
>  .../python/python3-ruamel-yaml_0.17.16.bb | 23 +
>  .../python/python3-webcolors/run-ptest|  3 ++
>  .../python/python3-webcolors_1.11.1.bb| 27 +++
>  .../python3-dtschema-wrapper/dt-doc-validate  | 20 

Re: [OE-core] [PATCH] native/cross: Add ar wrapper for determinism

2021-11-23 Thread Jacob Kroon
On 11/24/21 00:06, Richard Purdie wrote:
> On Tue, 2021-11-23 at 21:22 +0100, Jacob Kroon wrote:
>>
>> On 11/23/21 15:12, Richard Purdie wrote:
>>> From: Jacob Kroon 
>>>
>>> Add a wrapper around ar calls for native/cross recipes. This wrapper adds
>>> the -D option so that deterministic archives are built for native/cross
>>> output. This improves the changes of hash equivalence matches and hence
>>> build artefact reuse.
>>>
>>> We don't need this in the target case since we compile binutils-cross
>>> with an option making this the default. We need a wrapper since we need
>>> to remove the "u" option and replace it with "D" but also allow things like
>>> "--version" to continue to work too.
>>>
>>> Signed-off-by: Jacob Kroon 
>>> Signed-off-by: Richard Purdie 
>>> ---
>>>  meta/classes/cross.bbclass  |  2 ++
>>>  scripts/cross-intercept/ar  |  1 +
>>>  scripts/native-intercept/ar | 29 +
>>>  3 files changed, 32 insertions(+)
>>>  create mode 12 scripts/cross-intercept/ar
>>>  create mode 100755 scripts/native-intercept/ar
>>>
>>> diff --git a/meta/classes/cross.bbclass b/meta/classes/cross.bbclass
>>> index 3e6a2f60b9e..9d951076a78 100644
>>> --- a/meta/classes/cross.bbclass
>>> +++ b/meta/classes/cross.bbclass
>>> @@ -93,3 +93,5 @@ python do_addto_recipe_sysroot () {
>>>  }
>>>  addtask addto_recipe_sysroot after do_populate_sysroot
>>>  do_addto_recipe_sysroot[deptask] = "do_populate_sysroot"
>>> +
>>> +PATH:prepend = "${COREBASE}/scripts/cross-intercept:"
>>> diff --git a/scripts/cross-intercept/ar b/scripts/cross-intercept/ar
>>> new file mode 12
>>> index 000..bc68ffd7a21
>>> --- /dev/null
>>> +++ b/scripts/cross-intercept/ar
>>> @@ -0,0 +1 @@
>>> +../native-intercept/ar
>>> \ No newline at end of file
>>> diff --git a/scripts/native-intercept/ar b/scripts/native-intercept/ar
>>> new file mode 100755
>>> index 000..642b6eae864
>>> --- /dev/null
>>> +++ b/scripts/native-intercept/ar
>>> @@ -0,0 +1,29 @@
>>> +#!/usr/bin/env python3
>>> +#
>>> +# Wrapper around 'ar' that defaults to deterministic archives
>>> +
>>> +import os
>>> +import shutil
>>> +import sys
>>> +
>>> +# calculate path to the real 'ar'
>>> +path = os.environ['PATH']
>>> +path = path.replace(os.path.dirname(sys.argv[0]), '')
>>> +real_ar = shutil.which('ar', path=path)
>>> +
>>> +if len(sys.argv) == 1:
>>> +os.execl(real_ar, 'ar')
>>> +
>>> +# modify args to mimic 'ar' configured with 
>>> --default-deterministic-archives
>>> +argv = sys.argv
>>> +if argv[1].startswith('--'):
>>> +# No modifier given
>>> +None
>>> +else:
>>> +# remove the optional '-'
>>> +if argv[1][0] == '-':
>>> +argv[1] = argv[1][1:]
>>> +argv[1] = argv[1].replace('u', '')
>>> +argv[1] = 'D' + argv[1]
>>> +
>>> +os.execv(real_ar, argv)
>>>
>>
>> What should we do if the user is explicitly passing U, "Do not operate
>> in deterministic mode." ? Don't replace any 'u' and don't pass D ?
> 
> That would seem to make sense to me...
> 

Could we log a warning somewhere when this is done ? I can't write to
stdout here, but stderr perhaps ?

Jacob

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158646): 
https://lists.openembedded.org/g/openembedded-core/message/158646
Mute This Topic: https://lists.openembedded.org/mt/87259014/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] native/cross: Add ar wrapper for determinism

2021-11-23 Thread Richard Purdie
On Tue, 2021-11-23 at 21:22 +0100, Jacob Kroon wrote:
> 
> On 11/23/21 15:12, Richard Purdie wrote:
> > From: Jacob Kroon 
> > 
> > Add a wrapper around ar calls for native/cross recipes. This wrapper adds
> > the -D option so that deterministic archives are built for native/cross
> > output. This improves the changes of hash equivalence matches and hence
> > build artefact reuse.
> > 
> > We don't need this in the target case since we compile binutils-cross
> > with an option making this the default. We need a wrapper since we need
> > to remove the "u" option and replace it with "D" but also allow things like
> > "--version" to continue to work too.
> > 
> > Signed-off-by: Jacob Kroon 
> > Signed-off-by: Richard Purdie 
> > ---
> >  meta/classes/cross.bbclass  |  2 ++
> >  scripts/cross-intercept/ar  |  1 +
> >  scripts/native-intercept/ar | 29 +
> >  3 files changed, 32 insertions(+)
> >  create mode 12 scripts/cross-intercept/ar
> >  create mode 100755 scripts/native-intercept/ar
> > 
> > diff --git a/meta/classes/cross.bbclass b/meta/classes/cross.bbclass
> > index 3e6a2f60b9e..9d951076a78 100644
> > --- a/meta/classes/cross.bbclass
> > +++ b/meta/classes/cross.bbclass
> > @@ -93,3 +93,5 @@ python do_addto_recipe_sysroot () {
> >  }
> >  addtask addto_recipe_sysroot after do_populate_sysroot
> >  do_addto_recipe_sysroot[deptask] = "do_populate_sysroot"
> > +
> > +PATH:prepend = "${COREBASE}/scripts/cross-intercept:"
> > diff --git a/scripts/cross-intercept/ar b/scripts/cross-intercept/ar
> > new file mode 12
> > index 000..bc68ffd7a21
> > --- /dev/null
> > +++ b/scripts/cross-intercept/ar
> > @@ -0,0 +1 @@
> > +../native-intercept/ar
> > \ No newline at end of file
> > diff --git a/scripts/native-intercept/ar b/scripts/native-intercept/ar
> > new file mode 100755
> > index 000..642b6eae864
> > --- /dev/null
> > +++ b/scripts/native-intercept/ar
> > @@ -0,0 +1,29 @@
> > +#!/usr/bin/env python3
> > +#
> > +# Wrapper around 'ar' that defaults to deterministic archives
> > +
> > +import os
> > +import shutil
> > +import sys
> > +
> > +# calculate path to the real 'ar'
> > +path = os.environ['PATH']
> > +path = path.replace(os.path.dirname(sys.argv[0]), '')
> > +real_ar = shutil.which('ar', path=path)
> > +
> > +if len(sys.argv) == 1:
> > +os.execl(real_ar, 'ar')
> > +
> > +# modify args to mimic 'ar' configured with 
> > --default-deterministic-archives
> > +argv = sys.argv
> > +if argv[1].startswith('--'):
> > +# No modifier given
> > +None
> > +else:
> > +# remove the optional '-'
> > +if argv[1][0] == '-':
> > +argv[1] = argv[1][1:]
> > +argv[1] = argv[1].replace('u', '')
> > +argv[1] = 'D' + argv[1]
> > +
> > +os.execv(real_ar, argv)
> > 
> 
> What should we do if the user is explicitly passing U, "Do not operate
> in deterministic mode." ? Don't replace any 'u' and don't pass D ?

That would seem to make sense to me...

Cheers,

Richard


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158645): 
https://lists.openembedded.org/g/openembedded-core/message/158645
Mute This Topic: https://lists.openembedded.org/mt/87259014/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCHv3] waffle: add explicit dependency to cmake-native

2021-11-23 Thread Richard Purdie
On Tue, 2021-11-23 at 12:00 -0600, Anibal Limon wrote:
> Hi,
> 
> Is this patch good enough? or need another change.

There was feedback about the commit message needing work. Someone else also sent
a similar patch with a commit message with the right explanation in it so that
was merged in preference but the issue should be fixed.

http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=50e0aed0684526c74072ceaf8fa52964c9cc0d19

Cheers,

Richard


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158644): 
https://lists.openembedded.org/g/openembedded-core/message/158644
Mute This Topic: https://lists.openembedded.org/mt/87073490/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] meson: drop redundant patch

2021-11-23 Thread Richard Purdie
On Tue, 2021-11-23 at 19:38 +, Ross Burton wrote:
> This patch disables the debian-detection to use the correct $libdir by
> default on that platform.  However in cross builds this is always
> overridden to be $prefix/lib, and all recipes that inherit meson pass
> the correct libdir explicitly.
> 
> Signed-off-by: Ross Burton 
> ---
>  meta/recipes-devtools/meson/meson.inc |  1 -
>  ...01-is_debianlike-always-return-False.patch | 26 ---
>  2 files changed, 27 deletions(-)
>  delete mode 100644 
> meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch

We build native things which are meson based. Do we want native tool libdir
paths depending on the existence of /etc/debian_version ? It was some reason
like that this was added as we found it doing 'fun' changes depending on the
host. Not sure I really want to debug that again...

Cheers,

Richard




-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158643): 
https://lists.openembedded.org/g/openembedded-core/message/158643
Mute This Topic: https://lists.openembedded.org/mt/87266402/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] gdb-common: Add --with-liblzma-prefix in xz PACKAGECONFIG.

2021-11-23 Thread Jim Wilson
On Tue, Nov 16, 2021 at 9:59 AM Khem Raj  wrote:

> yes, this patch is fine in itself.
>

Thanks.  I see that the patch got applied last week.

Jim

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158642): 
https://lists.openembedded.org/g/openembedded-core/message/158642
Mute This Topic: https://lists.openembedded.org/mt/87085648/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 20/20] perf: sort-pmuevents: allow for additional type qualifiers and storage class

2021-11-23 Thread Bruce Ashfield
From: Max Krummenacher 

With kernel 5.16 some structs in pmu-events do get a const qualifier, some
a static const storage class and qualifier.

The current sort-pmuevents cannot cope with that and drops all struct
arrays with such additional elements. This then leads to compiler errors.

Allow '^struct', '^const struct', '^static struct', '^static const struct'.

Signed-off-by: Max Krummenacher 
Signed-off-by: Bruce Ashfield 
---
 .../perf/perf/sort-pmuevents.py   | 30 ++-
 1 file changed, 16 insertions(+), 14 deletions(-)

diff --git a/meta/recipes-kernel/perf/perf/sort-pmuevents.py 
b/meta/recipes-kernel/perf/perf/sort-pmuevents.py
index 4f841eb822..09ba3328a7 100755
--- a/meta/recipes-kernel/perf/perf/sort-pmuevents.py
+++ b/meta/recipes-kernel/perf/perf/sort-pmuevents.py
@@ -33,10 +33,10 @@ if os.path.exists(outfile):
 with open(infile, 'r') as file:
 data = file.read()
 
-preamble_regex = re.compile( '^(.*?)^struct', re.MULTILINE | re.DOTALL )
+preamble_regex = re.compile( '^(.*?)^(struct|const struct|static struct|static 
const struct)', re.MULTILINE | re.DOTALL )
 
 preamble = re.search( preamble_regex, data )
-struct_block_regex = re.compile( '^struct.*?(\w+) (.*?)\[\] = {(.*?)^};', 
re.MULTILINE | re.DOTALL )
+struct_block_regex = re.compile( '^(struct|const struct|static struct|static 
const struct).*?(\w+) (.*?)\[\] = {(.*?)^};', re.MULTILINE | re.DOTALL )
 field_regex =  re.compile( '{.*?},', re.MULTILINE | re.DOTALL )
 cpuid_regex = re.compile( '\.cpuid = (.*?),', re.MULTILINE | re.DOTALL )
 name_regex = re.compile( '\.name = (.*?),', re.MULTILINE | re.DOTALL )
@@ -45,24 +45,25 @@ name_regex = re.compile( '\.name = (.*?),', re.MULTILINE | 
re.DOTALL )
 # types and then their fields.
 entry_dict = {}
 for struct in re.findall( struct_block_regex, data ):
-# print( "struct: %s %s" % (struct[0],struct[1]) )
-entry_dict[struct[1]] = {}
-entry_dict[struct[1]]['type'] = struct[0]
-entry_dict[struct[1]]['fields'] = {}
-for entry in re.findall( field_regex, struct[2] ):
+# print( "struct: %s %s %s" % (struct[0],struct[1],struct[2]) )
+entry_dict[struct[2]] = {}
+entry_dict[struct[2]]['type_prefix'] = struct[0]
+entry_dict[struct[2]]['type'] = struct[1]
+entry_dict[struct[2]]['fields'] = {}
+for entry in re.findall( field_regex, struct[3] ):
 #print( "entry: %s" % entry )
 cpuid = re.search( cpuid_regex, entry )
 if cpuid:
 #print( "cpuid found: %s" % cpuid.group(1) )
-entry_dict[struct[1]]['fields'][cpuid.group(1)] = entry
-
+entry_dict[struct[2]]['fields'][cpuid.group(1)] = entry
+
 name = re.search( name_regex, entry )
 if name:
 #print( "name found: %s" % name.group(1) )
-entry_dict[struct[1]]['fields'][name.group(1)] = entry
-
-if not entry_dict[struct[1]]['fields']:
-entry_dict[struct[1]]['fields']['0'] = entry
+entry_dict[struct[2]]['fields'][name.group(1)] = entry
+
+if not entry_dict[struct[2]]['fields']:
+entry_dict[struct[2]]['fields']['0'] = entry
 
 # created ordered dictionaries from the captured values. These are ordered by
 # a sorted() iteration of the keys. We don't care about the order we read
@@ -74,6 +75,7 @@ for struct in re.findall( struct_block_regex, data ):
 entry_dict_sorted = OrderedDict()
 for i in sorted(entry_dict.keys()):
 entry_dict_sorted[i] = {}
+entry_dict_sorted[i]['type_prefix'] = entry_dict[i]['type_prefix']
 entry_dict_sorted[i]['type'] = entry_dict[i]['type']
 entry_dict_sorted[i]['fields'] = {}
 for f in sorted(entry_dict[i]['fields'].keys()):
@@ -85,7 +87,7 @@ outf = open( outfile, 'w' )
 print( preamble.group(1) )
 outf.write( preamble.group(1) )
 for d in entry_dict_sorted:
-outf.write( "struct %s %s[] = {\n" % (entry_dict_sorted[d]['type'],d) )
+outf.write( "%s %s %s[] = {\n" % (entry_dict_sorted[d]['type_prefix'], 
entry_dict_sorted[d]['type'],d) )
 for f in entry_dict_sorted[d]['fields']:
 outf.write( entry_dict_sorted[d]['fields'][f] + '\n' )
 
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158641): 
https://lists.openembedded.org/g/openembedded-core/message/158641
Mute This Topic: https://lists.openembedded.org/mt/87269405/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 19/20] perf: sort-pmuevents: don't drop elements

2021-11-23 Thread Bruce Ashfield
From: Max Krummenacher 

If a struct element neither has an element cpuid or name it gets silenty
dropped.
Kernel 5.15 for some ARCHs have at least one array of structs matching
this.
e.g. for arm pmu-events.c:

|#include "pmu-events/pmu-events.h"
struct pmu_events_map pmu_events_map[] = {
{
.cpuid = 0,
.version = 0,
.type = 0,
.table = 0,
},
};

struct pmu_sys_events pmu_sys_event_tables[] = {
{
.table = 0
},
};

Before this patch the second struct is translated to an empty array::

struct pmu_sys_events pmu_sys_event_tables[] = {
};

Signed-off-by: Max Krummenacher 
Signed-off-by: Bruce Ashfield 
---
 meta/recipes-kernel/perf/perf/sort-pmuevents.py | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/meta/recipes-kernel/perf/perf/sort-pmuevents.py 
b/meta/recipes-kernel/perf/perf/sort-pmuevents.py
index 5ddf0f144f..4f841eb822 100755
--- a/meta/recipes-kernel/perf/perf/sort-pmuevents.py
+++ b/meta/recipes-kernel/perf/perf/sort-pmuevents.py
@@ -61,6 +61,8 @@ for struct in re.findall( struct_block_regex, data ):
 #print( "name found: %s" % name.group(1) )
 entry_dict[struct[1]]['fields'][name.group(1)] = entry
 
+if not entry_dict[struct[1]]['fields']:
+entry_dict[struct[1]]['fields']['0'] = entry
 
 # created ordered dictionaries from the captured values. These are ordered by
 # a sorted() iteration of the keys. We don't care about the order we read
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158640): 
https://lists.openembedded.org/g/openembedded-core/message/158640
Mute This Topic: https://lists.openembedded.org/mt/87269404/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 18/20] linux-yocto-dev: introduce dt-validation PACKAGECONFIG

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Add a PACKAGECONFIG to control which type of dt-validation
is installed (full, or wrapped).

This is currently in linux-yocto-dev, as 5.16 introduces
the functionality of required dt schema validation.

Other v5.16 providing recipes can use the base functionality
as they desire (with or without PACKAGECONFIG).

Over time, we can migrate the support the the core
kernel classes .. in particular when more providers are at
v5.16+

Signed-off-by: Bruce Ashfield 
---
 meta/recipes-kernel/linux/linux-yocto-dev.bb | 10 --
 1 file changed, 8 insertions(+), 2 deletions(-)

diff --git a/meta/recipes-kernel/linux/linux-yocto-dev.bb 
b/meta/recipes-kernel/linux/linux-yocto-dev.bb
index ed94ab2517..858772ba41 100644
--- a/meta/recipes-kernel/linux/linux-yocto-dev.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-dev.bb
@@ -39,8 +39,14 @@ LIC_FILES_CHKSUM = 
"file://COPYING;md5=6bc538ed5bd9a7fc9398086aedcd7e46"
 DEPENDS += "${@bb.utils.contains('ARCH', 'x86', 'elfutils-native', '', d)}"
 DEPENDS += "openssl-native util-linux-native"
 DEPENDS += "gmp-native libmpc-native"
-# yaml and dtschema are required for 5.16+ device tree validation
-DEPENDS += "libyaml-native python3-dtschema-native"
+
+# yaml and dtschema are required for 5.16+ device tree validation, libyaml is 
checked
+# via pkgconfig, so must always be present, but we can wrap the others to make 
them
+# conditional
+DEPENDS += "libyaml-native"
+
+PACKAGECONFIG ??= ""
+DEPENDS += "${@bb.utils.contains('PACKAGECONFIG', 'dt-validation', 
'python3-dtschema-native', 'python3-dtschema-wrapper-native', d)}"
 
 COMPATIBLE_MACHINE = 
"(qemuarm|qemux86|qemuppc|qemumips|qemumips64|qemux86-64|qemuriscv64)"
 
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158639): 
https://lists.openembedded.org/g/openembedded-core/message/158639
Mute This Topic: https://lists.openembedded.org/mt/87269403/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 15/20] maintainers: update for kernel dtschema checking dependencies

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

These packages are required for dtschema checking in the
kernel build. Adding myself as the maintainer.

Signed-off-by: Bruce Ashfield 
---
 meta/conf/distro/include/maintainers.inc | 8 
 1 file changed, 8 insertions(+)

diff --git a/meta/conf/distro/include/maintainers.inc 
b/meta/conf/distro/include/maintainers.inc
index 5423358e77..3919c5ede6 100644
--- a/meta/conf/distro/include/maintainers.inc
+++ b/meta/conf/distro/include/maintainers.inc
@@ -597,16 +597,20 @@ RECIPE_MAINTAINER:pn-python3-cython = "Oleksandr Kravchuk 
"
 RECIPE_MAINTAINER:pn-python3-pyparsing = "Oleksandr Kravchuk 
"
 RECIPE_MAINTAINER:pn-python3-pytest = "Tim Orling "
+RECIPE_MAINTAINER:pn-python3-rfc3339-validator = "Bruce Ashfield 
"
+RECIPE_MAINTAINER:pn-python3-rfc3986-validator = "Bruce Ashfield 
"
+RECIPE_MAINTAINER:pn-python3-ruamel-yaml = "Bruce Ashfield 
"
 RECIPE_MAINTAINER:pn-python3-scons = "Tim Orling "
 RECIPE_MAINTAINER:pn-python3-scons-native = "Tim Orling 
"
 RECIPE_MAINTAINER:pn-python3-setuptools = "Oleksandr Kravchuk 
"
@@ -642,6 +649,7 @@ RECIPE_MAINTAINER:pn-python3-toml = "Tim Orling 
"
 RECIPE_MAINTAINER:pn-python3-tomli = "Tim Orling "
 RECIPE_MAINTAINER:pn-python3-typogrify = "Alexander Kanavin 
"
 RECIPE_MAINTAINER:pn-python3-wcwidth = "Tim Orling 
"
+RECIPE_MAINTAINER:pn-python3-webcolors = "Bruce Ashfield 
"
 RECIPE_MAINTAINER:pn-python3-zipp = "Tim Orling "
 RECIPE_MAINTAINER:pn-qemu = "Richard Purdie 
"
 RECIPE_MAINTAINER:pn-qemu-helper-native = "Richard Purdie 
"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158636): 
https://lists.openembedded.org/g/openembedded-core/message/158636
Mute This Topic: https://lists.openembedded.org/mt/87269400/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 16/20] linux-yocto: export pkgconfig variables to devshell

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Not all of the kernel host/build Makefiles allow pkg-config
to be overriden to pkg-config-native. Exporting these variables
allow us to debug host tool issues with the kernel build.

Signed-off-by: Bruce Ashfield 
---
 meta/recipes-kernel/linux/linux-yocto.inc | 9 +
 1 file changed, 9 insertions(+)

diff --git a/meta/recipes-kernel/linux/linux-yocto.inc 
b/meta/recipes-kernel/linux/linux-yocto.inc
index 15fc7ff724..a3b2416367 100644
--- a/meta/recipes-kernel/linux/linux-yocto.inc
+++ b/meta/recipes-kernel/linux/linux-yocto.inc
@@ -61,3 +61,12 @@ KERNEL_FEATURES:append:qemuall=" 
features/kernel-sample/kernel-sample.scc"
 
 KERNEL_DEBUG_OPTIONS ?= "stack"
 KERNEL_EXTRA_ARGS:append:x86-64 = 
"${@bb.utils.contains('KERNEL_DEBUG_OPTIONS', 'stack', 
'HOST_LIBELF_LIBS="-L${RECIPE_SYSROOT_NATIVE}/usr/lib/pkgconfig/../../../usr/lib/
 -lelf"', '', d)}"
+
+do_devshell:prepend() {
+# setup native pkg-config variables (kconfig scripts call pkg-config 
directly, cannot generically be overriden to pkg-config-native)
+d.setVar("PKG_CONFIG_DIR", 
"${STAGING_DIR_NATIVE}${libdir_native}/pkgconfig")
+d.setVar("PKG_CONFIG_PATH", 
"${PKG_CONFIG_DIR}:${STAGING_DATADIR_NATIVE}/pkgconfig")
+d.setVar("PKG_CONFIG_LIBDIR", "${PKG_CONFIG_DIR}")
+d.setVarFlag("PKG_CONFIG_SYSROOT_DIR", "unexport", "1")
+d.appendVar("OE_TERMINAL_EXPORTS", " PKG_CONFIG_DIR PKG_CONFIG_PATH 
PKG_CONFIG_LIBDIR PKG_CONFIG_SYSROOT_DIR")
+}
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158637): 
https://lists.openembedded.org/g/openembedded-core/message/158637
Mute This Topic: https://lists.openembedded.org/mt/87269401/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 17/20] kernel: introduce python3-dtschema-wrapper

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

The 5.16 kernel introduced mandatory schema checking on any dtb file
built through the kernel.

That funcionality is provided via python3-dt-schema.

The dependencies to enable that functionality is not small, and may
not always be desired (in particular on architectures that do not
support dtbs, or in development cycles). It may also be useful for
allowing a non-conformant dts to be compiled.

This commit introduces a set of wrapper scripts that when added
as a depenency to the kernel, can pass both the validation testing
and validation steps of a dts.

We use the wrapper by default, while more dts file are brought up
to spec and the dt-validation matures upstream.

To enable valiation, simply add 'dt-valiation' to the PACKAGECONFIG
variable and the full dt-schema package will be selected and
validation will occur.

Signed-off-by: Bruce Ashfield 
---
 meta/conf/distro/include/maintainers.inc  |  1 +
 .../python3-dtschema-wrapper/dt-doc-validate  | 20 +++
 .../dtc/python3-dtschema-wrapper/dt-mk-schema | 20 +++
 .../dtc/python3-dtschema-wrapper/dt-validate  | 20 +++
 .../dtc/python3-dtschema-wrapper_2021.10.bb   | 17 
 5 files changed, 78 insertions(+)
 create mode 100644 
meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-doc-validate
 create mode 100644 
meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-mk-schema
 create mode 100644 meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-validate
 create mode 100644 meta/recipes-kernel/dtc/python3-dtschema-wrapper_2021.10.bb

diff --git a/meta/conf/distro/include/maintainers.inc 
b/meta/conf/distro/include/maintainers.inc
index 3919c5ede6..ba7a47c30d 100644
--- a/meta/conf/distro/include/maintainers.inc
+++ b/meta/conf/distro/include/maintainers.inc
@@ -598,6 +598,7 @@ RECIPE_MAINTAINER:pn-python3-dbus = "Zang Ruochen 
"
 RECIPE_MAINTAINER:pn-python3-dbusmock = "Oleksandr Kravchuk 
"
 RECIPE_MAINTAINER:pn-python3-docutils = "Oleksandr Kravchuk 
"
 RECIPE_MAINTAINER:pn-python3-dtschema = "Bruce Ashfield 
"
+RECIPE_MAINTAINER:pn-python3-dtschema-wrapper = "Bruce Ashfield 
"
 RECIPE_MAINTAINER:pn-python3-pycryptodome = "Joshua Watt 
"
 RECIPE_MAINTAINER:pn-python3-pycryptodomex = "Joshua Watt 
"
 RECIPE_MAINTAINER:pn-python3-extras = "Oleksandr Kravchuk 
"
diff --git a/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-doc-validate 
b/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-doc-validate
new file mode 100644
index 00..2aa57851c7
--- /dev/null
+++ b/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-doc-validate
@@ -0,0 +1,20 @@
+#!/bin/sh
+# dt-doc-validate wrapper to allow kernel dt-validation to pass
+#
+# Copyright (C) 2021 Bruce Ashfield 
+# License: MIT (see COPYING.MIT at the root of the repository for terms)
+
+for arg; do
+case "$arg" in
+--version)
+echo "v2021.10"
+;;
+esac
+done
+
+# TBD: left for future consideration
+# exec dt-doc-validate.real "$@"
+
+# we always succeed
+exit 0
+
diff --git a/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-mk-schema 
b/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-mk-schema
new file mode 100644
index 00..24b89d8619
--- /dev/null
+++ b/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-mk-schema
@@ -0,0 +1,20 @@
+#!/bin/sh
+# dt-mk-schema wrapper to allow kernel dt-validation to pass
+#
+# Copyright (C) 2021 Bruce Ashfield 
+# License: MIT (see COPYING.MIT at the root of the repository for terms)
+
+for arg; do
+case "$arg" in
+--version)
+echo "v2021.10"
+;;
+esac
+done
+
+# TBD: left for future consideration
+# exec dt-mk-schema.real "$@"
+
+# we always succeed
+exit 0
+
diff --git a/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-validate 
b/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-validate
new file mode 100644
index 00..8a4710a7ed
--- /dev/null
+++ b/meta/recipes-kernel/dtc/python3-dtschema-wrapper/dt-validate
@@ -0,0 +1,20 @@
+#!/bin/sh
+# dt-validate wrapper to allow kernel dt-validation to pass
+#
+# Copyright (C) 2021 Bruce Ashfield 
+# License: MIT (see COPYING.MIT at the root of the repository for terms)
+
+for arg; do
+case "$arg" in
+--version)
+echo "v2021.10"
+;;
+esac
+done
+
+# TBD: left for future consideration
+# exec dt-validate.real "$@"
+
+# we always succeed
+exit 0
+
diff --git a/meta/recipes-kernel/dtc/python3-dtschema-wrapper_2021.10.bb 
b/meta/recipes-kernel/dtc/python3-dtschema-wrapper_2021.10.bb
new file mode 100644
index 00..c869274d09
--- /dev/null
+++ b/meta/recipes-kernel/dtc/python3-dtschema-wrapper_2021.10.bb
@@ -0,0 +1,17 @@
+DESCRIPTION = "Wrapper for tooling for devicetree validation using YAML and 
jsonschema"
+HOMEPAGE = "https://yoctoproject.org;
+LICENSE = "MIT"
+LIC_FILES_CHKSUM = 
"file://${COREBASE}/meta/COPYING.MIT;md5=3da9cfbcb788c80a0384361b4de20420"
+
+SRC_URI = "file://dt-doc-validate \

[OE-core] [PATCH 14/20] python: import ruamel-yaml from meta-python

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Importing ruamel-yaml from meta-python. This package is a
dependency of python3-dtschema, which is required to validate
kernel devicetrees.

Signed-off-by: Bruce Ashfield 
---
 .../python/python3-ruamel-yaml_0.17.16.bb | 23 +++
 1 file changed, 23 insertions(+)
 create mode 100644 meta/recipes-devtools/python/python3-ruamel-yaml_0.17.16.bb

diff --git a/meta/recipes-devtools/python/python3-ruamel-yaml_0.17.16.bb 
b/meta/recipes-devtools/python/python3-ruamel-yaml_0.17.16.bb
new file mode 100644
index 00..e64f196004
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-ruamel-yaml_0.17.16.bb
@@ -0,0 +1,23 @@
+SUMMARY = "YAML parser/emitter that supports roundtrip preservation of 
comments, seq/map flow style, and map key order."
+AUTHOR = "Anthon van der Neut"
+
+LICENSE = "MIT"
+LIC_FILES_CHKSUM = "file://LICENSE;md5=fa0a51dfb461e2f803969e0f3fa71dfe"
+
+PYPI_PACKAGE = "ruamel.yaml"
+
+inherit pypi setuptools3
+
+SRC_URI[sha256sum] = 
"1a771fc92d3823682b7f0893ad56cb5a5c87c48e62b5399d6f42c8759a583b33"
+
+RDEPENDS:${PN} += "\
+${PYTHON_PN}-shell \
+${PYTHON_PN}-datetime \
+${PYTHON_PN}-netclient \
+"
+
+do_install:prepend() {
+export RUAMEL_NO_PIP_INSTALL_CHECK=1
+}
+
+BBCLASSEXTEND = "native nativesdk"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158635): 
https://lists.openembedded.org/g/openembedded-core/message/158635
Mute This Topic: https://lists.openembedded.org/mt/87269399/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 13/20] python: import webcolors from meta-python

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Importing webcolors, which is a dependency of
python3-jsonschema. These packges are required to support
the validation of kernel device trees.

Signed-off-by: Bruce Ashfield 
---
 .../python/python3-webcolors/run-ptest|  3 +++
 .../python/python3-webcolors_1.11.1.bb| 27 +++
 2 files changed, 30 insertions(+)
 create mode 100644 meta/recipes-devtools/python/python3-webcolors/run-ptest
 create mode 100644 meta/recipes-devtools/python/python3-webcolors_1.11.1.bb

diff --git a/meta/recipes-devtools/python/python3-webcolors/run-ptest 
b/meta/recipes-devtools/python/python3-webcolors/run-ptest
new file mode 100644
index 00..3385d68939
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-webcolors/run-ptest
@@ -0,0 +1,3 @@
+#!/bin/sh
+
+pytest -o log_cli=true -o log_cli_level=INFO | sed -e 's/\[...%\]//g'| sed -e 
's/PASSED/PASS/g'| sed -e 's/FAILED/FAIL/g'|sed -e 's/SKIPED/SKIP/g'| awk '{if 
($NF=="PASS" || $NF=="FAIL" || $NF=="SKIP" || $NF=="XFAIL" || 
$NF=="XPASS"){printf "%s: %s\n", $NF, $0}else{print}}'| awk '{if ($NF=="PASS" 
|| $NF=="FAIL" || $NF=="SKIP" || $NF=="XFAIL" || $NF=="XPASS") {$NF="";print 
$0}else{print}}'
diff --git a/meta/recipes-devtools/python/python3-webcolors_1.11.1.bb 
b/meta/recipes-devtools/python/python3-webcolors_1.11.1.bb
new file mode 100644
index 00..2ec036ef35
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-webcolors_1.11.1.bb
@@ -0,0 +1,27 @@
+SUMMARY = "Simple Python module for working with HTML/CSS color definitions."
+LICENSE = "BSD-3-Clause"
+LIC_FILES_CHKSUM = "file://LICENSE;md5=25b90379a52351261c51272e7923d240"
+
+SRC_URI[md5sum] = "54d28a7c80b3e4d974ec2fee86768be9"
+SRC_URI[sha256sum] = 
"76f360636957d1c976db7466bc71dcb713bb95ac8911944dffc55c01cb516de6"
+
+inherit pypi setuptools3 ptest
+
+RDEPENDS:${PN}:class-target = "\
+${PYTHON_PN}-stringold \
+"
+
+SRC_URI += " \
+file://run-ptest \
+"
+
+RDEPENDS:${PN}-ptest += " \
+${PYTHON_PN}-pytest \
+"
+
+do_install_ptest() {
+install -d ${D}${PTEST_PATH}/tests
+cp -rf ${S}/tests/* ${D}${PTEST_PATH}/tests/
+}
+
+BBCLASSEXTEND = "native nativesdk"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158634): 
https://lists.openembedded.org/g/openembedded-core/message/158634
Mute This Topic: https://lists.openembedded.org/mt/87269398/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 12/20] python: import rfc3986-validator from meta-python

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Importing rfc3986-validator, which is a dependency of
python3-jsonschema. These packges are required to support
the validation of kernel device trees.

Signed-off-by: Bruce Ashfield 
---
 ...e-pytest-runner-to-test_requirements.patch | 32 +++
 .../python/python3-rfc3986-validator_0.1.1.bb | 23 +
 2 files changed, 55 insertions(+)
 create mode 100644 
meta/recipes-devtools/python/python-rfc3986-validator/0001-setup.py-move-pytest-runner-to-test_requirements.patch
 create mode 100644 
meta/recipes-devtools/python/python3-rfc3986-validator_0.1.1.bb

diff --git 
a/meta/recipes-devtools/python/python-rfc3986-validator/0001-setup.py-move-pytest-runner-to-test_requirements.patch
 
b/meta/recipes-devtools/python/python-rfc3986-validator/0001-setup.py-move-pytest-runner-to-test_requirements.patch
new file mode 100644
index 00..8a646874e8
--- /dev/null
+++ 
b/meta/recipes-devtools/python/python-rfc3986-validator/0001-setup.py-move-pytest-runner-to-test_requirements.patch
@@ -0,0 +1,32 @@
+From 3531ff73631a0d59234eb4713e7b3a7f5ea57bbb Mon Sep 17 00:00:00 2001
+From: Nicola Lunghi 
+Date: Thu, 14 Nov 2019 12:17:51 +
+Subject: [PATCH] setup.py: move pytest-runner to test_requirements
+
+This fixes an issue with yocto build.
+pytest-runner is only needed when running tests.
+
+Upstream-Status: Pending
+---
+ setup.py | 4 ++--
+ 1 file changed, 2 insertions(+), 2 deletions(-)
+
+diff --git a/setup.py b/setup.py
+index 53ebea7..ebb0de2 100644
+--- a/setup.py
 b/setup.py
+@@ -10,9 +10,9 @@ with open('README.md') as readme_file:
+ 
+ requirements = []
+ 
+-setup_requirements = ['pytest-runner', ]
++setup_requirements = []
+ 
+-test_requirements = ['pytest>=3', ]
++test_requirements = ['pytest>=3', 'pytest-runner']
+ 
+ setup(
+ author="Nicolas Aimetti",
+-- 
+2.20.1
+
diff --git a/meta/recipes-devtools/python/python3-rfc3986-validator_0.1.1.bb 
b/meta/recipes-devtools/python/python3-rfc3986-validator_0.1.1.bb
new file mode 100644
index 00..68b3db1f48
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-rfc3986-validator_0.1.1.bb
@@ -0,0 +1,23 @@
+SUMMARY = "Pure python rfc3986 validator"
+HOMEPAGE = "https://github.com/naimetti/rfc3986-validator;
+LICENSE = "MIT"
+LIC_FILES_CHKSUM = "file://LICENSE;md5=a21b13b5a996f08f7e0b088aa38ce9c6"
+
+FILESEXTRAPATHS:prepend := "${THISDIR}/python-rfc3986-validator:"
+
+SRC_URI[md5sum] = "47f7657b790aaf6011a1ab3d86c6be95"
+SRC_URI[sha256sum] = 
"3d44bde7921b3b9ec3ae4e3adca370438eccebc676456449b145d533b240d055"
+
+PYPI_PACKAGE = "rfc3986_validator"
+
+inherit pypi setuptools3
+
+SRC_URI:append = " \
+file://0001-setup.py-move-pytest-runner-to-test_requirements.patch \
+"
+
+RDEPENDS:${PN} += "\
+python3-core \
+"
+
+BBCLASSEXTEND = "native nativesdk"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158633): 
https://lists.openembedded.org/g/openembedded-core/message/158633
Mute This Topic: https://lists.openembedded.org/mt/87269397/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 10/20] python: import idna from meta-python

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Importing idna from meta-python, which is a dependency of
python3-jsonschema. These packges are required to support
the validation of kernel device trees.

Signed-off-by: Bruce Ashfield 
---
 .../python/python3-idna_3.3.bb| 19 +++
 1 file changed, 19 insertions(+)
 create mode 100644 meta/recipes-devtools/python/python3-idna_3.3.bb

diff --git a/meta/recipes-devtools/python/python3-idna_3.3.bb 
b/meta/recipes-devtools/python/python3-idna_3.3.bb
new file mode 100644
index 00..a0e6b79a56
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-idna_3.3.bb
@@ -0,0 +1,19 @@
+SUMMARY = "Internationalised Domain Names in Applications"
+HOMEPAGE = "https://github.com/kjd/idna;
+LICENSE = "BSD-3-Clause & Python-2.0 & Unicode"
+LIC_FILES_CHKSUM = "file://LICENSE.md;md5=239668a7c6066d9e0c5382e9c8c6c0e1"
+
+SRC_URI[sha256sum] = 
"9d643ff0a55b762d5cdb124b8eaa99c66322e2157b69160bc32796e824360e6d"
+
+inherit pypi setuptools3
+
+# Remove bundled egg-info
+do_compile:prepend() {
+rm -rf ${S}/idna.egg-info
+}
+
+RDEPENDS:${PN}:class-target = "\
+${PYTHON_PN}-codecs \
+"
+
+BBCLASSEXTEND = "native nativesdk"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158631): 
https://lists.openembedded.org/g/openembedded-core/message/158631
Mute This Topic: https://lists.openembedded.org/mt/87269395/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 11/20] python: import rfc3339-validator from meta-python

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Importing rfc3339-validator from meta-python, which is a dependency of
python3-jsonschema. These packges are required to support
the validation of kernel device trees.

Signed-off-by: Bruce Ashfield 
---
 .../python/python3-rfc3339-validator_0.1.4.bb | 20 +++
 1 file changed, 20 insertions(+)
 create mode 100644 
meta/recipes-devtools/python/python3-rfc3339-validator_0.1.4.bb

diff --git a/meta/recipes-devtools/python/python3-rfc3339-validator_0.1.4.bb 
b/meta/recipes-devtools/python/python3-rfc3339-validator_0.1.4.bb
new file mode 100644
index 00..7f1bbaf97d
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-rfc3339-validator_0.1.4.bb
@@ -0,0 +1,20 @@
+SUMMARY = "A pure python RFC3339 validator"
+HOMEPAGE = "https://github.com/naimetti/rfc3339-validator;
+LICENSE = "MIT"
+LIC_FILES_CHKSUM = "file://LICENSE;md5=a21b13b5a996f08f7e0b088aa38ce9c6"
+
+FILESEXTRAPATHS:prepend := "${THISDIR}/python-rfc3339-validator:"
+
+SRC_URI[sha256sum] = 
"138a2abdf93304ad60530167e51d2dfb9549521a836871b88d7f4695d0022f6b"
+
+PYPI_PACKAGE = "rfc3339_validator"
+
+inherit pypi setuptools3
+
+RDEPENDS:${PN} += "\
+${PYTHON_PN}-core \
+${PYTHON_PN}-datetime \
+${PYTHON_PN}-six \
+"
+
+BBCLASSEXTEND = "native nativesdk"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158632): 
https://lists.openembedded.org/g/openembedded-core/message/158632
Mute This Topic: https://lists.openembedded.org/mt/87269396/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 08/20] python: import jsonpointer from meta-python

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

required to support python3-json, which is required for python3-dtschema
and device tree checking by the kernel.

Signed-off-by: Bruce Ashfield 
---
 .../python/python3-jsonpointer/run-ptest  |  3 +++
 .../python/python3-jsonpointer_2.1.bb | 26 +++
 2 files changed, 29 insertions(+)
 create mode 100644 meta/recipes-devtools/python/python3-jsonpointer/run-ptest
 create mode 100644 meta/recipes-devtools/python/python3-jsonpointer_2.1.bb

diff --git a/meta/recipes-devtools/python/python3-jsonpointer/run-ptest 
b/meta/recipes-devtools/python/python3-jsonpointer/run-ptest
new file mode 100644
index 00..51e609f4ba
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-jsonpointer/run-ptest
@@ -0,0 +1,3 @@
+#!/bin/sh
+
+python3 tests.py
diff --git a/meta/recipes-devtools/python/python3-jsonpointer_2.1.bb 
b/meta/recipes-devtools/python/python3-jsonpointer_2.1.bb
new file mode 100644
index 00..fb3d9e0da9
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-jsonpointer_2.1.bb
@@ -0,0 +1,26 @@
+SUMMARY = "Resolve JSON Pointers in Python"
+HOMEPAGE = "https://github.com/stefankoegl/python-json-pointer;
+LICENSE = "BSD-3-Clause"
+LIC_FILES_CHKSUM = "file://LICENSE.txt;md5=32b15c843b7a329130f4e266a281ebb3"
+
+inherit pypi ptest setuptools3
+
+SRC_URI[sha256sum] = 
"5a34b698db1eb79ceac454159d3f7c12a451a91f6334a4f638454327b7a89962"
+
+RDEPENDS:${PN} += " \
+${PYTHON_PN}-json \
+"
+
+BBCLASSEXTEND = "native nativesdk"
+
+SRC_URI += " \
+   file://run-ptest \
+"
+
+RDEPENDS:${PN}-ptest += " \
+   ${PYTHON_PN}-pytest \
+"
+
+do_install_ptest() {
+   cp -f ${S}/tests.py ${D}${PTEST_PATH}/
+}
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158629): 
https://lists.openembedded.org/g/openembedded-core/message/158629
Mute This Topic: https://lists.openembedded.org/mt/87269391/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 09/20] python: import jsonschema from meta-python

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Importing this package as a dependency to python3-dt-schema,
which is required for kernel device tree validation.

Signed-off-by: Bruce Ashfield 
---
 .../python/python3-jsonschema_3.2.0.bb| 48 +++
 1 file changed, 48 insertions(+)
 create mode 100644 meta/recipes-devtools/python/python3-jsonschema_3.2.0.bb

diff --git a/meta/recipes-devtools/python/python3-jsonschema_3.2.0.bb 
b/meta/recipes-devtools/python/python3-jsonschema_3.2.0.bb
new file mode 100644
index 00..c7efe33a83
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-jsonschema_3.2.0.bb
@@ -0,0 +1,48 @@
+SUMMARY = "An implementation of JSON Schema validation for Python"
+HOMEPAGE = "https://github.com/Julian/jsonschema;
+LICENSE = "MIT"
+LIC_FILES_CHKSUM = "file://COPYING;md5=7a60a81c146ec25599a3e1dabb8610a8 \
+file://json/LICENSE;md5=9d4de43111d33570c8fe49b4cb0e01af"
+DEPENDS += "${PYTHON_PN}-vcversioner-native ${PYTHON_PN}-setuptools-scm-native"
+
+SRC_URI[md5sum] = "f1a0b5011f05a02a8dee1070cd10a26d"
+SRC_URI[sha256sum] = 
"c8a85b28d377cc7737e46e2d9f2b4f44ee3c0e1deac6bf46ddefc7187d30797a"
+
+inherit pypi setuptools3
+
+PACKAGECONFIG ??= "format"
+PACKAGECONFIG[format] = ",,,\
+${PYTHON_PN}-idna \
+${PYTHON_PN}-jsonpointer \
+${PYTHON_PN}-webcolors \
+${PYTHON_PN}-rfc3987 \
+${PYTHON_PN}-strict-rfc3339 \
+"
+PACKAGECONFIG[nongpl] = ",,,\
+${PYTHON_PN}-idna \
+${PYTHON_PN}-jsonpointer \
+${PYTHON_PN}-webcolors \
+${PYTHON_PN}-rfc3986-validator \
+${PYTHON_PN}-rfc3339-validator \
+"
+
+RDEPENDS:${PN} += " \
+${PYTHON_PN}-attrs \
+${PYTHON_PN}-core \
+${PYTHON_PN}-datetime \
+${PYTHON_PN}-importlib-metadata \
+${PYTHON_PN}-io \
+${PYTHON_PN}-json \
+${PYTHON_PN}-netclient \
+${PYTHON_PN}-numbers \
+${PYTHON_PN}-pkgutil \
+${PYTHON_PN}-pprint \
+${PYTHON_PN}-pyrsistent \
+${PYTHON_PN}-shell \
+${PYTHON_PN}-six \
+${PYTHON_PN}-unittest \
+${PYTHON_PN}-setuptools-scm \
+${PYTHON_PN}-zipp \
+"
+
+BBCLASSEXTEND = "native nativesdk"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158630): 
https://lists.openembedded.org/g/openembedded-core/message/158630
Mute This Topic: https://lists.openembedded.org/mt/87269394/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 07/20] python: introduce python3-dtschema

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

kernel commit 53182e81f47d [kbuild: Enable DT schema checks for %.dtb
targets], which is part of v5.16+, makes the checking of dtb schemas
manditory.

To support the checking, we introduce this new recipe dtschema.

Dependencies will be imported in subsequent commits, so we can
track the dependency need on a per-import basis.

Signed-off-by: Bruce Ashfield 
---
 .../python/python3-dtschema_2021.10.bb| 15 +++
 1 file changed, 15 insertions(+)
 create mode 100644 meta/recipes-devtools/python/python3-dtschema_2021.10.bb

diff --git a/meta/recipes-devtools/python/python3-dtschema_2021.10.bb 
b/meta/recipes-devtools/python/python3-dtschema_2021.10.bb
new file mode 100644
index 00..36e572a35c
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-dtschema_2021.10.bb
@@ -0,0 +1,15 @@
+DESCRIPTION = "Tooling for devicetree validation using YAML and jsonschema"
+HOMEPAGE = "https://github.com/devicetree-org/dt-schema;
+LICENSE = "BSD-2-Clause"
+LIC_FILES_CHKSUM = "file://LICENSE.txt;md5=457495c8fa03540db4a576bf7869e811"
+
+inherit pypi setuptools3
+
+PYPI_PACKAGE = "dtschema"
+
+SRC_URI[md5sum] = "d2f0d847ba2ad4d223317ef7304342b0"
+SRC_URI[sha256sum] = 
"d09c94d13f46e6674ba11ff31220651ad1b02dae860f5a87905dfac6b8d768d9"
+
+DEPENDS += "${PYTHON_PN}-setuptools-scm ${PYTHON_PN}-ruamel-yaml 
${PYTHON_PN}-jsonschema ${PYTHON_PN}-rfc3987"
+
+BBCLASSEXTEND = "native nativesdk"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158628): 
https://lists.openembedded.org/g/openembedded-core/message/158628
Mute This Topic: https://lists.openembedded.org/mt/87269390/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 05/20] linux-yocto-dev: bump to v5.16+

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Bumping the version of -dev ot 5.16. We also pickup two new
dependencies to support kernel dtschema validation. This
requirement was introduced by kernel commit:

   commit 53182e81f47d4ea0c727c49ad23cb782173ab849
   Author: Rob Herring 
   Date:   Mon Sep 13 09:51:46 2021 -0500

   kbuild: Enable DT schema checks for %.dtb targets

   It is possible to build a single dtb, but not with DT schema validation
   enabled. Enable the schema validation to run for %.dtb and %.dtbo
   targets. Anyone building a dtb for a specific platform *should* pay
   attention to schema warnings.

   This could be supported with a separate %.dt.yaml target instead.
   However, the .dt.yaml format is considered an intermediate format and
   could possibly go away at some point if schema checking is integrated
   into dtc. Also, the plan is to enable the schema checks by default once
   platforms are free of warnings, and this is a move in that direction.

   Cc: Dmitry Baryshkov 
   Cc: Tom Rini 
   Cc: Masahiro Yamada 
   Cc: linux-kbu...@vger.kernel.org
   Signed-off-by: Rob Herring 
   Acked-by: Masahiro Yamada 
   Link: https://lore.kernel.org/r/20210913145146.766080-1-r...@kernel.org

Signed-off-by: Bruce Ashfield 
---
 meta/recipes-kernel/linux/linux-yocto-dev.bb | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/meta/recipes-kernel/linux/linux-yocto-dev.bb 
b/meta/recipes-kernel/linux/linux-yocto-dev.bb
index 005b688778..ed94ab2517 100644
--- a/meta/recipes-kernel/linux/linux-yocto-dev.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-dev.bb
@@ -30,7 +30,7 @@ SRC_URI = 
"git://git.yoctoproject.org/linux-yocto-dev.git;branch=${KBRANCH};name
 SRCREV_machine ?= 
'${@oe.utils.conditional("PREFERRED_PROVIDER_virtual/kernel", 
"linux-yocto-dev", "${AUTOREV}", "29594404d7fe73cd80eaa4ee8c43dcc53970c60e", 
d)}'
 SRCREV_meta ?= '${@oe.utils.conditional("PREFERRED_PROVIDER_virtual/kernel", 
"linux-yocto-dev", "${AUTOREV}", "29594404d7fe73cd80eaa4ee8c43dcc53970c60e", 
d)}'
 
-LINUX_VERSION ?= "5.15+"
+LINUX_VERSION ?= "5.16+"
 LINUX_VERSION_EXTENSION ?= "-yoctodev-${LINUX_KERNEL_TYPE}"
 PV = "${LINUX_VERSION}+git${SRCPV}"
 
@@ -39,6 +39,8 @@ LIC_FILES_CHKSUM = 
"file://COPYING;md5=6bc538ed5bd9a7fc9398086aedcd7e46"
 DEPENDS += "${@bb.utils.contains('ARCH', 'x86', 'elfutils-native', '', d)}"
 DEPENDS += "openssl-native util-linux-native"
 DEPENDS += "gmp-native libmpc-native"
+# yaml and dtschema are required for 5.16+ device tree validation
+DEPENDS += "libyaml-native python3-dtschema-native"
 
 COMPATIBLE_MACHINE = 
"(qemuarm|qemux86|qemuppc|qemumips|qemumips64|qemux86-64|qemuriscv64)"
 
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158626): 
https://lists.openembedded.org/g/openembedded-core/message/158626
Mute This Topic: https://lists.openembedded.org/mt/87269387/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 06/20] kernel: export native PKGCONFIG variables

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

In a similar manner to cml1.bbclass, we export the pkg-config
variables to allow a direct call to pkg-config access to the
native sysroot versus the target sysroot.

The kernel doesn't use pkg-config for target configuration,
and has many explicit calls to pkg-config, without the
possibility of easy override to pkg-config-native.

The calls to pkg-config could be made cross friendly via
replacement with make variables, but until that effort is
undertaken upstream, we need a bridge approach.

In particular, this is required for dtschema validation,
which is a requirement in kernel 5.16+

Signed-off-by: Bruce Ashfield 
---
 meta/classes/kernel.bbclass | 7 +++
 1 file changed, 7 insertions(+)

diff --git a/meta/classes/kernel.bbclass b/meta/classes/kernel.bbclass
index e0b752de19..2d219cb5e5 100644
--- a/meta/classes/kernel.bbclass
+++ b/meta/classes/kernel.bbclass
@@ -326,6 +326,13 @@ KERNEL_DEBUG_TIMESTAMPS ??= "0"
 
 kernel_do_compile() {
unset CFLAGS CPPFLAGS CXXFLAGS LDFLAGS MACHINE
+
+   # setup native pkg-config variables (kconfig scripts call pkg-config 
directly, cannot generically be overriden to pkg-config-native)
+   export PKG_CONFIG_DIR="${STAGING_DIR_NATIVE}${libdir_native}/pkgconfig"
+   export 
PKG_CONFIG_PATH="$PKG_CONFIG_DIR:${STAGING_DATADIR_NATIVE}/pkgconfig"
+   export PKG_CONFIG_LIBDIR="$PKG_CONFIG_DIR"
+   export PKG_CONFIG_SYSROOT_DIR=""
+
if [ "${KERNEL_DEBUG_TIMESTAMPS}" != "1" ]; then
# kernel sources do not use do_unpack, so SOURCE_DATE_EPOCH may 
not
# be set
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158627): 
https://lists.openembedded.org/g/openembedded-core/message/158627
Mute This Topic: https://lists.openembedded.org/mt/87269388/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 02/20] linux-yocto/5.14: update to v5.14.18

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Updating linux-yocto/5.14 to the latest korg -stable release that comprises
the following commits:

a0265dd8262d Linux 5.14.18
1379769b0b46 rsi: fix control-message timeout
eda57a310234 media: staging/intel-ipu3: css: Fix wrong size comparison 
imgu_css_fw_init
5013f2aaf959 staging: rtl8192u: fix control-message timeouts
f3422d1fceba staging: r8712u: fix control-message timeout
373ac8c59414 comedi: vmk80xx: fix bulk and interrupt message timeouts
7b0e35618932 comedi: vmk80xx: fix bulk-buffer overflow
278484ae9329 comedi: vmk80xx: fix transfer-buffer overflows
4a9d43cb5d5f comedi: ni_usb6501: fix NULL-deref in command paths
3ac273d154d6 comedi: dt9812: fix DMA buffers on stack
b2fa1f52d22c isofs: Fix out of bound access for corrupted isofs image
befd23bd3b17 staging: rtl8712: fix use-after-free in rtl8712_dl_fw
bec32c40e438 binder: don't detect sender/target during buffer cleanup
68abe9aefc40 binder: use cred instead of task for getsecid
46088365bab7 binder: use cred instead of task for selinux checks
fbb106e79524 binder: use euid from cred instead of using task
f9b4ef2504bb Revert "proc/wchan: use printk format instead of 
lookup_symbol_name()"
4674de4e2734 usb-storage: Add compatibility quirk flags for iODD 2531/2541
6be11f54f5d4 usb: musb: Balance list entry in musb_gadget_queue
d7f4ffba71d0 usb: gadget: Mark USB_FSL_QE broken on 64-bit
d3c7daab289d usb: ehci: handshake CMD_RUN instead of STS_HALT
a4cdb4c9c453 Revert "x86/kvm: fix vcpu-id indexed array sizes"
2f63111ab86f KVM: x86: avoid warning with -Wbitwise-instead-of-logical
f468cbedb2a7 ALSA: pci: cs46xx: Fix set up buffer type properly
186155ac272e ALSA: pcm: Check mmap capability of runtime dma buffer at first

Signed-off-by: Bruce Ashfield 
---
 .../linux/linux-yocto-rt_5.14.bb  |  6 ++---
 .../linux/linux-yocto-tiny_5.14.bb|  8 +++---
 meta/recipes-kernel/linux/linux-yocto_5.14.bb | 26 +--
 3 files changed, 20 insertions(+), 20 deletions(-)

diff --git a/meta/recipes-kernel/linux/linux-yocto-rt_5.14.bb 
b/meta/recipes-kernel/linux/linux-yocto-rt_5.14.bb
index 7e02f83d51..a328c6211f 100644
--- a/meta/recipes-kernel/linux/linux-yocto-rt_5.14.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-rt_5.14.bb
@@ -11,13 +11,13 @@ python () {
 raise bb.parse.SkipRecipe("Set PREFERRED_PROVIDER_virtual/kernel to 
linux-yocto-rt to enable it")
 }
 
-SRCREV_machine ?= "672665c11dd86abd71bbad0537e6388c6a5a84ca"
-SRCREV_meta ?= "b3ac9c40a22d6b00545b7ce51ef6dfb0cb9d2933"
+SRCREV_machine ?= "b9d37d8650cd3787d60516496f60178c51564a59"
+SRCREV_meta ?= "4e79d0b09290482ffb891e6b4acb3c7447b9c94d"
 
 SRC_URI = 
"git://git.yoctoproject.org/linux-yocto.git;branch=${KBRANCH};name=machine \

git://git.yoctoproject.org/yocto-kernel-cache;type=kmeta;name=meta;branch=yocto-5.14;destsuffix=${KMETA}"
 
-LINUX_VERSION ?= "5.14.17"
+LINUX_VERSION ?= "5.14.18"
 
 LIC_FILES_CHKSUM = "file://COPYING;md5=6bc538ed5bd9a7fc9398086aedcd7e46"
 
diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_5.14.bb 
b/meta/recipes-kernel/linux/linux-yocto-tiny_5.14.bb
index 9ad9549554..98947900a4 100644
--- a/meta/recipes-kernel/linux/linux-yocto-tiny_5.14.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-tiny_5.14.bb
@@ -6,7 +6,7 @@ KCONFIG_MODE = "--allnoconfig"
 
 require recipes-kernel/linux/linux-yocto.inc
 
-LINUX_VERSION ?= "5.14.17"
+LINUX_VERSION ?= "5.14.18"
 LIC_FILES_CHKSUM = "file://COPYING;md5=6bc538ed5bd9a7fc9398086aedcd7e46"
 
 DEPENDS += "${@bb.utils.contains('ARCH', 'x86', 'elfutils-native', '', d)}"
@@ -15,9 +15,9 @@ DEPENDS += "openssl-native util-linux-native"
 KMETA = "kernel-meta"
 KCONF_BSP_AUDIT_LEVEL = "2"
 
-SRCREV_machine:qemuarm ?= "566227d5b0913910467a7736d78cad37e60217f8"
-SRCREV_machine ?= "35888b3a9a222963b856c960e8f0c72c2de18d4a"
-SRCREV_meta ?= "b3ac9c40a22d6b00545b7ce51ef6dfb0cb9d2933"
+SRCREV_machine:qemuarm ?= "83004545c9bb5e3ad666b3ffa9ad723eb795881a"
+SRCREV_machine ?= "8411a30747a2750c9d4dbe24631958bd00d3157e"
+SRCREV_meta ?= "4e79d0b09290482ffb891e6b4acb3c7447b9c94d"
 
 PV = "${LINUX_VERSION}+git${SRCPV}"
 
diff --git a/meta/recipes-kernel/linux/linux-yocto_5.14.bb 
b/meta/recipes-kernel/linux/linux-yocto_5.14.bb
index f034f36d45..673c03d82e 100644
--- a/meta/recipes-kernel/linux/linux-yocto_5.14.bb
+++ b/meta/recipes-kernel/linux/linux-yocto_5.14.bb
@@ -13,17 +13,17 @@ KBRANCH:qemux86  ?= "v5.14/standard/base"
 KBRANCH:qemux86-64 ?= "v5.14/standard/base"
 KBRANCH:qemumips64 ?= "v5.14/standard/mti-malta64"
 
-SRCREV_machine:qemuarm ?= "eef94a78151c2227eba9a8468ac611d9507482b5"
-SRCREV_machine:qemuarm64 ?= "35888b3a9a222963b856c960e8f0c72c2de18d4a"
-SRCREV_machine:qemumips ?= "607d94618b35382f38ab2bc0d37494372897ae4d"
-SRCREV_machine:qemuppc ?= "35888b3a9a222963b856c960e8f0c72c2de18d4a"
-SRCREV_machine:qemuriscv64 ?= "35888b3a9a222963b856c960e8f0c72c2de18d4a"

[OE-core] [PATCH 04/20] kernel-yocto: conditionally enable stack protection checking on x86-64

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

The kernel Makfile uses pkgconfig to check for libelf when enabling
CONFIG_STACK_VALIDATION. We already have libelf in our DEPENDS, but
the kernel Makefiles hardcode 'pkgconfig', so fail to pick up our
pkgconfig-native binary that would report the correct flags and paths
for libelf support.

Rather than patching the kernel Makefile's to use pkgconfig-native,
we can use the KERNEL_EXTRA_ARGS variable to pass the definition of
HOST_LIBELF_LIBS via the kernel build commmand line.

We conditionally set HOST_LIBELF_LIBS based on "stack" being in
a newly introduced variable KERNEL_DEBUG_OPTIONS. The value of
HOST_LIBELF_LIBS is the same as pkgconfig-native would set in a
kernel build (but we cannot call pkgconfig at the point this
variable is set).

Signed-off-by: Bruce Ashfield 
---
 meta/recipes-kernel/linux/linux-yocto.inc | 4 
 1 file changed, 4 insertions(+)

diff --git a/meta/recipes-kernel/linux/linux-yocto.inc 
b/meta/recipes-kernel/linux/linux-yocto.inc
index 331727d62c..15fc7ff724 100644
--- a/meta/recipes-kernel/linux/linux-yocto.inc
+++ b/meta/recipes-kernel/linux/linux-yocto.inc
@@ -46,6 +46,7 @@ LINUX_VERSION_EXTENSION ??= "-yocto-${LINUX_KERNEL_TYPE}"
 # Pick up shared functions
 inherit kernel
 inherit kernel-yocto
+inherit pkgconfig
 
 B = "${WORKDIR}/linux-${PACKAGE_ARCH}-${LINUX_KERNEL_TYPE}-build"
 
@@ -57,3 +58,6 @@ do_install:append(){
 
 # enable kernel-sample for oeqa/runtime/cases's ksample.py test
 KERNEL_FEATURES:append:qemuall=" features/kernel-sample/kernel-sample.scc"
+
+KERNEL_DEBUG_OPTIONS ?= "stack"
+KERNEL_EXTRA_ARGS:append:x86-64 = 
"${@bb.utils.contains('KERNEL_DEBUG_OPTIONS', 'stack', 
'HOST_LIBELF_LIBS="-L${RECIPE_SYSROOT_NATIVE}/usr/lib/pkgconfig/../../../usr/lib/
 -lelf"', '', d)}"
-- 
2.19.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158625): 
https://lists.openembedded.org/g/openembedded-core/message/158625
Mute This Topic: https://lists.openembedded.org/mt/87269386/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 03/20] linux-yocto/5.10: update to v5.10.79

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Updating linux-yocto/5.10 to the latest korg -stable release that comprises
the following commits:

bd816c278316 Linux 5.10.79
62424fe4c2cf rsi: fix control-message timeout
8971158af1e0 media: staging/intel-ipu3: css: Fix wrong size comparison 
imgu_css_fw_init
1cf43e928954 staging: rtl8192u: fix control-message timeouts
9963ba5b9d49 staging: r8712u: fix control-message timeout
844b02496eac comedi: vmk80xx: fix bulk and interrupt message timeouts
b7fd7f3387f0 comedi: vmk80xx: fix bulk-buffer overflow
33d7a470730d comedi: vmk80xx: fix transfer-buffer overflows
ef143dc0c3de comedi: ni_usb6501: fix NULL-deref in command paths
786f5b034504 comedi: dt9812: fix DMA buffers on stack
86d4aedcbc69 isofs: Fix out of bound access for corrupted isofs image
c430094541a8 staging: rtl8712: fix use-after-free in rtl8712_dl_fw
ab4af56ae250 printk/console: Allow to disable console output by using 
console="" or console=null
07d1db141e47 binder: don't detect sender/target during buffer cleanup
42681b90c4db usb-storage: Add compatibility quirk flags for iODD 2531/2541
1309753b7841 usb: musb: Balance list entry in musb_gadget_queue
27409143122f usb: gadget: Mark USB_FSL_QE broken on 64-bit
94e5305a3816 usb: ehci: handshake CMD_RUN instead of STS_HALT
a8db6fd04d58 Revert "x86/kvm: fix vcpu-id indexed array sizes"
ecf58653f1e4 KVM: x86: avoid warning with -Wbitwise-instead-of-logical

Signed-off-by: Bruce Ashfield 
---
 .../linux/linux-yocto-rt_5.10.bb  |  6 ++---
 .../linux/linux-yocto-tiny_5.10.bb|  8 +++
 meta/recipes-kernel/linux/linux-yocto_5.10.bb | 24 +--
 3 files changed, 19 insertions(+), 19 deletions(-)

diff --git a/meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb 
b/meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb
index f666ac0611..89ef0097fa 100644
--- a/meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb
@@ -11,13 +11,13 @@ python () {
 raise bb.parse.SkipRecipe("Set PREFERRED_PROVIDER_virtual/kernel to 
linux-yocto-rt to enable it")
 }
 
-SRCREV_machine ?= "12f6a7187b3c8abab5e139dbfdf7f58f265f4169"
-SRCREV_meta ?= "a0238f7f4fd08bb18147bb5e24cc877b0546"
+SRCREV_machine ?= "31ba5af055c8ec4f10e7d830f6303ca2384e345a"
+SRCREV_meta ?= "1a4cd99824c919ba17dc62935532f3748ef18469"
 
 SRC_URI = 
"git://git.yoctoproject.org/linux-yocto.git;branch=${KBRANCH};name=machine \

git://git.yoctoproject.org/yocto-kernel-cache;type=kmeta;name=meta;branch=yocto-5.10;destsuffix=${KMETA}"
 
-LINUX_VERSION ?= "5.10.78"
+LINUX_VERSION ?= "5.10.79"
 
 LIC_FILES_CHKSUM = "file://COPYING;md5=6bc538ed5bd9a7fc9398086aedcd7e46"
 
diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_5.10.bb 
b/meta/recipes-kernel/linux/linux-yocto-tiny_5.10.bb
index 86010f106f..ef562f42f1 100644
--- a/meta/recipes-kernel/linux/linux-yocto-tiny_5.10.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-tiny_5.10.bb
@@ -6,7 +6,7 @@ KCONFIG_MODE = "--allnoconfig"
 
 require recipes-kernel/linux/linux-yocto.inc
 
-LINUX_VERSION ?= "5.10.78"
+LINUX_VERSION ?= "5.10.79"
 LIC_FILES_CHKSUM = "file://COPYING;md5=6bc538ed5bd9a7fc9398086aedcd7e46"
 
 DEPENDS += "${@bb.utils.contains('ARCH', 'x86', 'elfutils-native', '', d)}"
@@ -15,9 +15,9 @@ DEPENDS += "openssl-native util-linux-native"
 KMETA = "kernel-meta"
 KCONF_BSP_AUDIT_LEVEL = "2"
 
-SRCREV_machine:qemuarm ?= "cdec5045c5323846adaf2510e539843d0cfe74ae"
-SRCREV_machine ?= "344c0c38f5b892312b0a1db7f613d2704dd4942f"
-SRCREV_meta ?= "a0238f7f4fd08bb18147bb5e24cc877b0546"
+SRCREV_machine:qemuarm ?= "d8f6c9be051a886d4956a7d6195d0e8f10761a33"
+SRCREV_machine ?= "f7838de907e651c3d279e6b5209b7e5d7e12ad21"
+SRCREV_meta ?= "1a4cd99824c919ba17dc62935532f3748ef18469"
 
 PV = "${LINUX_VERSION}+git${SRCPV}"
 
diff --git a/meta/recipes-kernel/linux/linux-yocto_5.10.bb 
b/meta/recipes-kernel/linux/linux-yocto_5.10.bb
index 2e81068330..a68744d129 100644
--- a/meta/recipes-kernel/linux/linux-yocto_5.10.bb
+++ b/meta/recipes-kernel/linux/linux-yocto_5.10.bb
@@ -13,17 +13,17 @@ KBRANCH:qemux86  ?= "v5.10/standard/base"
 KBRANCH:qemux86-64 ?= "v5.10/standard/base"
 KBRANCH:qemumips64 ?= "v5.10/standard/mti-malta64"
 
-SRCREV_machine:qemuarm ?= "f98b917d7826304daeecf11cc52be2562a9304ff"
-SRCREV_machine:qemuarm64 ?= "13ff8a3ae368724e008e3bcd77833611de7962b2"
-SRCREV_machine:qemumips ?= "7b94dec2b0f5b582b97cdb3ac97fe153559869e4"
-SRCREV_machine:qemuppc ?= "652531fb0cc8eb3607109bb8d878253be2d3d534"
-SRCREV_machine:qemuriscv64 ?= "2daa192783edd4974da8e900c0dc93186e57a838"
-SRCREV_machine:qemuriscv32 ?= "2daa192783edd4974da8e900c0dc93186e57a838"
-SRCREV_machine:qemux86 ?= "2daa192783edd4974da8e900c0dc93186e57a838"
-SRCREV_machine:qemux86-64 ?= "2daa192783edd4974da8e900c0dc93186e57a838"
-SRCREV_machine:qemumips64 ?= "4c817df0fd06350e18693551699c33361e16a193"
-SRCREV_machine ?= "2daa192783edd4974da8e900c0dc93186e57a838"

[OE-core] [PATCH 01/20] linux-yocto/5.15: update to v5.15.2

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Updating linux-yocto/5.15 to the latest korg -stable release that comprises
the following commits:

7cc36c3e14ae Linux 5.15.2
5dbe126056fb rsi: fix control-message timeout
7d6f8d3bab72 media: staging/intel-ipu3: css: Fix wrong size comparison 
imgu_css_fw_init
4787caef521c staging: r8188eu: fix memleak in rtw_wx_set_enc_ext
8f60f9f6ee24 staging: rtl8192u: fix control-message timeouts
9033490a3fef staging: r8712u: fix control-message timeout
3a66e8a661a4 comedi: vmk80xx: fix bulk and interrupt message timeouts
47b4636ebdbe comedi: vmk80xx: fix bulk-buffer overflow
06ac746d57e6 comedi: vmk80xx: fix transfer-buffer overflows
d6a727a681a3 comedi: ni_usb6501: fix NULL-deref in command paths
20cebb8b620d comedi: dt9812: fix DMA buffers on stack
e7fb722586a2 isofs: Fix out of bound access for corrupted isofs image
a65c9afe9f2f staging: rtl8712: fix use-after-free in rtl8712_dl_fw
a0041453ff9e btrfs: fix lzo_decompress_bio() kmap leakage
d5dd3b44488b kfence: default to dynamic branch instead of static keys mode
93ce7441001f kfence: always use static branches to guard kfence_alloc()
5e57d171e2e6 binder: don't detect sender/target during buffer cleanup
6e8813eadf8b binder: use cred instead of task for getsecid
3f3c31dd0f8c binder: use cred instead of task for selinux checks
ff1bd01f490b binder: use euid from cred instead of using task
ec7c20d41714 Revert "proc/wchan: use printk format instead of 
lookup_symbol_name()"
2e93afda0520 usb-storage: Add compatibility quirk flags for iODD 2531/2541
ad5df979295b usb: musb: Balance list entry in musb_gadget_queue
72a9bf9bb16a usb: gadget: Mark USB_FSL_QE broken on 64-bit
adb1902a1246 usb: ehci: handshake CMD_RUN instead of STS_HALT
aa8a82d6db0b Revert "x86/kvm: fix vcpu-id indexed array sizes"
26ac7dec7ff0 KVM: x86: avoid warning with -Wbitwise-instead-of-logical

Signed-off-by: Bruce Ashfield 
---
 .../linux/linux-yocto-rt_5.15.bb  |  6 ++---
 .../linux/linux-yocto-tiny_5.15.bb|  8 +++---
 meta/recipes-kernel/linux/linux-yocto_5.15.bb | 26 +--
 3 files changed, 20 insertions(+), 20 deletions(-)

diff --git a/meta/recipes-kernel/linux/linux-yocto-rt_5.15.bb 
b/meta/recipes-kernel/linux/linux-yocto-rt_5.15.bb
index 879f2be677..d5c11b8d33 100644
--- a/meta/recipes-kernel/linux/linux-yocto-rt_5.15.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-rt_5.15.bb
@@ -11,13 +11,13 @@ python () {
 raise bb.parse.SkipRecipe("Set PREFERRED_PROVIDER_virtual/kernel to 
linux-yocto-rt to enable it")
 }
 
-SRCREV_machine ?= "b9ff38638d2398b647629e768713eefb0fc6707a"
-SRCREV_meta ?= "5bcd50d6b0cde22583768dc1acf304259364ddbc"
+SRCREV_machine ?= "ada3579e989bfe75d8598ab993347157dc4611c2"
+SRCREV_meta ?= "e3682eb8fe7512597c75b009f51027534ab2f58d"
 
 SRC_URI = 
"git://git.yoctoproject.org/linux-yocto.git;branch=${KBRANCH};name=machine \

git://git.yoctoproject.org/yocto-kernel-cache;type=kmeta;name=meta;branch=yocto-5.15;destsuffix=${KMETA}"
 
-LINUX_VERSION ?= "5.15.1"
+LINUX_VERSION ?= "5.15.2"
 
 LIC_FILES_CHKSUM = "file://COPYING;md5=6bc538ed5bd9a7fc9398086aedcd7e46"
 
diff --git a/meta/recipes-kernel/linux/linux-yocto-tiny_5.15.bb 
b/meta/recipes-kernel/linux/linux-yocto-tiny_5.15.bb
index 6035dc47f1..49e74252e9 100644
--- a/meta/recipes-kernel/linux/linux-yocto-tiny_5.15.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-tiny_5.15.bb
@@ -6,7 +6,7 @@ KCONFIG_MODE = "--allnoconfig"
 
 require recipes-kernel/linux/linux-yocto.inc
 
-LINUX_VERSION ?= "5.15.1"
+LINUX_VERSION ?= "5.15.2"
 LIC_FILES_CHKSUM = "file://COPYING;md5=6bc538ed5bd9a7fc9398086aedcd7e46"
 
 DEPENDS += "${@bb.utils.contains('ARCH', 'x86', 'elfutils-native', '', d)}"
@@ -15,9 +15,9 @@ DEPENDS += "openssl-native util-linux-native"
 KMETA = "kernel-meta"
 KCONF_BSP_AUDIT_LEVEL = "2"
 
-SRCREV_machine:qemuarm ?= "098dbfb0e6d95ae958e1003738fb0dc90a81691b"
-SRCREV_machine ?= "5a8ec126c297dd9e410eb23685003f670f8f3d57"
-SRCREV_meta ?= "5bcd50d6b0cde22583768dc1acf304259364ddbc"
+SRCREV_machine:qemuarm ?= "0daad4eb78782be97ce4d91f2d455ccc2d238991"
+SRCREV_machine ?= "a81c52f3e09edca72d2b3da6cbab5d17769fa8cb"
+SRCREV_meta ?= "e3682eb8fe7512597c75b009f51027534ab2f58d"
 
 PV = "${LINUX_VERSION}+git${SRCPV}"
 
diff --git a/meta/recipes-kernel/linux/linux-yocto_5.15.bb 
b/meta/recipes-kernel/linux/linux-yocto_5.15.bb
index 0fd49d78cb..51259617a7 100644
--- a/meta/recipes-kernel/linux/linux-yocto_5.15.bb
+++ b/meta/recipes-kernel/linux/linux-yocto_5.15.bb
@@ -13,17 +13,17 @@ KBRANCH:qemux86  ?= "v5.15/standard/base"
 KBRANCH:qemux86-64 ?= "v5.15/standard/base"
 KBRANCH:qemumips64 ?= "v5.15/standard/mti-malta64"
 
-SRCREV_machine:qemuarm ?= "47b7bd92b84e0ad136d45956e86039ad7307c892"
-SRCREV_machine:qemuarm64 ?= "5a8ec126c297dd9e410eb23685003f670f8f3d57"
-SRCREV_machine:qemumips ?= "e2dd4de2dfebf97237b87c414d0582016f64d5b1"
-SRCREV_machine:qemuppc ?= 

[OE-core] [PATCH 00/20] kernel/kernel-yocto: consolidated pull request

2021-11-23 Thread Bruce Ashfield
From: Bruce Ashfield 

Richard,

There's a few routine -stable updates at the start of this, and then some
more painful (and RFC) commits.

As part of this series, we fix one pkg-config issue that was preventing
x86 from doing stack valildation during build. At one point it was
increasing my build times signficantly, but that seems to have gone
away now. If we see something like this on the AB, we'll have to keep
the fix, but disable it by default.

The next big chunk of changes are the ones we talked about during the
tech call today. The 5.16 kernel has introduced mandatory dtschema
checking for device trees built through the kernel.

That checking pulls in a reasonably large amount of dependencies to
the kernel build: libyaml, dtschema, jsonschema, etc.

We weren't able to even run the validation at all, due to the kernel
calling pkg-config directly to check for libyaml, which is the target
pkgconfig and failing on missing dependencies. Rather than patching
the kernel, I've finally given in and made the do_compile task set
the PKG_CONFIG variables to point to our native-sysroot. Since the
kenrel doesn't use pkgconfig for target decisions, and has quite
a few calls directly to pkgconfig, this is the best short term way
to get all those checks working.

Once we are past yaml, we need to create the dtschema recipe, and
bring in the dependencies from meta-python. I've put myself down as
the maintainer for all the new recipes, but otherwise, I haven't
changed or modified them.

BUT! there are scenarios where a non-conformant dts file is being
built, or we just don't want those dependencies in the built. To
work around that, I took the suggestion from this morning and
created a python3-dtschema-wrappers recipe. It contains three
scripts of the same name as the ones from the real package. When
put in the dependency for a kernel build, it can pass the dtschema
steps.

Finally, I created a reference PACKAGECONFIG for linux-yocto-dev
to enable/disable the main package and wrappers (the wrappers are
used by default). I haven't put this into kernel.bbclass yet, since
it is version specific, and it needs to soak for a bit. But if
there's demand, it is something that can be moved to kernel.bclass
(along with a few other version specific dependencies).

Note: I haven't done an AB run with these yet, so I could be
missing some python dependencies, etc, but I wanted to get this
out to the list in case others are running into this with
v5.16+.

Cheers,

Bruce


The following changes since commit 60409917ea3e7353f5b7ee831fe4ffaff0957d94:

  glibc-tests: Do not set SYSTEMD_SERVICE (2021-11-23 14:04:02 +)

are available in the Git repository at:

  git://git.yoctoproject.org/poky-contrib zedd/kernel
  http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=zedd/kernel

Bruce Ashfield (18):
  linux-yocto/5.15: update to v5.15.2
  linux-yocto/5.14: update to v5.14.18
  linux-yocto/5.10: update to v5.10.79
  kernel-yocto: conditionally enable stack protection checking on x86-64
  linux-yocto-dev: bump to v5.16+
  kernel: export native PKGCONFIG variables
  python: introduce python3-dtschema
  python: import jsonpointer from meta-python
  python: import jsonschema from meta-python
  python: import idna from meta-python
  python: import rfc3339-validator from meta-python
  python: import rfc3986-validator from meta-python
  python: import webcolors from meta-python
  python: import ruamel-yaml from meta-python
  maintainers: update for kernel dtschema checking dependencies
  linux-yocto: export pkgconfig variables to devshell
  kernel: introduce python3-dtschema-wrapper
  linux-yocto-dev: introduce dt-validation PACKAGECONFIG

Max Krummenacher (2):
  perf: sort-pmuevents: don't drop elements
  perf: sort-pmuevents: allow for additional type qualifiers and storage
class

 meta/classes/kernel.bbclass   |  7 +++
 meta/conf/distro/include/maintainers.inc  |  9 
 ...e-pytest-runner-to-test_requirements.patch | 32 +
 .../python/python3-dtschema_2021.10.bb| 15 ++
 .../python/python3-idna_3.3.bb| 19 
 .../python/python3-jsonpointer/run-ptest  |  3 ++
 .../python/python3-jsonpointer_2.1.bb | 26 ++
 .../python/python3-jsonschema_3.2.0.bb| 48 +++
 .../python/python3-rfc3339-validator_0.1.4.bb | 20 
 .../python/python3-rfc3986-validator_0.1.1.bb | 23 +
 .../python/python3-ruamel-yaml_0.17.16.bb | 23 +
 .../python/python3-webcolors/run-ptest|  3 ++
 .../python/python3-webcolors_1.11.1.bb| 27 +++
 .../python3-dtschema-wrapper/dt-doc-validate  | 20 
 .../dtc/python3-dtschema-wrapper/dt-mk-schema | 20 
 .../dtc/python3-dtschema-wrapper/dt-validate  | 20 
 .../dtc/python3-dtschema-wrapper_2021.10.bb   | 17 +++
 meta/recipes-kernel/linux/linux-yocto-dev.bb  | 10 +++-
 .../linux/linux-yocto-rt_5.10.bb  |  6 +--
 

Re: [oe][OE-core][Patch 0/2] perf: sort-pmuevents: some fixes

2021-11-23 Thread Bruce Ashfield
On Tue, Nov 23, 2021 at 9:05 AM Bruce Ashfield via
lists.openembedded.org
 wrote:
>
> On Tue, Nov 23, 2021 at 8:58 AM Max Krummenacher  wrote:
> >
> > Let me know if there is anything I can do/provide from my side.
> > I know you already did, but does 'bitbake perf -c cleansstate' help?
>
> The builds were clean, but to rule out old artifacts, I just started a
> new build on a separate server, without my normal sstate sharing
> configuration. Fingers crossed :D

It is building on my completely fresh box. Which does imply I was
getting the old script before .. but I can't say for sure why.

Regardless, I'm sending a consolidated pull request shortly with some
v5.16 fixes, and have these stacked on top, just to confirm they are
working in my setup and that I've tested them.

Bruce

>
> Bruce
>
> >
> > Max
> >
> > On Tue, Nov 23, 2021 at 2:55 PM Bruce Ashfield  
> > wrote:
> > >
> > > On Tue, Nov 23, 2021 at 8:48 AM Max Krummenacher  
> > > wrote:
> > > >
> > > > Hi Bruce,
> > > >
> > > > On Tue, Nov 23, 2021 at 2:41 AM Bruce Ashfield 
> > > >  wrote:
> > > > >
> > > > > On Mon, Nov 22, 2021 at 11:35 AM Max Krummenacher 
> > > > >  wrote:
> > > > > >
> > > > > > I am trying out a kernel recipe using linux master, 5.16-rc2. I 
> > > > > > found
> > > > > > that perf fails to build in do_compile with such a setup.
> > > > > > Root cause is that the kernel did add 'static' and 'const' to the
> > > > > > arrays of structs which sort-pmuevents does sort.
> > > > > > This is addressed in the second commit.
> > > > > >
> > > > > > While at it I noticed that there are some struct arrays which 
> > > > > > neither
> > > > > > have a name or cpuid element with 1 array element. That 1 element 
> > > > > > was
> > > > > > dropped. I did not verify if that causes any issues at runtime, 
> > > > > > however
> > > > > > that behaviour was improved with the first commit.
> > > > >
> > > > > What MACHINE were you testing against ? When I build perf against my
> > > > > -rc2 dev kernel, I still run into the build issues with these commits
> > > > > in place.
> > > > >
> > > > > I just want to make sure that I'm not seeing something different .. so
> > > > > I can do some runs against a similar config as you are using.
> > > > >
> > > >
> > > > I did the inital work against a Toradex machine, apalis-imx6.
> > > > However I built before sending the patches with qemuarm64 qemuarm 
> > > > qemux86-64
> > > > with the following modification to use my 'master' kernel recipe:
> > > > +PREFERRED_PROVIDER_virtual/kernel = "linux-toradex-mainline"
> > > > +KBUILD_DEFCONFIG:arm = "tegra_defconfig"
> > > > +KBUILD_DEFCONFIG:aarch64 = "defconfig"
> > > > +KBUILD_DEFCONFIG:qemux86-64 = "x86_64_defconfig"
> > > >
> > > > I tried again. With the patches perf builds for all three machines,
> > > > reverting the patches and it fails again.
> > > > The x86 compiles forever, for the two ARM machines I get:
> > > > ...
> > > > Traceback (most recent call last):
> > > >   File 
> > > > "/build/krm/oe-core_master/build/tmp/work/qemuarm64-tdx-linux/perf/1.0-r9/perf-1.0/sort-pmuevents.py",
> > > > line 83, in 
> > > > print( preamble.group(1) )
> > > > AttributeError: 'NoneType' object has no attribute 'group'
> > >
> > > Definitely still fails here for some of my configurations. I'll look
> > > into it more today, and see if there's something in my reference
> > > kernel configurations that are causing it.
> > >
> > > I need to sort this out, and can put it in a queue with my -dev
> > > upgrades to 5.16, since without those version bumps, we have nothing
> > > in core that exercises the change.
> > >
> > > Cheers,
> > >
> > > Bruce
> > >
> > > > ...
> > > >
> > > > Max
> > > >
> > > > >
> > > > > >
> > > > > > Note that the kernel itself doesn't build either as after 5.15 it 
> > > > > > now
> > > > > > does try to run the dt_binding_check for which the kernel recipe 
> > > > > > does
> > > > > > not provide whatever stuff is needed.
> > > > > > I just did a revert patch for commit 53182e81f47d ("kbuild: Enable
> > > > > > DT schema checks for %.dtb targets") to get over that.
> > > > > >
> > > > > > Max Krummenacher (2):
> > > > > >   perf: sort-pmuevents: don't drop elements
> > > > > >   perf: sort-pmuevents: allow for additional type qualifiers and 
> > > > > > storage
> > > > > > class
> > > > > >
> > > > > >  .../perf/perf/sort-pmuevents.py   | 28 
> > > > > > +++
> > > > > >  1 file changed, 16 insertions(+), 12 deletions(-)
> > > > > >
> > > > > > --
> > > > > > 2.20.1
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > - Thou shalt not follow the NULL pointer, for chaos and madness await
> > > > > thee at its end
> > > > > - "Use the force Harry" - Gandalf, Star Trek II
> > >
> > >
> > >
> > > --
> > > - Thou shalt not follow the NULL pointer, for chaos and madness await
> > > thee at its end
> > > - "Use the force Harry" - Gandalf, Star Trek II
>
>
>
> --
> - Thou shalt not follow the NULL pointer, 

[OE-core] [PATCH] wayland-protocols: upgrade 1.23 -> 1.24

2021-11-23 Thread Denys Dmytriyenko
wayland-protocols 1.24 is now available.

This release adds feedback to the DMA buffer protocol, allowing smarter and
more dynamic DMA buffer allocation semantics. Other changes include
documentation improvements and improved testing infrastructure.

This is also the first release of wayland-protocols that do not include a
autotools build description.

https://lists.freedesktop.org/archives/wayland-devel/2021-November/042039.html

Disable build-time tests as they want to cross-compile in an allarch package:

| # Check buildability
| add_languages('c', 'cpp', native: false)

Signed-off-by: Denys Dmytriyenko 
---
 .../{wayland-protocols_1.23.bb => wayland-protocols_1.24.bb}| 6 --
 1 file changed, 4 insertions(+), 2 deletions(-)
 rename meta/recipes-graphics/wayland/{wayland-protocols_1.23.bb => 
wayland-protocols_1.24.bb} (84%)

diff --git a/meta/recipes-graphics/wayland/wayland-protocols_1.23.bb 
b/meta/recipes-graphics/wayland/wayland-protocols_1.24.bb
similarity index 84%
rename from meta/recipes-graphics/wayland/wayland-protocols_1.23.bb
rename to meta/recipes-graphics/wayland/wayland-protocols_1.24.bb
index 60b6eb1..2a1f1e3 100644
--- a/meta/recipes-graphics/wayland/wayland-protocols_1.23.bb
+++ b/meta/recipes-graphics/wayland/wayland-protocols_1.24.bb
@@ -11,11 +11,13 @@ LIC_FILES_CHKSUM = 
"file://COPYING;md5=c7b12b6702da38ca028ace54aae3d484 \
 
 SRC_URI = "https://wayland.freedesktop.org/releases/${BPN}-${PV}.tar.xz \
"
-SRC_URI[sha256sum] = 
"6c0af1915f96f615927a6270d025bd973ff1c58e521e4ca1fc9abfc914633f76"
+SRC_URI[sha256sum] = 
"bff0d8cffeeceb35159d6f4aa6bab18c807b80642c9d50f66cba52ecf7338bc2"
 
 UPSTREAM_CHECK_URI = "https://wayland.freedesktop.org/releases.html;
 
-inherit allarch autotools pkgconfig
+inherit allarch meson pkgconfig
+
+EXTRA_OEMESON += "-Dtests=false"
 
 PACKAGES = "${PN}"
 FILES:${PN} += "${datadir}/pkgconfig/wayland-protocols.pc"
-- 
2.7.4


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158619): 
https://lists.openembedded.org/g/openembedded-core/message/158619
Mute This Topic: https://lists.openembedded.org/mt/87267791/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] native/cross: Add ar wrapper for determinism

2021-11-23 Thread Jacob Kroon


On 11/23/21 15:12, Richard Purdie wrote:
> From: Jacob Kroon 
> 
> Add a wrapper around ar calls for native/cross recipes. This wrapper adds
> the -D option so that deterministic archives are built for native/cross
> output. This improves the changes of hash equivalence matches and hence
> build artefact reuse.
> 
> We don't need this in the target case since we compile binutils-cross
> with an option making this the default. We need a wrapper since we need
> to remove the "u" option and replace it with "D" but also allow things like
> "--version" to continue to work too.
> 
> Signed-off-by: Jacob Kroon 
> Signed-off-by: Richard Purdie 
> ---
>  meta/classes/cross.bbclass  |  2 ++
>  scripts/cross-intercept/ar  |  1 +
>  scripts/native-intercept/ar | 29 +
>  3 files changed, 32 insertions(+)
>  create mode 12 scripts/cross-intercept/ar
>  create mode 100755 scripts/native-intercept/ar
> 
> diff --git a/meta/classes/cross.bbclass b/meta/classes/cross.bbclass
> index 3e6a2f60b9e..9d951076a78 100644
> --- a/meta/classes/cross.bbclass
> +++ b/meta/classes/cross.bbclass
> @@ -93,3 +93,5 @@ python do_addto_recipe_sysroot () {
>  }
>  addtask addto_recipe_sysroot after do_populate_sysroot
>  do_addto_recipe_sysroot[deptask] = "do_populate_sysroot"
> +
> +PATH:prepend = "${COREBASE}/scripts/cross-intercept:"
> diff --git a/scripts/cross-intercept/ar b/scripts/cross-intercept/ar
> new file mode 12
> index 000..bc68ffd7a21
> --- /dev/null
> +++ b/scripts/cross-intercept/ar
> @@ -0,0 +1 @@
> +../native-intercept/ar
> \ No newline at end of file
> diff --git a/scripts/native-intercept/ar b/scripts/native-intercept/ar
> new file mode 100755
> index 000..642b6eae864
> --- /dev/null
> +++ b/scripts/native-intercept/ar
> @@ -0,0 +1,29 @@
> +#!/usr/bin/env python3
> +#
> +# Wrapper around 'ar' that defaults to deterministic archives
> +
> +import os
> +import shutil
> +import sys
> +
> +# calculate path to the real 'ar'
> +path = os.environ['PATH']
> +path = path.replace(os.path.dirname(sys.argv[0]), '')
> +real_ar = shutil.which('ar', path=path)
> +
> +if len(sys.argv) == 1:
> +os.execl(real_ar, 'ar')
> +
> +# modify args to mimic 'ar' configured with --default-deterministic-archives
> +argv = sys.argv
> +if argv[1].startswith('--'):
> +# No modifier given
> +None
> +else:
> +# remove the optional '-'
> +if argv[1][0] == '-':
> +argv[1] = argv[1][1:]
> +argv[1] = argv[1].replace('u', '')
> +argv[1] = 'D' + argv[1]
> +
> +os.execv(real_ar, argv)
> 

What should we do if the user is explicitly passing U, "Do not operate
in deterministic mode." ? Don't replace any 'u' and don't pass D ?

Jacob

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158618): 
https://lists.openembedded.org/g/openembedded-core/message/158618
Mute This Topic: https://lists.openembedded.org/mt/87259014/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] meson: drop redundant patch

2021-11-23 Thread Alexander Kanavin
Sorry, I have to say no. The offending is_debianlike function is still in
place, and I would not want to battle cryptic errors again if it is taken
in use somewhere else. The correct fix is to drop the function itself.

Alex

On Tue, 23 Nov 2021 at 20:39, Ross Burton  wrote:

> This patch disables the debian-detection to use the correct $libdir by
> default on that platform.  However in cross builds this is always
> overridden to be $prefix/lib, and all recipes that inherit meson pass
> the correct libdir explicitly.
>
> Signed-off-by: Ross Burton 
> ---
>  meta/recipes-devtools/meson/meson.inc |  1 -
>  ...01-is_debianlike-always-return-False.patch | 26 ---
>  2 files changed, 27 deletions(-)
>  delete mode 100644
> meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch
>
> diff --git a/meta/recipes-devtools/meson/meson.inc
> b/meta/recipes-devtools/meson/meson.inc
> index f383ad9f74..757295a50a 100644
> --- a/meta/recipes-devtools/meson/meson.inc
> +++ b/meta/recipes-devtools/meson/meson.inc
> @@ -13,7 +13,6 @@ SRC_URI = "
> https://github.com/mesonbuild/meson/releases/download/${PV}/meson-${P
> file://disable-rpath-handling.patch \
> file://0001-Make-CPU-family-warnings-fatal.patch \
> file://0002-Support-building-allarch-recipes-again.patch \
> -   file://0001-is_debianlike-always-return-False.patch \
> "
>  SRC_URI[sha256sum] =
> "5add789c953d984b500858b2851ee3d7add0460cf1a6f852f0a721af17384e13"
>
> diff --git
> a/meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch
> b/meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch
> deleted file mode 100644
> index 83c4782a61..00
> ---
> a/meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch
> +++ /dev/null
> @@ -1,26 +0,0 @@
> -From 667b9ede638677fb37911306937ea62f05897581 Mon Sep 17 00:00:00 2001
> -From: Alexander Kanavin 
> -Date: Mon, 18 Oct 2021 15:55:59 +0200
> -Subject: [PATCH] is_debianlike(): always return False
> -
> -Otherwise, host contamination happens.
> -
> -Upstream-Status: Inappropriate [oe-core specific]
> -Signed-off-by: Alexander Kanavin 
> 
> - mesonbuild/mesonlib/universal.py | 2 +-
> - 1 file changed, 1 insertion(+), 1 deletion(-)
> -
> -diff --git a/mesonbuild/mesonlib/universal.py
> b/mesonbuild/mesonlib/universal.py
> -index d670d04..47d1b52 100644
>  a/mesonbuild/mesonlib/universal.py
> -+++ b/mesonbuild/mesonlib/universal.py
> -@@ -651,7 +651,7 @@ def is_cygwin() -> bool:
> -
> -
> - def is_debianlike() -> bool:
> --return os.path.isfile('/etc/debian_version')
> -+return False
> -
> -
> - def is_dragonflybsd() -> bool:
> --
> 2.25.1
>
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158617): 
https://lists.openembedded.org/g/openembedded-core/message/158617
Mute This Topic: https://lists.openembedded.org/mt/87266402/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] meson: drop redundant patch

2021-11-23 Thread Ross Burton
This patch disables the debian-detection to use the correct $libdir by
default on that platform.  However in cross builds this is always
overridden to be $prefix/lib, and all recipes that inherit meson pass
the correct libdir explicitly.

Signed-off-by: Ross Burton 
---
 meta/recipes-devtools/meson/meson.inc |  1 -
 ...01-is_debianlike-always-return-False.patch | 26 ---
 2 files changed, 27 deletions(-)
 delete mode 100644 
meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch

diff --git a/meta/recipes-devtools/meson/meson.inc 
b/meta/recipes-devtools/meson/meson.inc
index f383ad9f74..757295a50a 100644
--- a/meta/recipes-devtools/meson/meson.inc
+++ b/meta/recipes-devtools/meson/meson.inc
@@ -13,7 +13,6 @@ SRC_URI = 
"https://github.com/mesonbuild/meson/releases/download/${PV}/meson-${P
file://disable-rpath-handling.patch \
file://0001-Make-CPU-family-warnings-fatal.patch \
file://0002-Support-building-allarch-recipes-again.patch \
-   file://0001-is_debianlike-always-return-False.patch \
"
 SRC_URI[sha256sum] = 
"5add789c953d984b500858b2851ee3d7add0460cf1a6f852f0a721af17384e13"
 
diff --git 
a/meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch
 
b/meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch
deleted file mode 100644
index 83c4782a61..00
--- 
a/meta/recipes-devtools/meson/meson/0001-is_debianlike-always-return-False.patch
+++ /dev/null
@@ -1,26 +0,0 @@
-From 667b9ede638677fb37911306937ea62f05897581 Mon Sep 17 00:00:00 2001
-From: Alexander Kanavin 
-Date: Mon, 18 Oct 2021 15:55:59 +0200
-Subject: [PATCH] is_debianlike(): always return False
-
-Otherwise, host contamination happens.
-
-Upstream-Status: Inappropriate [oe-core specific]
-Signed-off-by: Alexander Kanavin 

- mesonbuild/mesonlib/universal.py | 2 +-
- 1 file changed, 1 insertion(+), 1 deletion(-)
-
-diff --git a/mesonbuild/mesonlib/universal.py 
b/mesonbuild/mesonlib/universal.py
-index d670d04..47d1b52 100644
 a/mesonbuild/mesonlib/universal.py
-+++ b/mesonbuild/mesonlib/universal.py
-@@ -651,7 +651,7 @@ def is_cygwin() -> bool:
- 
- 
- def is_debianlike() -> bool:
--return os.path.isfile('/etc/debian_version')
-+return False
- 
- 
- def is_dragonflybsd() -> bool:
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158616): 
https://lists.openembedded.org/g/openembedded-core/message/158616
Mute This Topic: https://lists.openembedded.org/mt/87266402/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCHv3] waffle: add explicit dependency to cmake-native

2021-11-23 Thread Anibal Limon
Hi,

Is this patch good enough? or need another change.

Regards!,
Anibal

On Mon, 15 Nov 2021 at 10:36, Anibal Limon via lists.openembedded.org
 wrote:

> cmake-native can get pulled into the sysroot via dependencies, but it
> is always needed:
>
> | Program cmake found: NO
> | ERROR: meson failed
>
> Fixes,
>
>   ...
> File
> "/home/builds/oe-rpb-master/build-410c/tmp-rpb-glibc/work/cortexa53-linaro-linux/waffle/1.7.0-r0/recipe-sysroot-native/usr/lib/python3.10/site-packages/mesonbuild/modules/cmake.py",
> line 241, in detect_cmake
>   p, stdout, stderr = mesonlib.Popen_safe(cmakebin.get_command() +
> ['--system-information', '-G', 'Ninja'])[0:3]
> File
> "/home/builds/oe-rpb-master/build-410c/tmp-rpb-glibc/work/cortexa53-linaro-linux/waffle/1.7.0-r0/recipe-sysroot-native/usr/lib/python3.10/site-packages/mesonbuild/mesonlib/universal.py",
> line 1397, in Popen_safe
>   p = subprocess.Popen(args, universal_newlines=True, close_fds=False,
> File
> "/home/builds/oe-rpb-master/build-410c/tmp-rpb-glibc/work/cortexa53-linaro-linux/waffle/1.7.0-r0/recipe-sysroot-native/usr/lib/python3.10/subprocess.py",
> line 966, in __init__
>   self._execute_child(args, executable, preexec_fn, close_fds,
> File
> "/home/builds/oe-rpb-master/build-410c/tmp-rpb-glibc/work/cortexa53-linaro-linux/waffle/1.7.0-r0/recipe-sysroot-native/usr/lib/python3.10/subprocess.py",
> line 1717, in _execute_child
>   and os.path.dirname(executable)
> File
> "/home/builds/oe-rpb-master/build-410c/tmp-rpb-glibc/work/cortexa53-linaro-linux/waffle/1.7.0-r0/recipe-sysroot-native/usr/lib/python3.10/posixpath.py",
> line 152, in dirname
>   p = os.fspath(p)
>   ...
>
> Not inherit cmake class because expects meson-log.txt,
>
>   ...
>
>   File: 'exec_func_python() autogenerated', lineno: 2, function: 
>0001:
>*** 0002:meson_do_qa_configure(d)
>0003:
>   File:
> '/home/builds/oe-rpb-master/build-410c/conf/../../layers/openembedded-core/meta/classes/meson.bbclass',
> lineno: 130, function: meson_do_qa_configure
>0126:
>0127:python meson_do_qa_configure() {
>0128:import re
>0129:warn_re = re.compile(r"^WARNING: Cross property (.+) is
> using default value (.+)$", re.MULTILINE)
>*** 0130:with open(d.expand("${B}/meson-logs/meson-log.txt")) as
> logfile:
>0131:log = logfile.read()
>0132:for (prop, value) in warn_re.findall(log):
>0133:bb.warn("Meson cross property %s used without explicit
> assignment, defaulting to %s" % (prop, value))
>0134:}
>   Exception: FileNotFoundError: [Errno 2] No such file or directory:
> '/home/builds/oe-rpb-master/build-410c/tmp-rpb-glibc/work/cortexa53-linaro-linux/waffle/1.7.0-r0/build/meson-logs/meson-log.txt'
>   ...
>
> Signed-off-by: Aníbal Limón 
> ---
>  meta/recipes-graphics/waffle/waffle_1.7.0.bb | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>
> diff --git a/meta/recipes-graphics/waffle/waffle_1.7.0.bb
> b/meta/recipes-graphics/waffle/waffle_1.7.0.bb
> index 6284af3076..ea11309940 100644
> --- a/meta/recipes-graphics/waffle/waffle_1.7.0.bb
> +++ b/meta/recipes-graphics/waffle/waffle_1.7.0.bb
> @@ -17,7 +17,7 @@ S = "${WORKDIR}/git"
>
>  inherit meson features_check lib_package bash-completion pkgconfig
>
> -DEPENDS:append = " python3"
> +DEPENDS:append = " python3 cmake-native"
>
>  # This should be overridden per-machine to reflect the capabilities of
> the GL
>  # stack.
> --
> 2.33.1
>
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158615): 
https://lists.openembedded.org/g/openembedded-core/message/158615
Mute This Topic: https://lists.openembedded.org/mt/87073490/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] glibc: Fix i586/c3 support

2021-11-23 Thread Richard Purdie
On Tue, 2021-11-23 at 09:13 -0800, Khem Raj wrote:
> 
> On 11/23/21 8:55 AM, Richard Purdie wrote:
> > CET can't be enabled on i586 or c3 for x86, adjust the configuration 
> > accordingly
> > to fix those builds.
> > 
> > Signed-off-by: Richard Purdie 
> > ---
> >   meta/recipes-core/glibc/glibc_2.34.bb | 2 +-
> >   1 file changed, 1 insertion(+), 1 deletion(-)
> > 
> > diff --git a/meta/recipes-core/glibc/glibc_2.34.bb 
> > b/meta/recipes-core/glibc/glibc_2.34.bb
> > index 72064772789..7efc1ec1ef7 100644
> > --- a/meta/recipes-core/glibc/glibc_2.34.bb
> > +++ b/meta/recipes-core/glibc/glibc_2.34.bb
> > @@ -90,7 +90,7 @@ EXTRA_OECONF = "--enable-kernel=${OLDEST_KERNEL} \
> >   
> >   EXTRA_OECONF += "${@get_libc_fpu_setting(bb, d)}"
> >   
> > -EXTRA_OECONF:append:x86 = " --enable-cet"
> > +EXTRA_OECONF:append:x86 = " ${@bb.utils.contains_any('TUNE_FEATURES', 
> > 'i586 c3', '--disable-cet', '--enable-cet', d)}"
> 
> does this make glibc tune specific now ?

glibc is compiled so it is already tune specific :)

Cheers,

Richard


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158614): 
https://lists.openembedded.org/g/openembedded-core/message/158614
Mute This Topic: https://lists.openembedded.org/mt/87262863/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [qa-build-notification] [yocto] QA notification for completed autobuilder build (yocto-3.1.12.rc1)

2021-11-23 Thread Richard Purdie
On Tue, 2021-11-23 at 11:54 +, Teoh, Jay Shen wrote:
> This is the full report for yocto-3.1.12.rc1:  
> https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/tree/?h=intel-yocto-testresults
> 
> === Summary 
> No high milestone defects. 
> 
> new issue found 
> 
> Bug 14622 - bsps-hw.bsps-hw.Test_Seek_bar_and_volume_control manual test case 
> failure
>
> === Bugs 
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=14622
> 
> Thanks,
> Jay

Thanks Jay.

The TSC discussed 3.1.12 and are happy for rc1 to be released.

Cheers,

Richard


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158613): 
https://lists.openembedded.org/g/openembedded-core/message/158613
Mute This Topic: https://lists.openembedded.org/mt/87264068/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] glibc: Fix i586/c3 support

2021-11-23 Thread Khem Raj



On 11/23/21 8:55 AM, Richard Purdie wrote:

CET can't be enabled on i586 or c3 for x86, adjust the configuration accordingly
to fix those builds.

Signed-off-by: Richard Purdie 
---
  meta/recipes-core/glibc/glibc_2.34.bb | 2 +-
  1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-core/glibc/glibc_2.34.bb 
b/meta/recipes-core/glibc/glibc_2.34.bb
index 72064772789..7efc1ec1ef7 100644
--- a/meta/recipes-core/glibc/glibc_2.34.bb
+++ b/meta/recipes-core/glibc/glibc_2.34.bb
@@ -90,7 +90,7 @@ EXTRA_OECONF = "--enable-kernel=${OLDEST_KERNEL} \
  
  EXTRA_OECONF += "${@get_libc_fpu_setting(bb, d)}"
  
-EXTRA_OECONF:append:x86 = " --enable-cet"

+EXTRA_OECONF:append:x86 = " ${@bb.utils.contains_any('TUNE_FEATURES', 'i586 c3', 
'--disable-cet', '--enable-cet', d)}"


does this make glibc tune specific now ?


  EXTRA_OECONF:append:x86-64 = " --enable-cet"
  
  PACKAGECONFIG ??= "nscd memory-tagging"







-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158612): 
https://lists.openembedded.org/g/openembedded-core/message/158612
Mute This Topic: https://lists.openembedded.org/mt/87262863/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] glibc: Fix i586/c3 support

2021-11-23 Thread Richard Purdie
CET can't be enabled on i586 or c3 for x86, adjust the configuration accordingly
to fix those builds.

Signed-off-by: Richard Purdie 
---
 meta/recipes-core/glibc/glibc_2.34.bb | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-core/glibc/glibc_2.34.bb 
b/meta/recipes-core/glibc/glibc_2.34.bb
index 72064772789..7efc1ec1ef7 100644
--- a/meta/recipes-core/glibc/glibc_2.34.bb
+++ b/meta/recipes-core/glibc/glibc_2.34.bb
@@ -90,7 +90,7 @@ EXTRA_OECONF = "--enable-kernel=${OLDEST_KERNEL} \
 
 EXTRA_OECONF += "${@get_libc_fpu_setting(bb, d)}"
 
-EXTRA_OECONF:append:x86 = " --enable-cet"
+EXTRA_OECONF:append:x86 = " ${@bb.utils.contains_any('TUNE_FEATURES', 'i586 
c3', '--disable-cet', '--enable-cet', d)}"
 EXTRA_OECONF:append:x86-64 = " --enable-cet"
 
 PACKAGECONFIG ??= "nscd memory-tagging"
-- 
2.32.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158611): 
https://lists.openembedded.org/g/openembedded-core/message/158611
Mute This Topic: https://lists.openembedded.org/mt/87262863/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] Yocto Project Status WW46`21

2021-11-23 Thread Stephen Jolley
Current Dev Position: YP 3.5 M1

Next Deadline: 6th Dec. 2021 YP 3.5 M1 build

 

Next Team Meetings:

*   Bug Triage meeting Thursday Nov. 25th at 7:30am PDT (

https://zoom.us/j/454367603?pwd=ZGxoa2ZXL3FkM3Y0bFd5aVpHVVZ6dz09)
*   Monthly Project Meeting Tuesday Dec. 7th at 8am PDT (

https://zoom.us/j/990892712?pwd=cHU1MjhoM2x6ck81bkcrYjRrcmJsUT09
 )
*   Weekly Engineering Sync Tuesday Nov. 23th at 8am PDT (

https://zoom.us/j/990892712?pwd=cHU1MjhoM2x6ck81bkcrYjRrcmJsUT09
 )
*   Twitch -  See https://www.twitch.tv/theyoctojester

 

Key Status/Updates:

*   YP 3.3.4 was released
*   YP 3.1.12 has been through QA and is pending release approval.
*   YP 3.4.1 is due to be built after the current patchsets are reviewed
and merge.
*   Next week is the Yocto Project Virtual Summit

https://www.yoctoproject.org/yocto-project-summit-2021-11/ and OpenEmbedded
Virtual Developer Meeting on Friday

https://www.openembedded.org/wiki/OEDVM_Nov_2021
*   CVEs in hardknott and dunfell rose this week due to 14 busybox
issues being added. Master remains roughly stable but we need to upgrade
golang to fix some, the other issues in master do not yet have fixes in
upstream (qemu, libarchive and nasm).
*   We continue to see a reduction in the number of patches in "Pending"
state. Many thanks to everyone who has taken the time to review patch status
and handle accordingly, particularly where they were accepted upstream. This
will significantly benefit the project in the long term.
*   Intermittent issues continue to rise and help is very much welcome
on these issues. You can see the list of failures we're continuing to see by
searching for the "AB-INT" tag in bugzilla:

https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

 

Ways to contribute:

*   There are bugs identified as possible for newcomers to the project:

https://wiki.yoctoproject.org/wiki/Newcomers
*   There are bugs that are currently unassigned for YP 3.5. See:

https://wiki.yoctoproject.org/wiki/Bug_Triage#Medium.2B_3.5_Unassigned_Enhan
cements.2FBugs
*   We'd welcome new maintainers for recipes in OE-Core. Please see the
list at:

http://git.yoctoproject.org/cgit.cgi/poky/tree/meta/conf/distro/include/main
tainers.inc and discuss with the existing maintainer, or ask on the OE-Core
mailing list. We will likely move a chunk of these to "Unassigned" soon to
help facilitate this.

 

YP 3.5 Milestone Dates:

*   YP 3.5 M1 build date 2021/12/06
*   YP 3.5 M1 Release date 2021/12/17
*   YP 3.5 M2 build date 2022/01/10
*   YP 3.5 M2 Release date 2022/1/21
*   YP 3.5 M3 build date 2022/2/21
*   YP 3.5 M3 Release date 2022/03/04
*   YP 3.5 M4 build date 2022/04/04
*   YP 3.5 M4 Release date 2022/04/29

 

Upcoming dot releases:

*   YP 3.3.4 is released
*   YP 3.1.12 is out of QA
*   YP 3.4.1 build date 2021/11/22
*   YP 3.4.1 Release date 2021/12/03
*   YP 3.1.13 build date 2021/12/13
*   YP 3.1.13 Release date 2021/12/22
*   YP 3.1.14 build date 2022/01/24
*   YP 3.1.14 Release date 2022/02/04
*   YP 3.4.2 build date 2022/02/07
*   YP 3.4.2 Release date 2022/02/18
*   YP 3.1.15 build date 2022/03/14
*   YP 3.1.15 Release date 2022/03/25
*   YP 3.4.3 build date 2022/03/21
*   YP 3.4.3 Release date 2022/04/01
*   YP 3.1.16 build date 2022/04/25
*   YP 3.1.16 Release date 2022/05/06

 

Tracking Metrics:

*   WDD 2588 (last week 2603) (

https://wiki.yoctoproject.org/charts/combo.html)
*   OE-Core/Poky Patch Metrics

*   Total patches found: 1276 (last week 1271)
*   Patches in the Pending State: 422 (33%) [last week 436 (34%)]

 

The Yocto Project's technical governance is through its Technical Steering
Committee, more information is available at:

 
https://wiki.yoctoproject.org/wiki/TSC

 

The Status reports are now stored on the wiki at:

https://wiki.yoctoproject.org/wiki/Weekly_Status

 

[If anyone has suggestions for other information you'd like to see on this
weekly status update, let us know!]

 

Thanks,

 

Stephen K. Jolley

Yocto Project Program Manager

*Cell:(208) 

[OE-core] [PATCH] go: upgrade 1.16.8 -> 1.16.10

2021-11-23 Thread Pavel Zhukov
From: Pavel Zhukov 

The release includes fixes for CVE-2021-41771 and CVE-2021-41772

Signed-off-by: Pavel Zhukov 
---
 meta/recipes-devtools/go/{go-1.16.8.inc => go-1.16.10.inc}| 4 ++--
 ...go-binary-native_1.16.8.bb => go-binary-native_1.16.10.bb} | 4 ++--
 ...-cross-canadian_1.16.8.bb => go-cross-canadian_1.16.10.bb} | 0
 .../go/{go-cross_1.16.8.bb => go-cross_1.16.10.bb}| 0
 .../go/{go-crosssdk_1.16.8.bb => go-crosssdk_1.16.10.bb}  | 0
 .../go/{go-native_1.16.8.bb => go-native_1.16.10.bb}  | 0
 .../go/{go-runtime_1.16.8.bb => go-runtime_1.16.10.bb}| 0
 meta/recipes-devtools/go/{go_1.16.8.bb => go_1.16.10.bb}  | 0
 8 files changed, 4 insertions(+), 4 deletions(-)
 rename meta/recipes-devtools/go/{go-1.16.8.inc => go-1.16.10.inc} (90%)
 rename meta/recipes-devtools/go/{go-binary-native_1.16.8.bb => 
go-binary-native_1.16.10.bb} (83%)
 rename meta/recipes-devtools/go/{go-cross-canadian_1.16.8.bb => 
go-cross-canadian_1.16.10.bb} (100%)
 rename meta/recipes-devtools/go/{go-cross_1.16.8.bb => go-cross_1.16.10.bb} 
(100%)
 rename meta/recipes-devtools/go/{go-crosssdk_1.16.8.bb => 
go-crosssdk_1.16.10.bb} (100%)
 rename meta/recipes-devtools/go/{go-native_1.16.8.bb => go-native_1.16.10.bb} 
(100%)
 rename meta/recipes-devtools/go/{go-runtime_1.16.8.bb => 
go-runtime_1.16.10.bb} (100%)
 rename meta/recipes-devtools/go/{go_1.16.8.bb => go_1.16.10.bb} (100%)

diff --git a/meta/recipes-devtools/go/go-1.16.8.inc 
b/meta/recipes-devtools/go/go-1.16.10.inc
similarity index 90%
rename from meta/recipes-devtools/go/go-1.16.8.inc
rename to meta/recipes-devtools/go/go-1.16.10.inc
index 925bf46965..7549ffc211 100644
--- a/meta/recipes-devtools/go/go-1.16.8.inc
+++ b/meta/recipes-devtools/go/go-1.16.10.inc
@@ -1,7 +1,7 @@
 require go-common.inc
 
 GO_BASEVERSION = "1.16"
-PV = "1.16.8"
+PV = "1.16.10"
 FILESEXTRAPATHS:prepend := "${FILE_DIRNAME}/go-${GO_BASEVERSION}:"
 
 LIC_FILES_CHKSUM = "file://LICENSE;md5=5d4950ecb7b26d2c5e4e7b4e0dd74707"
@@ -17,7 +17,7 @@ SRC_URI += "\
 file://0008-use-GOBUILDMODE-to-set-buildmode.patch \
 file://0009-Revert-cmd-go-make-sure-CC-and-CXX-are-absolute.patch \
 "
-SRC_URI[main.sha256sum] = 
"8f2a8c24b793375b3243df82fdb0c8387486dcc8a892ca1c991aa99ace086b98"
+SRC_URI[main.sha256sum] = 
"a905472011585e403d00d2a41de7ced29b8884309d73482a307f689fd0f320b5"
 
 # Upstream don't believe it is a signifiant real world issue and will only
 # fix in 1.17 onwards where we can drop this.
diff --git a/meta/recipes-devtools/go/go-binary-native_1.16.8.bb 
b/meta/recipes-devtools/go/go-binary-native_1.16.10.bb
similarity index 83%
rename from meta/recipes-devtools/go/go-binary-native_1.16.8.bb
rename to meta/recipes-devtools/go/go-binary-native_1.16.10.bb
index 926222089d..4866c9f847 100644
--- a/meta/recipes-devtools/go/go-binary-native_1.16.8.bb
+++ b/meta/recipes-devtools/go/go-binary-native_1.16.10.bb
@@ -8,8 +8,8 @@ LIC_FILES_CHKSUM = 
"file://LICENSE;md5=5d4950ecb7b26d2c5e4e7b4e0dd74707"
 PROVIDES = "go-native"
 
 SRC_URI = 
"https://dl.google.com/go/go${PV}.${BUILD_GOOS}-${BUILD_GOARCH}.tar.gz;name=go_${BUILD_GOTUPLE};
-SRC_URI[go_linux_amd64.sha256sum] = 
"f32501aeb8b7b723bc7215f6c373abb6981bbc7e1c7b44e9f07317e1a300dce2"
-SRC_URI[go_linux_arm64.sha256sum] = 
"430dbe185417204f6788913197ab3b189b6deae9c9b524f262858e53dab239c2"
+SRC_URI[go_linux_amd64.sha256sum] = 
"414cd18ce1d193769b9e97d2401ad718755ab47816e13b2a1cde203d263b55cf"
+SRC_URI[go_linux_arm64.sha256sum] = 
"bfe1d4b82626c742b4690a832ca59a21e3d702161556f3c0ed26dffb368927e9"
 
 UPSTREAM_CHECK_URI = "https://golang.org/dl/;
 UPSTREAM_CHECK_REGEX = "go(?P\d+(\.\d+)+)\.linux"
diff --git a/meta/recipes-devtools/go/go-cross-canadian_1.16.8.bb 
b/meta/recipes-devtools/go/go-cross-canadian_1.16.10.bb
similarity index 100%
rename from meta/recipes-devtools/go/go-cross-canadian_1.16.8.bb
rename to meta/recipes-devtools/go/go-cross-canadian_1.16.10.bb
diff --git a/meta/recipes-devtools/go/go-cross_1.16.8.bb 
b/meta/recipes-devtools/go/go-cross_1.16.10.bb
similarity index 100%
rename from meta/recipes-devtools/go/go-cross_1.16.8.bb
rename to meta/recipes-devtools/go/go-cross_1.16.10.bb
diff --git a/meta/recipes-devtools/go/go-crosssdk_1.16.8.bb 
b/meta/recipes-devtools/go/go-crosssdk_1.16.10.bb
similarity index 100%
rename from meta/recipes-devtools/go/go-crosssdk_1.16.8.bb
rename to meta/recipes-devtools/go/go-crosssdk_1.16.10.bb
diff --git a/meta/recipes-devtools/go/go-native_1.16.8.bb 
b/meta/recipes-devtools/go/go-native_1.16.10.bb
similarity index 100%
rename from meta/recipes-devtools/go/go-native_1.16.8.bb
rename to meta/recipes-devtools/go/go-native_1.16.10.bb
diff --git a/meta/recipes-devtools/go/go-runtime_1.16.8.bb 
b/meta/recipes-devtools/go/go-runtime_1.16.10.bb
similarity index 100%
rename from meta/recipes-devtools/go/go-runtime_1.16.8.bb
rename to meta/recipes-devtools/go/go-runtime_1.16.10.bb
diff --git a/meta/recipes-devtools/go/go_1.16.8.bb 
b/meta/recipes-devtools/go/go_1.16.10.bb

Re: [OE-core] [PATCH] buildhistory: Fix do_package race issues

2021-11-23 Thread Alexander Kanavin
Thanks Richard, this should remove occasional false failures from AUH runs
:)

Alex

On Tue, 23 Nov 2021 at 14:59, Richard Purdie <
richard.pur...@linuxfoundation.org> wrote:

> The buildhistory_list_pkg_files function uses data from do_package, not
> do_packagedata. Usally the two are restored together but it may see
> a half complete directory or other races issues depending on timing.
>
> Rework the function so that it uses the correct task dependencies. This
> should avoid races but means the data is only restored to buildhistory
> if the do_package or do_package_setscene tasks are restored.
>
> Signed-off-by: Richard Purdie 
> ---
>  meta/classes/buildhistory.bbclass | 12 
>  1 file changed, 8 insertions(+), 4 deletions(-)
>
> diff --git a/meta/classes/buildhistory.bbclass
> b/meta/classes/buildhistory.bbclass
> index 64df432f136..daa96f3b63b 100644
> --- a/meta/classes/buildhistory.bbclass
> +++ b/meta/classes/buildhistory.bbclass
> @@ -91,13 +91,19 @@ buildhistory_emit_sysroot() {
>  python buildhistory_emit_pkghistory() {
>  if d.getVar('BB_CURRENTTASK') in ['populate_sysroot',
> 'populate_sysroot_setscene']:
>  bb.build.exec_func("buildhistory_emit_sysroot", d)
> -
> -if not d.getVar('BB_CURRENTTASK') in ['packagedata',
> 'packagedata_setscene']:
>  return 0
>
>  if not "package" in (d.getVar('BUILDHISTORY_FEATURES') or "").split():
>  return 0
>
> +if d.getVar('BB_CURRENTTASK') in ['package', 'package_setscene']:
> +# Create files-in-.txt files containing a list of
> files of each recipe's package
> +bb.build.exec_func("buildhistory_list_pkg_files", d)
> +return 0
> +
> +if not d.getVar('BB_CURRENTTASK') in ['packagedata',
> 'packagedata_setscene']:
> +return 0
> +
>  import re
>  import json
>  import shlex
> @@ -319,8 +325,6 @@ python buildhistory_emit_pkghistory() {
>
>  write_pkghistory(pkginfo, d)
>
> -# Create files-in-.txt files containing a list of files
> of each recipe's package
> -bb.build.exec_func("buildhistory_list_pkg_files", d)
>  oe.qa.exit_if_errors(d)
>  }
>
> --
> 2.32.0
>
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158608): 
https://lists.openembedded.org/g/openembedded-core/message/158608
Mute This Topic: https://lists.openembedded.org/mt/87258776/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] native/cross: Add ar wrapper for determinism

2021-11-23 Thread Richard Purdie
From: Jacob Kroon 

Add a wrapper around ar calls for native/cross recipes. This wrapper adds
the -D option so that deterministic archives are built for native/cross
output. This improves the changes of hash equivalence matches and hence
build artefact reuse.

We don't need this in the target case since we compile binutils-cross
with an option making this the default. We need a wrapper since we need
to remove the "u" option and replace it with "D" but also allow things like
"--version" to continue to work too.

Signed-off-by: Jacob Kroon 
Signed-off-by: Richard Purdie 
---
 meta/classes/cross.bbclass  |  2 ++
 scripts/cross-intercept/ar  |  1 +
 scripts/native-intercept/ar | 29 +
 3 files changed, 32 insertions(+)
 create mode 12 scripts/cross-intercept/ar
 create mode 100755 scripts/native-intercept/ar

diff --git a/meta/classes/cross.bbclass b/meta/classes/cross.bbclass
index 3e6a2f60b9e..9d951076a78 100644
--- a/meta/classes/cross.bbclass
+++ b/meta/classes/cross.bbclass
@@ -93,3 +93,5 @@ python do_addto_recipe_sysroot () {
 }
 addtask addto_recipe_sysroot after do_populate_sysroot
 do_addto_recipe_sysroot[deptask] = "do_populate_sysroot"
+
+PATH:prepend = "${COREBASE}/scripts/cross-intercept:"
diff --git a/scripts/cross-intercept/ar b/scripts/cross-intercept/ar
new file mode 12
index 000..bc68ffd7a21
--- /dev/null
+++ b/scripts/cross-intercept/ar
@@ -0,0 +1 @@
+../native-intercept/ar
\ No newline at end of file
diff --git a/scripts/native-intercept/ar b/scripts/native-intercept/ar
new file mode 100755
index 000..642b6eae864
--- /dev/null
+++ b/scripts/native-intercept/ar
@@ -0,0 +1,29 @@
+#!/usr/bin/env python3
+#
+# Wrapper around 'ar' that defaults to deterministic archives
+
+import os
+import shutil
+import sys
+
+# calculate path to the real 'ar'
+path = os.environ['PATH']
+path = path.replace(os.path.dirname(sys.argv[0]), '')
+real_ar = shutil.which('ar', path=path)
+
+if len(sys.argv) == 1:
+os.execl(real_ar, 'ar')
+
+# modify args to mimic 'ar' configured with --default-deterministic-archives
+argv = sys.argv
+if argv[1].startswith('--'):
+# No modifier given
+None
+else:
+# remove the optional '-'
+if argv[1][0] == '-':
+argv[1] = argv[1][1:]
+argv[1] = argv[1].replace('u', '')
+argv[1] = 'D' + argv[1]
+
+os.execv(real_ar, argv)
-- 
2.32.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158607): 
https://lists.openembedded.org/g/openembedded-core/message/158607
Mute This Topic: https://lists.openembedded.org/mt/87259014/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] bitbake.conf: Pass -D option to ranlib for determisim

2021-11-23 Thread Richard Purdie
Add the -D option to BUILD_RANLIB so that deterministic archives
are built for native/cross output. This improves the changes of hash
equivalence matches and hence build artefact reuse.

We don't need this in the target case since we compile binutils-cross
with an option making this the default.

Signed-off-by: Richard Purdie 
---
 meta/conf/bitbake.conf | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 71c1e52ad63..fba99e8f0cd 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -542,7 +542,7 @@ export BUILD_LD = "${BUILD_PREFIX}ld ${BUILD_LD_ARCH}"
 export BUILD_CCLD = "${BUILD_PREFIX}gcc ${BUILD_CC_ARCH}"
 export BUILD_AR = "${BUILD_PREFIX}ar"
 export BUILD_AS = "${BUILD_PREFIX}as ${BUILD_AS_ARCH}"
-export BUILD_RANLIB = "${BUILD_PREFIX}ranlib"
+export BUILD_RANLIB = "${BUILD_PREFIX}ranlib -D"
 export BUILD_STRIP = "${BUILD_PREFIX}strip"
 BUILD_OBJCOPY = "${BUILD_PREFIX}objcopy"
 BUILD_OBJDUMP = "${BUILD_PREFIX}objdump"
-- 
2.32.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158606): 
https://lists.openembedded.org/g/openembedded-core/message/158606
Mute This Topic: https://lists.openembedded.org/mt/87258930/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] bitbake.conf: Pass -D option to ranlib for determisim

2021-11-23 Thread Richard Purdie
Add the -D option to BUILD_RANLIB so that deterministic archives
are built for native/cross output. This improves the changes of hash
equivalence matches and hence build artefact reuse.

We don't need this in the target case since we compile binutils-cross
with an option making this the default.

Signed-off-by: Richard Purdie 
---
 meta/conf/bitbake.conf | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 71c1e52ad63..fba99e8f0cd 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -542,7 +542,7 @@ export BUILD_LD = "${BUILD_PREFIX}ld ${BUILD_LD_ARCH}"
 export BUILD_CCLD = "${BUILD_PREFIX}gcc ${BUILD_CC_ARCH}"
 export BUILD_AR = "${BUILD_PREFIX}ar"
 export BUILD_AS = "${BUILD_PREFIX}as ${BUILD_AS_ARCH}"
-export BUILD_RANLIB = "${BUILD_PREFIX}ranlib"
+export BUILD_RANLIB = "${BUILD_PREFIX}ranlib -D"
 export BUILD_STRIP = "${BUILD_PREFIX}strip"
 BUILD_OBJCOPY = "${BUILD_PREFIX}objcopy"
 BUILD_OBJDUMP = "${BUILD_PREFIX}objdump"
-- 
2.32.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158605): 
https://lists.openembedded.org/g/openembedded-core/message/158605
Mute This Topic: https://lists.openembedded.org/mt/87258930/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe][OE-core][Patch 0/2] perf: sort-pmuevents: some fixes

2021-11-23 Thread Bruce Ashfield
On Tue, Nov 23, 2021 at 8:58 AM Max Krummenacher  wrote:
>
> Let me know if there is anything I can do/provide from my side.
> I know you already did, but does 'bitbake perf -c cleansstate' help?

The builds were clean, but to rule out old artifacts, I just started a
new build on a separate server, without my normal sstate sharing
configuration. Fingers crossed :D

Bruce

>
> Max
>
> On Tue, Nov 23, 2021 at 2:55 PM Bruce Ashfield  
> wrote:
> >
> > On Tue, Nov 23, 2021 at 8:48 AM Max Krummenacher  
> > wrote:
> > >
> > > Hi Bruce,
> > >
> > > On Tue, Nov 23, 2021 at 2:41 AM Bruce Ashfield  
> > > wrote:
> > > >
> > > > On Mon, Nov 22, 2021 at 11:35 AM Max Krummenacher 
> > > >  wrote:
> > > > >
> > > > > I am trying out a kernel recipe using linux master, 5.16-rc2. I found
> > > > > that perf fails to build in do_compile with such a setup.
> > > > > Root cause is that the kernel did add 'static' and 'const' to the
> > > > > arrays of structs which sort-pmuevents does sort.
> > > > > This is addressed in the second commit.
> > > > >
> > > > > While at it I noticed that there are some struct arrays which neither
> > > > > have a name or cpuid element with 1 array element. That 1 element was
> > > > > dropped. I did not verify if that causes any issues at runtime, 
> > > > > however
> > > > > that behaviour was improved with the first commit.
> > > >
> > > > What MACHINE were you testing against ? When I build perf against my
> > > > -rc2 dev kernel, I still run into the build issues with these commits
> > > > in place.
> > > >
> > > > I just want to make sure that I'm not seeing something different .. so
> > > > I can do some runs against a similar config as you are using.
> > > >
> > >
> > > I did the inital work against a Toradex machine, apalis-imx6.
> > > However I built before sending the patches with qemuarm64 qemuarm 
> > > qemux86-64
> > > with the following modification to use my 'master' kernel recipe:
> > > +PREFERRED_PROVIDER_virtual/kernel = "linux-toradex-mainline"
> > > +KBUILD_DEFCONFIG:arm = "tegra_defconfig"
> > > +KBUILD_DEFCONFIG:aarch64 = "defconfig"
> > > +KBUILD_DEFCONFIG:qemux86-64 = "x86_64_defconfig"
> > >
> > > I tried again. With the patches perf builds for all three machines,
> > > reverting the patches and it fails again.
> > > The x86 compiles forever, for the two ARM machines I get:
> > > ...
> > > Traceback (most recent call last):
> > >   File 
> > > "/build/krm/oe-core_master/build/tmp/work/qemuarm64-tdx-linux/perf/1.0-r9/perf-1.0/sort-pmuevents.py",
> > > line 83, in 
> > > print( preamble.group(1) )
> > > AttributeError: 'NoneType' object has no attribute 'group'
> >
> > Definitely still fails here for some of my configurations. I'll look
> > into it more today, and see if there's something in my reference
> > kernel configurations that are causing it.
> >
> > I need to sort this out, and can put it in a queue with my -dev
> > upgrades to 5.16, since without those version bumps, we have nothing
> > in core that exercises the change.
> >
> > Cheers,
> >
> > Bruce
> >
> > > ...
> > >
> > > Max
> > >
> > > >
> > > > >
> > > > > Note that the kernel itself doesn't build either as after 5.15 it now
> > > > > does try to run the dt_binding_check for which the kernel recipe does
> > > > > not provide whatever stuff is needed.
> > > > > I just did a revert patch for commit 53182e81f47d ("kbuild: Enable
> > > > > DT schema checks for %.dtb targets") to get over that.
> > > > >
> > > > > Max Krummenacher (2):
> > > > >   perf: sort-pmuevents: don't drop elements
> > > > >   perf: sort-pmuevents: allow for additional type qualifiers and 
> > > > > storage
> > > > > class
> > > > >
> > > > >  .../perf/perf/sort-pmuevents.py   | 28 
> > > > > +++
> > > > >  1 file changed, 16 insertions(+), 12 deletions(-)
> > > > >
> > > > > --
> > > > > 2.20.1
> > > > >
> > > >
> > > >
> > > > --
> > > > - Thou shalt not follow the NULL pointer, for chaos and madness await
> > > > thee at its end
> > > > - "Use the force Harry" - Gandalf, Star Trek II
> >
> >
> >
> > --
> > - Thou shalt not follow the NULL pointer, for chaos and madness await
> > thee at its end
> > - "Use the force Harry" - Gandalf, Star Trek II



-- 
- Thou shalt not follow the NULL pointer, for chaos and madness await
thee at its end
- "Use the force Harry" - Gandalf, Star Trek II

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158604): 
https://lists.openembedded.org/g/openembedded-core/message/158604
Mute This Topic: https://lists.openembedded.org/mt/87238903/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] buildhistory: Fix do_package race issues

2021-11-23 Thread Richard Purdie
The buildhistory_list_pkg_files function uses data from do_package, not
do_packagedata. Usally the two are restored together but it may see
a half complete directory or other races issues depending on timing.

Rework the function so that it uses the correct task dependencies. This
should avoid races but means the data is only restored to buildhistory
if the do_package or do_package_setscene tasks are restored.

Signed-off-by: Richard Purdie 
---
 meta/classes/buildhistory.bbclass | 12 
 1 file changed, 8 insertions(+), 4 deletions(-)

diff --git a/meta/classes/buildhistory.bbclass 
b/meta/classes/buildhistory.bbclass
index 64df432f136..daa96f3b63b 100644
--- a/meta/classes/buildhistory.bbclass
+++ b/meta/classes/buildhistory.bbclass
@@ -91,13 +91,19 @@ buildhistory_emit_sysroot() {
 python buildhistory_emit_pkghistory() {
 if d.getVar('BB_CURRENTTASK') in ['populate_sysroot', 
'populate_sysroot_setscene']:
 bb.build.exec_func("buildhistory_emit_sysroot", d)
-
-if not d.getVar('BB_CURRENTTASK') in ['packagedata', 
'packagedata_setscene']:
 return 0
 
 if not "package" in (d.getVar('BUILDHISTORY_FEATURES') or "").split():
 return 0
 
+if d.getVar('BB_CURRENTTASK') in ['package', 'package_setscene']:
+# Create files-in-.txt files containing a list of files 
of each recipe's package
+bb.build.exec_func("buildhistory_list_pkg_files", d)
+return 0
+
+if not d.getVar('BB_CURRENTTASK') in ['packagedata', 
'packagedata_setscene']:
+return 0
+
 import re
 import json
 import shlex
@@ -319,8 +325,6 @@ python buildhistory_emit_pkghistory() {
 
 write_pkghistory(pkginfo, d)
 
-# Create files-in-.txt files containing a list of files of 
each recipe's package
-bb.build.exec_func("buildhistory_list_pkg_files", d)
 oe.qa.exit_if_errors(d)
 }
 
-- 
2.32.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158603): 
https://lists.openembedded.org/g/openembedded-core/message/158603
Mute This Topic: https://lists.openembedded.org/mt/87258776/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe][OE-core][Patch 0/2] perf: sort-pmuevents: some fixes

2021-11-23 Thread Max Krummenacher
Let me know if there is anything I can do/provide from my side.
I know you already did, but does 'bitbake perf -c cleansstate' help?

Max

On Tue, Nov 23, 2021 at 2:55 PM Bruce Ashfield  wrote:
>
> On Tue, Nov 23, 2021 at 8:48 AM Max Krummenacher  wrote:
> >
> > Hi Bruce,
> >
> > On Tue, Nov 23, 2021 at 2:41 AM Bruce Ashfield  
> > wrote:
> > >
> > > On Mon, Nov 22, 2021 at 11:35 AM Max Krummenacher  
> > > wrote:
> > > >
> > > > I am trying out a kernel recipe using linux master, 5.16-rc2. I found
> > > > that perf fails to build in do_compile with such a setup.
> > > > Root cause is that the kernel did add 'static' and 'const' to the
> > > > arrays of structs which sort-pmuevents does sort.
> > > > This is addressed in the second commit.
> > > >
> > > > While at it I noticed that there are some struct arrays which neither
> > > > have a name or cpuid element with 1 array element. That 1 element was
> > > > dropped. I did not verify if that causes any issues at runtime, however
> > > > that behaviour was improved with the first commit.
> > >
> > > What MACHINE were you testing against ? When I build perf against my
> > > -rc2 dev kernel, I still run into the build issues with these commits
> > > in place.
> > >
> > > I just want to make sure that I'm not seeing something different .. so
> > > I can do some runs against a similar config as you are using.
> > >
> >
> > I did the inital work against a Toradex machine, apalis-imx6.
> > However I built before sending the patches with qemuarm64 qemuarm qemux86-64
> > with the following modification to use my 'master' kernel recipe:
> > +PREFERRED_PROVIDER_virtual/kernel = "linux-toradex-mainline"
> > +KBUILD_DEFCONFIG:arm = "tegra_defconfig"
> > +KBUILD_DEFCONFIG:aarch64 = "defconfig"
> > +KBUILD_DEFCONFIG:qemux86-64 = "x86_64_defconfig"
> >
> > I tried again. With the patches perf builds for all three machines,
> > reverting the patches and it fails again.
> > The x86 compiles forever, for the two ARM machines I get:
> > ...
> > Traceback (most recent call last):
> >   File 
> > "/build/krm/oe-core_master/build/tmp/work/qemuarm64-tdx-linux/perf/1.0-r9/perf-1.0/sort-pmuevents.py",
> > line 83, in 
> > print( preamble.group(1) )
> > AttributeError: 'NoneType' object has no attribute 'group'
>
> Definitely still fails here for some of my configurations. I'll look
> into it more today, and see if there's something in my reference
> kernel configurations that are causing it.
>
> I need to sort this out, and can put it in a queue with my -dev
> upgrades to 5.16, since without those version bumps, we have nothing
> in core that exercises the change.
>
> Cheers,
>
> Bruce
>
> > ...
> >
> > Max
> >
> > >
> > > >
> > > > Note that the kernel itself doesn't build either as after 5.15 it now
> > > > does try to run the dt_binding_check for which the kernel recipe does
> > > > not provide whatever stuff is needed.
> > > > I just did a revert patch for commit 53182e81f47d ("kbuild: Enable
> > > > DT schema checks for %.dtb targets") to get over that.
> > > >
> > > > Max Krummenacher (2):
> > > >   perf: sort-pmuevents: don't drop elements
> > > >   perf: sort-pmuevents: allow for additional type qualifiers and storage
> > > > class
> > > >
> > > >  .../perf/perf/sort-pmuevents.py   | 28 +++
> > > >  1 file changed, 16 insertions(+), 12 deletions(-)
> > > >
> > > > --
> > > > 2.20.1
> > > >
> > >
> > >
> > > --
> > > - Thou shalt not follow the NULL pointer, for chaos and madness await
> > > thee at its end
> > > - "Use the force Harry" - Gandalf, Star Trek II
>
>
>
> --
> - Thou shalt not follow the NULL pointer, for chaos and madness await
> thee at its end
> - "Use the force Harry" - Gandalf, Star Trek II

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158602): 
https://lists.openembedded.org/g/openembedded-core/message/158602
Mute This Topic: https://lists.openembedded.org/mt/87238903/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe][OE-core][Patch 0/2] perf: sort-pmuevents: some fixes

2021-11-23 Thread Bruce Ashfield
On Tue, Nov 23, 2021 at 8:48 AM Max Krummenacher  wrote:
>
> Hi Bruce,
>
> On Tue, Nov 23, 2021 at 2:41 AM Bruce Ashfield  
> wrote:
> >
> > On Mon, Nov 22, 2021 at 11:35 AM Max Krummenacher  
> > wrote:
> > >
> > > I am trying out a kernel recipe using linux master, 5.16-rc2. I found
> > > that perf fails to build in do_compile with such a setup.
> > > Root cause is that the kernel did add 'static' and 'const' to the
> > > arrays of structs which sort-pmuevents does sort.
> > > This is addressed in the second commit.
> > >
> > > While at it I noticed that there are some struct arrays which neither
> > > have a name or cpuid element with 1 array element. That 1 element was
> > > dropped. I did not verify if that causes any issues at runtime, however
> > > that behaviour was improved with the first commit.
> >
> > What MACHINE were you testing against ? When I build perf against my
> > -rc2 dev kernel, I still run into the build issues with these commits
> > in place.
> >
> > I just want to make sure that I'm not seeing something different .. so
> > I can do some runs against a similar config as you are using.
> >
>
> I did the inital work against a Toradex machine, apalis-imx6.
> However I built before sending the patches with qemuarm64 qemuarm qemux86-64
> with the following modification to use my 'master' kernel recipe:
> +PREFERRED_PROVIDER_virtual/kernel = "linux-toradex-mainline"
> +KBUILD_DEFCONFIG:arm = "tegra_defconfig"
> +KBUILD_DEFCONFIG:aarch64 = "defconfig"
> +KBUILD_DEFCONFIG:qemux86-64 = "x86_64_defconfig"
>
> I tried again. With the patches perf builds for all three machines,
> reverting the patches and it fails again.
> The x86 compiles forever, for the two ARM machines I get:
> ...
> Traceback (most recent call last):
>   File 
> "/build/krm/oe-core_master/build/tmp/work/qemuarm64-tdx-linux/perf/1.0-r9/perf-1.0/sort-pmuevents.py",
> line 83, in 
> print( preamble.group(1) )
> AttributeError: 'NoneType' object has no attribute 'group'

Definitely still fails here for some of my configurations. I'll look
into it more today, and see if there's something in my reference
kernel configurations that are causing it.

I need to sort this out, and can put it in a queue with my -dev
upgrades to 5.16, since without those version bumps, we have nothing
in core that exercises the change.

Cheers,

Bruce

> ...
>
> Max
>
> >
> > >
> > > Note that the kernel itself doesn't build either as after 5.15 it now
> > > does try to run the dt_binding_check for which the kernel recipe does
> > > not provide whatever stuff is needed.
> > > I just did a revert patch for commit 53182e81f47d ("kbuild: Enable
> > > DT schema checks for %.dtb targets") to get over that.
> > >
> > > Max Krummenacher (2):
> > >   perf: sort-pmuevents: don't drop elements
> > >   perf: sort-pmuevents: allow for additional type qualifiers and storage
> > > class
> > >
> > >  .../perf/perf/sort-pmuevents.py   | 28 +++
> > >  1 file changed, 16 insertions(+), 12 deletions(-)
> > >
> > > --
> > > 2.20.1
> > >
> >
> >
> > --
> > - Thou shalt not follow the NULL pointer, for chaos and madness await
> > thee at its end
> > - "Use the force Harry" - Gandalf, Star Trek II



-- 
- Thou shalt not follow the NULL pointer, for chaos and madness await
thee at its end
- "Use the force Harry" - Gandalf, Star Trek II

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158601): 
https://lists.openembedded.org/g/openembedded-core/message/158601
Mute This Topic: https://lists.openembedded.org/mt/87238903/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe][OE-core][Patch 0/2] perf: sort-pmuevents: some fixes

2021-11-23 Thread Max Krummenacher
Hi Bruce,

On Tue, Nov 23, 2021 at 2:41 AM Bruce Ashfield  wrote:
>
> On Mon, Nov 22, 2021 at 11:35 AM Max Krummenacher  
> wrote:
> >
> > I am trying out a kernel recipe using linux master, 5.16-rc2. I found
> > that perf fails to build in do_compile with such a setup.
> > Root cause is that the kernel did add 'static' and 'const' to the
> > arrays of structs which sort-pmuevents does sort.
> > This is addressed in the second commit.
> >
> > While at it I noticed that there are some struct arrays which neither
> > have a name or cpuid element with 1 array element. That 1 element was
> > dropped. I did not verify if that causes any issues at runtime, however
> > that behaviour was improved with the first commit.
>
> What MACHINE were you testing against ? When I build perf against my
> -rc2 dev kernel, I still run into the build issues with these commits
> in place.
>
> I just want to make sure that I'm not seeing something different .. so
> I can do some runs against a similar config as you are using.
>

I did the inital work against a Toradex machine, apalis-imx6.
However I built before sending the patches with qemuarm64 qemuarm qemux86-64
with the following modification to use my 'master' kernel recipe:
+PREFERRED_PROVIDER_virtual/kernel = "linux-toradex-mainline"
+KBUILD_DEFCONFIG:arm = "tegra_defconfig"
+KBUILD_DEFCONFIG:aarch64 = "defconfig"
+KBUILD_DEFCONFIG:qemux86-64 = "x86_64_defconfig"

I tried again. With the patches perf builds for all three machines,
reverting the patches and it fails again.
The x86 compiles forever, for the two ARM machines I get:
...
Traceback (most recent call last):
  File 
"/build/krm/oe-core_master/build/tmp/work/qemuarm64-tdx-linux/perf/1.0-r9/perf-1.0/sort-pmuevents.py",
line 83, in 
print( preamble.group(1) )
AttributeError: 'NoneType' object has no attribute 'group'
...

Max

>
> >
> > Note that the kernel itself doesn't build either as after 5.15 it now
> > does try to run the dt_binding_check for which the kernel recipe does
> > not provide whatever stuff is needed.
> > I just did a revert patch for commit 53182e81f47d ("kbuild: Enable
> > DT schema checks for %.dtb targets") to get over that.
> >
> > Max Krummenacher (2):
> >   perf: sort-pmuevents: don't drop elements
> >   perf: sort-pmuevents: allow for additional type qualifiers and storage
> > class
> >
> >  .../perf/perf/sort-pmuevents.py   | 28 +++
> >  1 file changed, 16 insertions(+), 12 deletions(-)
> >
> > --
> > 2.20.1
> >
>
>
> --
> - Thou shalt not follow the NULL pointer, for chaos and madness await
> thee at its end
> - "Use the force Harry" - Gandalf, Star Trek II

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158600): 
https://lists.openembedded.org/g/openembedded-core/message/158600
Mute This Topic: https://lists.openembedded.org/mt/87238903/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [yocto] QA notification for completed autobuilder build (yocto-3.1.12.rc1)

2021-11-23 Thread Teoh, Jay Shen
Hi all,

This is the full report for yocto-3.1.12.rc1:  
https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/tree/?h=intel-yocto-testresults

=== Summary 
No high milestone defects. 

new issue found 

Bug 14622 - bsps-hw.bsps-hw.Test_Seek_bar_and_volume_control manual test case 
failure
   
=== Bugs 
https://bugzilla.yoctoproject.org/show_bug.cgi?id=14622

Thanks,
Jay

>-Original Message-
>From: yo...@lists.yoctoproject.org  On Behalf
>Of Richard Purdie
>Sent: Wednesday, 17 November, 2021 6:25 AM
>To:  
>Cc: qa-build-notification 
>Subject: [yocto] QA notification for completed autobuilder build (yocto-
>3.1.12.rc1)
>
>A build flagged for QA (yocto-3.1.12.rc1) was completed on the autobuilder and 
>is
>available at:
>
>
>https://autobuilder.yocto.io/pub/releases/yocto-3.1.12.rc1
>
>
>Build hash information:
>
>bitbake: c0348de8121c3a842bf44906f7e2f79e93f7275b
>meta-agl: 0406cbb235fb08ce9e6f9d07e64e0932b20050a9
>meta-arm: ce535dfb96de4d2529f091d7d85a7172c626001c
>meta-aws: 2f72301f5a73279c4d2f12fc6218876629666e06
>meta-gplv2: 60b251c25ba87e946a0ca4cdc8d17b1cb09292ac
>meta-intel: 625da85e7b01b71cc310267b0ba7119eb139e9f7
>meta-mingw: 524de686205b5d6736661d4532f5f98fee8589b7
>meta-openembedded: 7889158dcd187546fc5e99fd81d0779cad3e8d17
>oecore: 44b1970c40e9d73f6e63fb10cdc55837a26f5921
>poky: 0839888394a6e42e96f9f0d201376eb38bc79b24
>
>
>
>This is an automated message from the Yocto Project Autobuilder
>Git: git://git.yoctoproject.org/yocto-autobuilder2
>Email: richard.pur...@linuxfoundation.org
>


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158599): 
https://lists.openembedded.org/g/openembedded-core/message/158599
Mute This Topic: https://lists.openembedded.org/mt/87135613/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [docs] [PATCH] dev-manual: how to purge duplicate sstate cache files

2021-11-23 Thread Michael Opdenacker
Greetings,

On 11/19/21 5:06 PM, Michael Opdenacker wrote:
> Signed-off-by: Michael Opdenacker 
> ---
>  documentation/dev-manual/common-tasks.rst | 25 ++-
>  1 file changed, 24 insertions(+), 1 deletion(-)
>
> diff --git a/documentation/dev-manual/common-tasks.rst 
> b/documentation/dev-manual/common-tasks.rst
> index 3eead147a3..37612c84b7 100644
> --- a/documentation/dev-manual/common-tasks.rst
> +++ b/documentation/dev-manual/common-tasks.rst
> @@ -6242,8 +6242,11 @@ Changing the listed common targets is as easy as 
> editing your version of
>  ``conf-notes.txt`` in your custom template configuration directory and
>  making sure you have ``TEMPLATECONF`` set to your directory.
>  
> +Conserving Disk Space
> +=
> +
>  Conserving Disk Space During Builds
> -===
> +---
>  
>  To help conserve disk space during builds, you can add the following
>  statement to your project's ``local.conf`` configuration file found in
> @@ -6257,6 +6260,26 @@ building a recipe once the recipe is built. For more 
> information on
>  :ref:`rm_work ` class in the
>  Yocto Project Reference Manual.
>  
> +Purging Duplicate Shared State Cache Files
> +---
> +
> +After multiple build iterations, the Shared State (sstate) cache can contain
> +duplicate cache files for a given package, while only the most recent one
> +is likely to be reusable. The following command purges all but the
> +newest sstate cache file for each package::
> +
> +   sstate-cache-management.sh --remove-duplicated 
> --cache-dir=build/sstate-cache
> +
> +This command will ask you to confirm the deletions it identifies.
> +
> +Note::
> +
> +   The duplicated sstate cache files of one package must have the same
> +   architecture, which means that sstate cache files with multiple
> +   architectures are not considered as duplicate.
> +
> +Run ``sstate-cache-management.sh`` for more details about this script.
> +
>  Working with Packages
>  =
>  

Did anyone have time to have a look at what I wrote ? There may be
better ways to purge the sstate cache files.
Thanks in advance
Michael.

-- 
Michael Opdenacker, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158598): 
https://lists.openembedded.org/g/openembedded-core/message/158598
Mute This Topic: https://lists.openembedded.org/mt/87255323/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] wic: support rootdev identified by partition label

2021-11-23 Thread Schmidt, Adriaan
We already support specifying the rootfs by PARTUUID. This adds general
support for letting the kernel find the rootfs by PARTLABEL.

Signed-off-by: Adriaan Schmidt 
---
 scripts/lib/wic/plugins/imager/direct.py | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/scripts/lib/wic/plugins/imager/direct.py 
b/scripts/lib/wic/plugins/imager/direct.py
index c7bc2469ab..35fff7c102 100644
--- a/scripts/lib/wic/plugins/imager/direct.py
+++ b/scripts/lib/wic/plugins/imager/direct.py
@@ -259,6 +259,8 @@ class DirectPlugin(ImagerPlugin):
 if part.mountpoint == "/":
 if part.uuid:
 return "PARTUUID=%s" % part.uuid
+elif part.label:
+return "PARTLABEL=%s" % part.label
 else:
 suffix = 'p' if part.disk.startswith('mmcblk') else ''
 return "/dev/%s%s%-d" % (part.disk, suffix, part.realnum)
-- 
2.20.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158597): 
https://lists.openembedded.org/g/openembedded-core/message/158597
Mute This Topic: https://lists.openembedded.org/mt/87254905/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-