[OE-core] [PATCH] wic: Use os.rename instead of bb.utils.rename

2021-11-09 Thread Khem Raj
This is not invoked with bitbake context as a result bb.utils is not
visible when this function is called during image creation and builds
fail e.g.

NameError: name 'bb' is not defined

Signed-off-by: Khem Raj 
Cc: Joshua Watt 
Cc: Devendra Tewari 
---
 scripts/lib/wic/plugins/imager/direct.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/lib/wic/plugins/imager/direct.py 
b/scripts/lib/wic/plugins/imager/direct.py
index 495518fac81..c7bc2469ab5 100644
--- a/scripts/lib/wic/plugins/imager/direct.py
+++ b/scripts/lib/wic/plugins/imager/direct.py
@@ -619,5 +619,5 @@ class PartitionedImage():
  part.start + part.size_sec - 1, part.size_sec)
 
 partimage = self.path + '.p%d' % part.num
-bb.utils.rename(source, partimage)
+os.rename(source, partimage)
 self.partimages.append(partimage)
-- 
2.33.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158061): 
https://lists.openembedded.org/g/openembedded-core/message/158061
Mute This Topic: https://lists.openembedded.org/mt/86951858/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] vim: fix CVE-2021-3796, CVE-2021-3872, and CVE-2021-3875

2021-11-09 Thread Ross Burton
Backport patches from upstream to fix these CVEs.

Signed-off-by: Ross Burton 
---
 ...28-using-freed-memory-when-replacing.patch | 83 
 ...llegal-memory-access-if-buffer-name-.patch | 86 
 ...ml_get-error-after-search-with-range.patch | 72 ++
 ...nvalid-memory-access-when-scrolling-.patch | 97 +++
 meta/recipes-support/vim/vim.inc  |  8 +-
 5 files changed, 344 insertions(+), 2 deletions(-)
 create mode 100644 
meta/recipes-support/vim/files/0002-patch-8.2.3428-using-freed-memory-when-replacing.patch
 create mode 100644 
meta/recipes-support/vim/files/0003-patch-8.2.3487-illegal-memory-access-if-buffer-name-.patch
 create mode 100644 
meta/recipes-support/vim/files/0004-patch-8.2.3489-ml_get-error-after-search-with-range.patch
 create mode 100644 
meta/recipes-support/vim/files/0005-patch-8.2.3564-invalid-memory-access-when-scrolling-.patch

diff --git 
a/meta/recipes-support/vim/files/0002-patch-8.2.3428-using-freed-memory-when-replacing.patch
 
b/meta/recipes-support/vim/files/0002-patch-8.2.3428-using-freed-memory-when-replacing.patch
new file mode 100644
index 00..ecfae0301e
--- /dev/null
+++ 
b/meta/recipes-support/vim/files/0002-patch-8.2.3428-using-freed-memory-when-replacing.patch
@@ -0,0 +1,83 @@
+CVE: CVE-2021-3796
+Upstream-Status: Backport
+Signed-off-by: Ross Burton 
+
+From 1160e5f74b229336502fc376416f21108d36cfc2 Mon Sep 17 00:00:00 2001
+From: Bram Moolenaar 
+Date: Sat, 11 Sep 2021 21:14:20 +0200
+Subject: [PATCH] patch 8.2.3428: using freed memory when replacing
+
+Problem:Using freed memory when replacing. (Dhiraj Mishra)
+Solution:   Get the line pointer after calling ins_copychar().
+---
+ src/normal.c  | 10 +++---
+ src/testdir/test_edit.vim | 14 ++
+ src/version.c |  2 ++
+ 3 files changed, 23 insertions(+), 3 deletions(-)
+
+diff --git a/src/normal.c b/src/normal.c
+index c4963e621..d6333b948 100644
+--- a/src/normal.c
 b/src/normal.c
+@@ -5009,19 +5009,23 @@ nv_replace(cmdarg_T *cap)
+   {
+   /*
+* Get ptr again, because u_save and/or showmatch() will have
+-   * released the line.  At the same time we let know that the
+-   * line will be changed.
++   * released the line.  This may also happen in ins_copychar().
++   * At the same time we let know that the line will be changed.
+*/
+-  ptr = ml_get_buf(curbuf, curwin->w_cursor.lnum, TRUE);
+   if (cap->nchar == Ctrl_E || cap->nchar == Ctrl_Y)
+   {
+ int c = ins_copychar(curwin->w_cursor.lnum
+  + (cap->nchar == Ctrl_Y ? -1 : 1));
++
++ptr = ml_get_buf(curbuf, curwin->w_cursor.lnum, TRUE);
+ if (c != NUL)
+   ptr[curwin->w_cursor.col] = c;
+   }
+   else
++  {
++  ptr = ml_get_buf(curbuf, curwin->w_cursor.lnum, TRUE);
+   ptr[curwin->w_cursor.col] = cap->nchar;
++  }
+   if (p_sm && msg_silent == 0)
+   showmatch(cap->nchar);
+   ++curwin->w_cursor.col;
+diff --git a/src/testdir/test_edit.vim b/src/testdir/test_edit.vim
+index 4e29e7fe1..f94e6c181 100644
+--- a/src/testdir/test_edit.vim
 b/src/testdir/test_edit.vim
+@@ -1519,3 +1519,17 @@ func Test_edit_noesckeys()
+   bwipe!
+   set esckeys
+ endfunc
++
++" Test for getting the character of the line below after "p"
++func Test_edit_put_CTRL_E()
++  set encoding=latin1
++  new
++  let @" = ''
++  sil! norm orggRx
++  sil! norm pr
++  call assert_equal(['r', 'r'], getline(1, 2))
++  bwipe!
++  set encoding=utf-8
++endfunc
++
++" vim: shiftwidth=2 sts=2 expandtab
+diff --git a/src/version.c b/src/version.c
+index 85bdfc601..1046993d6 100644
+--- a/src/version.c
 b/src/version.c
+@@ -742,6 +742,8 @@ static char *(features[]) =
+ 
+ static int included_patches[] =
+ {   /* Add new patch number below this line */
++/**/
++3428,
+ /**/
+ 3409,
+ /**/
diff --git 
a/meta/recipes-support/vim/files/0003-patch-8.2.3487-illegal-memory-access-if-buffer-name-.patch
 
b/meta/recipes-support/vim/files/0003-patch-8.2.3487-illegal-memory-access-if-buffer-name-.patch
new file mode 100644
index 00..576664f436
--- /dev/null
+++ 
b/meta/recipes-support/vim/files/0003-patch-8.2.3487-illegal-memory-access-if-buffer-name-.patch
@@ -0,0 +1,86 @@
+CVE: CVE-2021-3872
+Upstream-Status: Backport
+Signed-off-by: Ross Burton 
+
+From 61629ea24a2fff1f89c37479d3fb52f17c3480fc Mon Sep 17 00:00:00 2001
+From: Bram Moolenaar 
+Date: Fri, 8 Oct 2021 18:39:28 +0100
+Subject: [PATCH] patch 8.2.3487: illegal memory access if buffer name is very
+ long
+
+Problem:Illegal memory access if buffer name is very long.
+Solution:   Make sure not to go over the end of the buffer.
+---
+ src/drawscreen.c   

Re: [OE-core] [PATCH] kexec-tools: upgrade 2.0.22 -> 2.0.23

2021-11-09 Thread Richard Purdie
On Tue, 2021-11-09 at 23:03 +0800, wangmy wrote:
> Signed-off-by: Wang Mingyu 
> ---
>  .../kexec/{kexec-tools_2.0.22.bb => kexec-tools_2.0.23.bb}  | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>  rename meta/recipes-kernel/kexec/{kexec-tools_2.0.22.bb => 
> kexec-tools_2.0.23.bb} (97%)
> 
> diff --git a/meta/recipes-kernel/kexec/kexec-tools_2.0.22.bb 
> b/meta/recipes-kernel/kexec/kexec-tools_2.0.23.bb
> similarity index 97%
> rename from meta/recipes-kernel/kexec/kexec-tools_2.0.22.bb
> rename to meta/recipes-kernel/kexec/kexec-tools_2.0.23.bb
> index 95ff5e6ef8..906e5fcd26 100644
> --- a/meta/recipes-kernel/kexec/kexec-tools_2.0.22.bb
> +++ b/meta/recipes-kernel/kexec/kexec-tools_2.0.23.bb
> @@ -22,7 +22,7 @@ SRC_URI = 
> "${KERNELORG_MIRROR}/linux/utils/kernel/kexec/kexec-tools-${PV}.tar.gz
> 
> file://0001-kexec-arch-ppc-kexec-ppc.c-correct-double-definition.patch \
> "
>  
> -SRC_URI[sha256sum] = 
> "40623d4321be2865ef9ea2cd6ec998d31dcf93d0f74353cbd3aa06d8821e3e41"
> +SRC_URI[sha256sum] = 
> "c7dcc59f5b66004d9d91264324e20e0387ea263dbb449708fbf84a4e5ff7decc"
>  
>  inherit autotools update-rc.d systemd
>  

Fails to build on ppc:

https://autobuilder.yoctoproject.org/typhoon/#/builders/63/builds/4295
https://autobuilder.yoctoproject.org/typhoon/#/builders/107/builds/2335

Cheers,

Richard




-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158059): 
https://lists.openembedded.org/g/openembedded-core/message/158059
Mute This Topic: https://lists.openembedded.org/mt/86932973/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] gdb-cross: add dependency on gmp-native

2021-11-09 Thread Khem Raj



On 11/9/21 2:29 AM, Martin Jansa wrote:

* it was already added for target and cross-canadian gdb in:
   commit 4643d1eb222151384f77d13a936537aae5ca3fe6
   Author: Khem Raj 
   Date:   Fri Nov 5 17:37:33 2021 -0700

 gdb: Add dependency on libgmp

 gdb 11 has added this library as must have

* but gdb-cross.inc overwrites DEPENDS from gdb-common.inc
   and needs the dependency as well as shown in log.do_compile:

   checking for libgmp... no
   configure: error: GMP is missing or unusable
   make[1]: *** [Makefile:9418: configure-gdb] Error 1

   and in gdb-cross-i686/11.1-r0/build-i686-oe-linux/gdb/config.log:



thanks for doing it



   configure:10402: checking for libgmp
   configure:10422: gcc  -o conftest 
-isystem/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/include
 -O2 -pipe 
-isystem/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/include
 
-I/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/include
  
-L/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/lib 

-L/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/lib 
-Wl,--enable-new-dtags 
-Wl,-rpath-link,/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/lib
 
-Wl,-rpath-link,/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/lib
 
-Wl,-rpath,/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/lib
 
-Wl,-rpath,/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/lib
 -Wl,-O1 -Wl,--allow-shlib-undefined 
-Wl,--dynamic-linker=/OE/tmp-glibc/sysroots-uninative/x86_64-linux/lib/ld-linux-x86-64.so.2
 conftest.c -lncursesw -lm -ldl  -lgmp >&5
   conftest.c:52:10: fatal error: gmp.h: No such file or directory
  52 | #include 
 |  ^~~

* this fails only when the host OS doesn't have GMP installed
   otherwise it will use libgmp from host and ignore
   
--with-libgmp-prefix=/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr

Signed-off-by: Martin Jansa 
---
  meta/recipes-devtools/gdb/gdb-cross.inc | 2 +-
  1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/gdb/gdb-cross.inc 
b/meta/recipes-devtools/gdb/gdb-cross.inc
index 4e50cd5ab0..9f9675c1b3 100644
--- a/meta/recipes-devtools/gdb/gdb-cross.inc
+++ b/meta/recipes-devtools/gdb/gdb-cross.inc
@@ -1,6 +1,6 @@
  require gdb-common.inc
  
-DEPENDS = "expat-native ncurses-native flex-native bison-native"

+DEPENDS = "expat-native gmp-native ncurses-native flex-native bison-native"
  
  inherit python3native pkgconfig
  







-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158058): 
https://lists.openembedded.org/g/openembedded-core/message/158058
Mute This Topic: https://lists.openembedded.org/mt/86928271/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] Yocto Project Status WW45`21

2021-11-09 Thread Stephen Jolley
Current Dev Position: YP 3.5 M1

Next Deadline: 6th Dec. 2021 YP 3.5 M1 build

 

Next Team Meetings:

*   Bug Triage meeting Thursday Nov.11th at 7:30am PDT (

https://zoom.us/j/454367603?pwd=ZGxoa2ZXL3FkM3Y0bFd5aVpHVVZ6dz09)
*   Monthly Project Meeting Tuesday Dec. 7th at 8am PDT (

https://zoom.us/j/990892712?pwd=cHU1MjhoM2x6ck81bkcrYjRrcmJsUT09
 )
*   Weekly Engineering Sync Tuesday Nov. 9th at 8am PDT (

https://zoom.us/j/990892712?pwd=cHU1MjhoM2x6ck81bkcrYjRrcmJsUT09
 )
*   Twitch -  See https://www.twitch.tv/theyoctojester

 

Key Status/Updates:

*   YP 3.3.4 is in QA
*   YP 3.5 Planning document:

https://docs.google.com/document/d/1OXw-NKoL_Vb9RWI6sRPs3zTcAn4hHPtG0Y2BIs7x
Izo/edit?usp=sharing
*   There is a proposed syntax simplification on the
openembedded-architecture list with a patch on bitbake-devel. This would
phase out the use of append/prepend/remove operators with +=/=+ and mean it
would just work with "=" alone. We've not recommended this combination and
it removes a redundancy which confuses new users.
*   There will be some infrastructure down time at the end of the year
for the autobuilder and NAS, likely between the 26th and 31st December. This
will affect the autobuilder workers, downloads and sstate shares from the
project but not websites or git services. Last time we had a NAS outage it
caused some issues so we are trying to ensure those issues are fixed in the
stable branches and master with mirroring in place for key things like
uninative before then. If anyone is aware of any other failure modes we need
to address, please let us know.
*   Workarounds for the github protocol changes have been merged to all
stable branches and to master with url changes also being made in many
cases.
*   We have seen a drop in the number of patches in "Pending" state
again this week. Many thanks to everyone who has taken the time to review
patch status and handle accordingly.
*   5.15 kernel headers and kernels have been merged.
*   There have been a number of small but potentially useful bitbake
fixes to file checksum tracking, runall option handling and hung parsing
threads.
*   Intermittent issues continue to rise and help is very much welcome
on these issues. You can see the list of failures we're continuing to see by
searching for the "AB-INT" tag in bugzilla:

https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

 

Ways to contribute:

*   There are bugs identified as possible for newcomers to the project:

https://wiki.yoctoproject.org/wiki/Newcomers
*   There are bugs that are currently unassigned for YP 3.4. See:

https://wiki.yoctoproject.org/wiki/Bug_Triage#Medium.2B_3.4_Unassigned_Enhan
cements.2FBugs
*   We'd welcome new maintainers for recipes in OE-Core. Please see the
list at:

http://git.yoctoproject.org/cgit.cgi/poky/tree/meta/conf/distro/include/main
tainers.inc and discuss with the existing maintainer, or ask on the OE-Core
mailing list. We will likely move a chunk of these to "Unassigned" soon to
help facilitate this.

 

YP 3.5 Milestone Dates:

*   YP 3.5 M1 build date 2021/12/06
*   YP 3.5 M1 Release date 2021/12/17
*   YP 3.5 M2 build date 2022/01/10
*   YP 3.5 M2 Release date 2022/1/21
*   YP 3.5 M3 build date 2022/2/21
*   YP 3.5 M3 Release date 2022/03/04
*   YP 3.5 M4 build date 2022/04/04
*   YP 3.5 M4 Release date 2022/04/29

 

Upcoming dot releases:

*   YP 3.3.4 is in QA
*   YP 3.1.12 build date 2021/11/15
*   YP 3.1.12 Release date 2021/11/26
*   YP 3.4.1 build date 2021/11/22
*   YP 3.4.1 Release date 2021/12/03
*   YP 3.1.13 build date 2021/12/13
*   YP 3.1.13 Release date 2021/12/22
*   YP 3.1.14 build date 2022/01/24
*   YP 3.1.14 Release date 2022/02/04
*   YP 3.4.2 build date 2022/02/07
*   YP 3.4.2 Release date 2022/02/18
*   YP 3.1.15 build date 2022/03/14
*   YP 3.1.15 Release date 2022/03/25
*   YP 3.4.3 build date 2022/03/21
*   YP 3.4.3 Release date 2022/04/01
*   YP 3.1.16 build date 2022/04/25
*   YP 3.1.16 Release date 2022/05/06

 

Tracking Metrics:

*   WDD 2633 (last week 2655) (

https://wiki.yoctoproject.org/charts/combo.html)
*   OE-Core/Poky Patch Metrics

*   Total 

[OE-core] [PATCH v4] glibc: ptest: Add running glibc time related test suite (Y2038) with ptest

2021-11-09 Thread ?ukasz Majewski
This patch introduces new recipe - namely 'glibc-tests', which
builds and installs time related (to check if Y2038 support works) glibc
test suite to OE/Yocto built image.

It reuses code from already available 'glibc-testsuite' recipe,
which is run with 'bitbake glibc-testsuite -c check' and uses qemu
to execute remotely (via SSH) tests on some emulated machine.

This recipe installs time related glibc tests on some rootfs image.
Afterwards, those tests can be executed on the real hardware, to
facilitate validation of it with Y2038 problem compliance.

To test time related subset - one needs to call:
ptest-runner glibc-tests
then change the date after Y2038 threshold for 32 bit systems:
date -s "20 JAN 2038 18:00:00"
and then run ptest-runner again.

To facilitate debugging, source files are provided by default with
the unstripped debugging symbols. Such approach would reduce the
already complex recipe (as it inherits base glibc one), so there
is no need to also install *-dbg and *-src packages.

Signed-off-by: Lukasz Majewski 

---
Changes for v4:
- Add entry for 'glibc-tests' in the maintainers.inc file
- Remove nativesdk from BBCLASSEXTEND as this resipe is not supposed
  to be the part of SDK

Changes for v3:
- Provide missing ${PN}-ptest for PACKAGES, PROVIDES and
  RPROVIDES variables

Changes for v2:
- Just focus on time related set of tests as those can be run as
  standalone
- Reuse of already built tests (from glibc-tests.inc) and depoloy
  them on the HW target.
- Provide single 'run-ptest' script.
- Update the recipe to run with newest poky's -master
---
 meta/conf/distro/include/maintainers.inc  |   1 +
 .../distro/include/ptest-packagelists.inc |   1 +
 meta/recipes-core/glibc/glibc-tests_2.34.bb   | 113 ++
 meta/recipes-core/glibc/glibc/run-ptest   |  37 ++
 4 files changed, 152 insertions(+)
 create mode 100644 meta/recipes-core/glibc/glibc-tests_2.34.bb
 create mode 100755 meta/recipes-core/glibc/glibc/run-ptest

diff --git a/meta/conf/distro/include/maintainers.inc 
b/meta/conf/distro/include/maintainers.inc
index baec2bef4d..7104e091fc 100644
--- a/meta/conf/distro/include/maintainers.inc
+++ b/meta/conf/distro/include/maintainers.inc
@@ -209,6 +209,7 @@ RECIPE_MAINTAINER:pn-glibc = "Khem Raj "
 RECIPE_MAINTAINER:pn-glibc-locale = "Khem Raj "
 RECIPE_MAINTAINER:pn-glibc-mtrace = "Khem Raj "
 RECIPE_MAINTAINER:pn-glibc-scripts = "Khem Raj "
+RECIPE_MAINTAINER:pn-glibc-tests = "Lukasz Majewski "
 RECIPE_MAINTAINER:pn-glibc-testsuite = "Khem Raj "
 RECIPE_MAINTAINER:pn-glide = "Otavio Salvador 
"
 RECIPE_MAINTAINER:pn-gmp = "Khem Raj "
diff --git a/meta/conf/distro/include/ptest-packagelists.inc 
b/meta/conf/distro/include/ptest-packagelists.inc
index 2e324f8da4..fd52fa72a4 100644
--- a/meta/conf/distro/include/ptest-packagelists.inc
+++ b/meta/conf/distro/include/ptest-packagelists.inc
@@ -61,6 +61,7 @@ PTESTS_FAST = "\
 slang-ptest \
 wayland-ptest \
 zlib-ptest \
+glibc-tests-ptest \
 "
 PTESTS_FAST:remove:mips64 = "qemu-ptest"
 PTESTS_PROBLEMS:append:mips64 = "qemu-ptest"
diff --git a/meta/recipes-core/glibc/glibc-tests_2.34.bb 
b/meta/recipes-core/glibc/glibc-tests_2.34.bb
new file mode 100644
index 00..d2d3cfff91
--- /dev/null
+++ b/meta/recipes-core/glibc/glibc-tests_2.34.bb
@@ -0,0 +1,113 @@
+require glibc_${PV}.bb
+require glibc-tests.inc
+
+inherit ptest
+
+SRC_URI:append = " \
+   file://run-ptest \
+"
+
+SUMMARY = "glibc tests to be run with ptest"
+
+# Erase some variables already set by glibc_${PV}
+python __anonymous() {
+   # Remove packages provided by glibc build, we only need a subset of them
+   d.setVar("PACKAGES", "${PN} ${PN}-ptest")
+
+   d.setVar("PROVIDES", "${PN} ${PN}-ptest")
+   d.setVar("RPROVIDES", "${PN} ${PN}-ptest")
+
+   d.setVar("BBCLASSEXTEND", "")
+   d.setVar("RRECOMMENDS", "")
+}
+
+# Remove any lefovers from original glibc recipe
+RPROVIDES:${PN} = "${PN}"
+RRECOMMENDS:${PN} = ""
+RDEPENDS:${PN} = " glibc sed"
+DEPENDS:append = " sed"
+
+# Just build tests for target - do not run them
+do_check:append () {
+   oe_runmake -i check run-built-tests=no
+}
+addtask do_check after do_compile before do_install_ptest_base
+
+glibc_strip_build_directory () {
+   # Delete all non executable files from build directory
+   find ${B} ! -executable -type f -delete
+
+   # Remove build dynamic libraries and links to them as
+   # those are already installed in the target device
+   find ${B} -type f -name "*.so" -delete
+   find ${B} -type l -name "*.so*" -delete
+
+   # Remove headers (installed with glibc)
+   find ${B} -type f -name "*.h" -delete
+
+   find ${B} -type f -name "isomac" -delete
+   find ${B} -type f -name "annexc" -delete
+}
+
+do_install_ptest_base () {
+   glibc_strip_build_directory
+
+   ls -r ${B}/*/*-time64 > ${B}/tst_time64
+
+   # Remove '-time64' suffix - those tests are also time related
+   

[OE-core] [PATCH] msmtp: upgrade 1.8.18 -> 1.8.19

2021-11-09 Thread wangmy
Signed-off-by: Wang Mingyu 
---
 .../recipes-extended/msmtp/{msmtp_1.8.18.bb => msmtp_1.8.19.bb} | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-extended/msmtp/{msmtp_1.8.18.bb => msmtp_1.8.19.bb} (91%)

diff --git a/meta/recipes-extended/msmtp/msmtp_1.8.18.bb 
b/meta/recipes-extended/msmtp/msmtp_1.8.19.bb
similarity index 91%
rename from meta/recipes-extended/msmtp/msmtp_1.8.18.bb
rename to meta/recipes-extended/msmtp/msmtp_1.8.19.bb
index 1a6cf72392..29f0e07fe4 100644
--- a/meta/recipes-extended/msmtp/msmtp_1.8.18.bb
+++ b/meta/recipes-extended/msmtp/msmtp_1.8.19.bb
@@ -11,7 +11,7 @@ LIC_FILES_CHKSUM = 
"file://COPYING;md5=d32239bcb673463ab874e80d47fae504"
 UPSTREAM_CHECK_URI = "https://marlam.de/msmtp/download/;
 
 SRC_URI = "https://marlam.de/${BPN}/releases/${BP}.tar.xz;
-SRC_URI[sha256sum] = 
"14fc62af37ebdcc5ed19a245a05eb8376efe7016118f00c9c594bc999d5560a5"
+SRC_URI[sha256sum] = 
"34a1e1981176874dbe4ee66ee0d9103c90989aa4dcdc4861e4de05ce7e44526b"
 
 inherit gettext autotools update-alternatives pkgconfig
 
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158055): 
https://lists.openembedded.org/g/openembedded-core/message/158055
Mute This Topic: https://lists.openembedded.org/mt/86933058/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] libpcre2: upgrade 10.37 -> 10.39

2021-11-09 Thread wangmy
This release is mainly to fix an important JIT bug, but it also
contains an update to Unicode 14.0.0 and some code and configuration tidies.

License-Update: 
 Add "Retired from" before "University of Cambridge Computing Service"

Signed-off-by: Wang Mingyu 
---
 .../libpcre/{libpcre2_10.37.bb => libpcre2_10.39.bb}  | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
 rename meta/recipes-support/libpcre/{libpcre2_10.37.bb => libpcre2_10.39.bb} 
(91%)

diff --git a/meta/recipes-support/libpcre/libpcre2_10.37.bb 
b/meta/recipes-support/libpcre/libpcre2_10.39.bb
similarity index 91%
rename from meta/recipes-support/libpcre/libpcre2_10.37.bb
rename to meta/recipes-support/libpcre/libpcre2_10.39.bb
index ccedf688d7..b5ec62fe18 100644
--- a/meta/recipes-support/libpcre/libpcre2_10.37.bb
+++ b/meta/recipes-support/libpcre/libpcre2_10.39.bb
@@ -8,13 +8,13 @@ SUMMARY = "Perl Compatible Regular Expressions version 2"
 HOMEPAGE = "http://www.pcre.org;
 SECTION = "devel"
 LICENSE = "BSD-3-Clause"
-LIC_FILES_CHKSUM = "file://LICENCE;md5=6b3022283c9a79238d521848ea9dcb4d"
+LIC_FILES_CHKSUM = "file://LICENCE;md5=43cfa999260dd853cd6cb174dc396f3d"
 
 SRC_URI = 
"https://github.com/PhilipHazel/pcre2/releases/download/pcre2-${PV}/pcre2-${PV}.tar.bz2;
 
 UPSTREAM_CHECK_URI = "https://github.com/PhilipHazel/pcre2/releases;
 
-SRC_URI[sha256sum] = 
"4d95a96e8b80529893b4562be12648d798b957b1ba1aae39606bbc2ab956d270"
+SRC_URI[sha256sum] = 
"0f03caf57f81d9ff362ac28cd389c055ec2bf0678d277349a1a4bee00ad6d440"
 
 CVE_PRODUCT = "pcre2"
 
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158054): 
https://lists.openembedded.org/g/openembedded-core/message/158054
Mute This Topic: https://lists.openembedded.org/mt/86933055/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] kexec-tools: upgrade 2.0.22 -> 2.0.23

2021-11-09 Thread wangmy
Signed-off-by: Wang Mingyu 
---
 .../kexec/{kexec-tools_2.0.22.bb => kexec-tools_2.0.23.bb}  | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-kernel/kexec/{kexec-tools_2.0.22.bb => 
kexec-tools_2.0.23.bb} (97%)

diff --git a/meta/recipes-kernel/kexec/kexec-tools_2.0.22.bb 
b/meta/recipes-kernel/kexec/kexec-tools_2.0.23.bb
similarity index 97%
rename from meta/recipes-kernel/kexec/kexec-tools_2.0.22.bb
rename to meta/recipes-kernel/kexec/kexec-tools_2.0.23.bb
index 95ff5e6ef8..906e5fcd26 100644
--- a/meta/recipes-kernel/kexec/kexec-tools_2.0.22.bb
+++ b/meta/recipes-kernel/kexec/kexec-tools_2.0.23.bb
@@ -22,7 +22,7 @@ SRC_URI = 
"${KERNELORG_MIRROR}/linux/utils/kernel/kexec/kexec-tools-${PV}.tar.gz

file://0001-kexec-arch-ppc-kexec-ppc.c-correct-double-definition.patch \
"
 
-SRC_URI[sha256sum] = 
"40623d4321be2865ef9ea2cd6ec998d31dcf93d0f74353cbd3aa06d8821e3e41"
+SRC_URI[sha256sum] = 
"c7dcc59f5b66004d9d91264324e20e0387ea263dbb449708fbf84a4e5ff7decc"
 
 inherit autotools update-rc.d systemd
 
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158053): 
https://lists.openembedded.org/g/openembedded-core/message/158053
Mute This Topic: https://lists.openembedded.org/mt/86932973/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] iw: upgrade 5.9 -> 5.16

2021-11-09 Thread wangmy
Signed-off-by: Wang Mingyu 
---
 meta/recipes-connectivity/iw/{iw_5.9.bb => iw_5.16.bb} | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-connectivity/iw/{iw_5.9.bb => iw_5.16.bb} (90%)

diff --git a/meta/recipes-connectivity/iw/iw_5.9.bb 
b/meta/recipes-connectivity/iw/iw_5.16.bb
similarity index 90%
rename from meta/recipes-connectivity/iw/iw_5.9.bb
rename to meta/recipes-connectivity/iw/iw_5.16.bb
index 3d1e1c7e79..cf176a349f 100644
--- a/meta/recipes-connectivity/iw/iw_5.9.bb
+++ b/meta/recipes-connectivity/iw/iw_5.16.bb
@@ -14,7 +14,7 @@ SRC_URI = 
"http://www.kernel.org/pub/software/network/iw/${BP}.tar.gz \
file://separate-objdir.patch \
 "
 
-SRC_URI[sha256sum] = 
"6e7d3c9f8b4ee68e412f20fe229c9854c2dba383e3e650ce6af8eb8dbd12efc3"
+SRC_URI[sha256sum] = 
"9c91f2560b258d9660e656ad37fa5bd100ac255865dcfb26076a576b10d8f3a7"
 
 inherit pkgconfig
 
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158052): 
https://lists.openembedded.org/g/openembedded-core/message/158052
Mute This Topic: https://lists.openembedded.org/mt/86932949/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] harfbuzz: upgrade 3.0.0 -> 3.1.1

2021-11-09 Thread wangmy
Work around GCC cast-align error/warning on some platforms. (Behdad Esfahbod)
Documentation improvements. (Matthias Clasen)

Signed-off-by: Wang Mingyu 
---
 .../harfbuzz/{harfbuzz_3.0.0.bb => harfbuzz_3.1.1.bb}   | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-graphics/harfbuzz/{harfbuzz_3.0.0.bb => harfbuzz_3.1.1.bb} 
(95%)

diff --git a/meta/recipes-graphics/harfbuzz/harfbuzz_3.0.0.bb 
b/meta/recipes-graphics/harfbuzz/harfbuzz_3.1.1.bb
similarity index 95%
rename from meta/recipes-graphics/harfbuzz/harfbuzz_3.0.0.bb
rename to meta/recipes-graphics/harfbuzz/harfbuzz_3.1.1.bb
index fef9453187..1fc83a3bc2 100644
--- a/meta/recipes-graphics/harfbuzz/harfbuzz_3.0.0.bb
+++ b/meta/recipes-graphics/harfbuzz/harfbuzz_3.1.1.bb
@@ -12,7 +12,7 @@ UPSTREAM_CHECK_URI = 
"https://github.com/${BPN}/${BPN}/releases;
 UPSTREAM_CHECK_REGEX = "harfbuzz-(?P\d+(\.\d+)+).tar"
 
 SRC_URI = 
"https://github.com/${BPN}/${BPN}/releases/download/${PV}/${BPN}-${PV}.tar.xz;
-SRC_URI[sha256sum] = 
"036b0ee118451539783ec7864148bb4106be42a2eb964df4e83e6703ec46f3d9"
+SRC_URI[sha256sum] = 
"f3f3247bdeabf36765acc237a5f651e651e4e9706582b9cc2cf6c9b8102dfa93"
 
 inherit meson pkgconfig lib_package gtk-doc gobject-introspection
 
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158051): 
https://lists.openembedded.org/g/openembedded-core/message/158051
Mute This Topic: https://lists.openembedded.org/mt/86932943/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] iproute2: upgrade 5.14.0 -> 5.15.0

2021-11-09 Thread wangmy
Signed-off-by: Wang Mingyu 
---
 .../iproute2/{iproute2_5.14.0.bb => iproute2_5.15.0.bb} | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-connectivity/iproute2/{iproute2_5.14.0.bb => 
iproute2_5.15.0.bb} (75%)

diff --git a/meta/recipes-connectivity/iproute2/iproute2_5.14.0.bb 
b/meta/recipes-connectivity/iproute2/iproute2_5.15.0.bb
similarity index 75%
rename from meta/recipes-connectivity/iproute2/iproute2_5.14.0.bb
rename to meta/recipes-connectivity/iproute2/iproute2_5.15.0.bb
index 27fb5c8866..99a743391a 100644
--- a/meta/recipes-connectivity/iproute2/iproute2_5.14.0.bb
+++ b/meta/recipes-connectivity/iproute2/iproute2_5.15.0.bb
@@ -4,7 +4,7 @@ SRC_URI = 
"${KERNELORG_MIRROR}/linux/utils/net/${BPN}/${BP}.tar.xz \
file://0001-libc-compat.h-add-musl-workaround.patch \
"
 
-SRC_URI[sha256sum] = 
"210fa785a52f3763c4287fd5ae63e246f6311bfaa48c424baab6d383bb7591d4"
+SRC_URI[sha256sum] = 
"38e3e4a5f9a7f5575c015027a10df097c149111eeb739993128e5b2b35b291ff"
 
 # CFLAGS are computed in Makefile and reference CCOPTS
 #
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158049): 
https://lists.openembedded.org/g/openembedded-core/message/158049
Mute This Topic: https://lists.openembedded.org/mt/86932941/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] iso-codes: upgrade 4.7.0 -> 4.8.0

2021-11-09 Thread wangmy
- ISO 3166-1: Add flag emoji to countries. Thanks to Pander
  for the suggestion. Fixes #19
- ISO 639-5: New translation for Chinese (Simplified)

- ISO 3166-2: Major update of data.
  Thanks to the script of Kevin Kaiser, which enables
  the download of ISO pages and parses the data.
  Fixes #15, #16, #27
- Rename ChangeLog.md to CHANGELOG.md and follow the suggestions
  from [Keep a Changelog](https://keepachangelog.com/en/1.0.0/)
- Move all CHANGELOG entries from versions before 4.0 to an
  archive file (CHANGELOG-PRE-4.0.md) in order to reduce the
  massive size of this CHANGELOG.
- Translation updates for ISO 3166-1
- Translation updates for ISO 3166-2
- Translation updates for ISO 639-2
- Translation updates for ISO 639-3
- Translation updates for ISO 639-5
- Translation updates for ISO 15924

Signed-off-by: Wang Mingyu 
---
 .../iso-codes/{iso-codes_4.7.0.bb => iso-codes_4.8.0.bb}| 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-support/iso-codes/{iso-codes_4.7.0.bb => 
iso-codes_4.8.0.bb} (94%)

diff --git a/meta/recipes-support/iso-codes/iso-codes_4.7.0.bb 
b/meta/recipes-support/iso-codes/iso-codes_4.8.0.bb
similarity index 94%
rename from meta/recipes-support/iso-codes/iso-codes_4.7.0.bb
rename to meta/recipes-support/iso-codes/iso-codes_4.8.0.bb
index 46988a7e80..2f3f589e7c 100644
--- a/meta/recipes-support/iso-codes/iso-codes_4.7.0.bb
+++ b/meta/recipes-support/iso-codes/iso-codes_4.8.0.bb
@@ -9,7 +9,7 @@ LICENSE = "LGPLv2.1"
 LIC_FILES_CHKSUM = "file://COPYING;md5=4fbd65380cdd255951079008b364516c"
 
 SRC_URI = 
"git://salsa.debian.org/iso-codes-team/iso-codes.git;protocol=https;branch=main;"
-SRCREV = "59767ed869f3952575f7d0f639a290a4c4b315e5"
+SRCREV = "5d0a5515f26b3858e27939c8f9a732d8bd4271ab"
 
 # inherit gettext cannot be used, because it adds gettext-native to 
BASEDEPENDS which
 # are inhibited by allarch
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158050): 
https://lists.openembedded.org/g/openembedded-core/message/158050
Mute This Topic: https://lists.openembedded.org/mt/86932942/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] python3-nose: translate to python3 code before build

2021-11-09 Thread Yi Zhao


On 11/9/21 5:56 AM, Richard Purdie wrote:

On Mon, 2021-11-08 at 14:55 +0800, Yi Zhao wrote:

Setuptools has removed support for 2to3 during builds since version
58[1]. But the nose's setup.py relies on use_2to3 option in setuptools,
it is failing an import and building without running 2to3 and generating
valid python3 code. As a workaround, we use command line 2to3 tool to
translate to Python3 code before build it.

Fixes:
$ python3

import nose

Traceback (most recent call last):
File "", line 1, in 
File "/usr/lib/python3.10/site-packages/nose/_init_.py", line 1, in 
from nose.core import collector, main, run, run_exit, runmodule
File "/usr/lib/python3.10/site-packages/nose/core.py", line 153
print "%s version %s" % (os.path.basename(sys.argv[0]), _version_)

SyntaxError: Missing parentheses in call to 'print'. Did you mean print(...)?
[1] https://github.com/pypa/setuptools/issues/2086

Signed-off-by: Yi Zhao 
---
  meta/recipes-devtools/python/python-nose.inc  |  6 ++
  .../python3-nose/0001-Remove-use_2to3.patch   | 71 +++
  2 files changed, 77 insertions(+)
  create mode 100644 
meta/recipes-devtools/python/python3-nose/0001-Remove-use_2to3.patch

This failed in testing unfortunately:

https://autobuilder.yoctoproject.org/typhoon/#/builders/40/builds/4323/steps/14/logs/stdio


Hi Richard,


I can not reproduce this issue in my local. Is there any detail log that 
I can find ? Maybe it is a parallel build issue.



Thanks,

Yi



Cheers,

Richard


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158048): 
https://lists.openembedded.org/g/openembedded-core/message/158048
Mute This Topic: https://lists.openembedded.org/mt/86900770/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 26/26] go-helloworld/glide: Fix urls

2021-11-09 Thread Anuj Mittal
From: Richard Purdie 

Handle github protocol changes not covered by the script due to variable 
indirection.

Signed-off-by: Richard Purdie 
(cherry picked from commit 3bb1cb476dbad1037522970af9afd69691a7033c)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-devtools/glide/glide_0.13.3.bb| 2 +-
 meta/recipes-extended/go-examples/go-helloworld_0.1.bb | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/meta/recipes-devtools/glide/glide_0.13.3.bb 
b/meta/recipes-devtools/glide/glide_0.13.3.bb
index 1a69445816..db703c2d21 100644
--- a/meta/recipes-devtools/glide/glide_0.13.3.bb
+++ b/meta/recipes-devtools/glide/glide_0.13.3.bb
@@ -5,7 +5,7 @@ LICENSE = "MIT"
 LIC_FILES_CHKSUM = 
"file://src/${GO_IMPORT}/LICENSE;md5=54905cf894f8cc416a92f4fc350c35b2"
 
 GO_IMPORT = "github.com/Masterminds/glide"
-SRC_URI = "git://${GO_IMPORT};branch=master"
+SRC_URI = "git://${GO_IMPORT};branch=master;protocol=https"
 SRCREV = "8ed5b9292379d86c39592a7e6a58eb9c903877cf"
 
 inherit go
diff --git a/meta/recipes-extended/go-examples/go-helloworld_0.1.bb 
b/meta/recipes-extended/go-examples/go-helloworld_0.1.bb
index 6e2687a083..4e582edcf1 100644
--- a/meta/recipes-extended/go-examples/go-helloworld_0.1.bb
+++ b/meta/recipes-extended/go-examples/go-helloworld_0.1.bb
@@ -5,7 +5,7 @@ HOMEPAGE = "https://golang.org/;
 LICENSE = "MIT"
 LIC_FILES_CHKSUM = 
"file://${COMMON_LICENSE_DIR}/MIT;md5=0835ade698e0bcf8506ecda2f7b4f302"
 
-SRC_URI = "git://${GO_IMPORT};branch=master"
+SRC_URI = "git://${GO_IMPORT};branch=master;protocol=https"
 SRCREV = "46695d81d1fae905a270fb7db8a4d11a334562fe"
 UPSTREAM_CHECK_COMMITS = "1"
 
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158047): 
https://lists.openembedded.org/g/openembedded-core/message/158047
Mute This Topic: https://lists.openembedded.org/mt/86932333/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 25/26] recipes: Update github.com urls to use https

2021-11-09 Thread Anuj Mittal
From: Richard Purdie 

Github has announced there will be no more git:// fetching from their servers:

https://github.blog/2021-09-01-improving-git-protocol-security-github/#no-more-unauthenticated-git

and they're about to start having brownout periods to encourage people
to update. This runs the conversion script over OE-Core to update our
urls to use https instead of git.

Signed-off-by: Richard Purdie 
(cherry picked from commit b37b61e9a1e448a34957db9ae39285d21352552e)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-bsp/efivar/efivar_37.bb| 2 +-
 meta/recipes-bsp/opensbi/opensbi_0.9.bb | 2 +-
 meta/recipes-connectivity/connman/connman-gnome_0.7.bb  | 2 +-
 meta/recipes-connectivity/libnss-mdns/libnss-mdns_0.15.1.bb | 2 +-
 meta/recipes-connectivity/libuv/libuv_1.42.0.bb | 2 +-
 meta/recipes-core/fts/fts_1.2.7.bb  | 2 +-
 meta/recipes-core/glibc/cross-localedef-native_2.34.bb  | 2 +-
 meta/recipes-core/libxcrypt/libxcrypt.inc   | 2 +-
 meta/recipes-core/musl/libucontext_git.bb   | 2 +-
 meta/recipes-core/musl/musl-obstack.bb  | 2 +-
 meta/recipes-core/musl/musl-utils.bb| 2 +-
 meta/recipes-core/systemd/systemd.inc   | 2 +-
 meta/recipes-devtools/bootchart2/bootchart2_0.14.9.bb   | 2 +-
 meta/recipes-devtools/createrepo-c/createrepo-c_0.17.4.bb   | 2 +-
 meta/recipes-devtools/distcc/distcc_3.4.bb  | 2 +-
 meta/recipes-devtools/dnf/dnf_4.8.0.bb  | 2 +-
 meta/recipes-devtools/file/file_5.40.bb | 2 +-
 meta/recipes-devtools/libcomps/libcomps_0.1.17.bb   | 2 +-
 meta/recipes-devtools/libdnf/libdnf_0.63.1.bb   | 2 +-
 meta/recipes-devtools/librepo/librepo_1.14.1.bb | 2 +-
 meta/recipes-devtools/llvm/llvm_git.bb  | 2 +-
 meta/recipes-devtools/ninja/ninja_1.10.2.bb | 2 +-
 meta/recipes-devtools/rpm/rpm_4.16.1.3.bb   | 2 +-
 meta/recipes-extended/iputils/iputils_20210722.bb   | 2 +-
 meta/recipes-extended/libnsl/libnsl2_git.bb | 2 +-
 meta/recipes-extended/libnss-nis/libnss-nis.bb  | 2 +-
 meta/recipes-extended/libsolv/libsolv_0.7.19.bb | 2 +-
 meta/recipes-extended/ltp/ltp_20210524.bb   | 2 +-
 meta/recipes-extended/rpcsvc-proto/rpcsvc-proto.bb  | 2 +-
 meta/recipes-extended/sysklogd/sysklogd_2.2.3.bb| 2 +-
 meta/recipes-extended/zstd/zstd_1.5.0.bb| 2 +-
 meta/recipes-graphics/libva/libva-utils_2.12.0.bb   | 2 +-
 meta/recipes-graphics/spir/spirv-tools_2021.2.bb| 2 +-
 meta/recipes-graphics/vulkan/vulkan-headers_1.2.182.0.bb| 2 +-
 meta/recipes-graphics/vulkan/vulkan-loader_1.2.182.0.bb | 2 +-
 meta/recipes-graphics/vulkan/vulkan-samples_git.bb  | 2 +-
 meta/recipes-graphics/vulkan/vulkan-tools_1.2.182.0.bb  | 2 +-
 .../recipes-graphics/xinput-calibrator/xinput-calibrator_git.bb | 2 +-
 meta/recipes-kernel/cryptodev/cryptodev.inc | 2 +-
 meta/recipes-multimedia/x264/x264_git.bb| 2 +-
 meta/recipes-sato/l3afpad/l3afpad_git.bb| 2 +-
 meta/recipes-support/bmap-tools/bmap-tools_3.6.bb   | 2 +-
 meta/recipes-support/libgit2/libgit2_1.1.1.bb   | 2 +-
 meta/recipes-support/libjitterentropy/libjitterentropy_3.1.0.bb | 2 +-
 meta/recipes-support/libseccomp/libseccomp_2.5.1.bb | 2 +-
 meta/recipes-support/lz4/lz4_1.9.3.bb   | 2 +-
 meta/recipes-support/numactl/numactl_git.bb | 2 +-
 meta/recipes-support/p11-kit/p11-kit_0.24.0.bb  | 2 +-
 meta/recipes-support/rng-tools/rng-tools_6.14.bb| 2 +-
 meta/recipes-support/vim/vim.inc| 2 +-
 meta/recipes-support/xxhash/xxhash_0.8.0.bb | 2 +-
 51 files changed, 51 insertions(+), 51 deletions(-)

diff --git a/meta/recipes-bsp/efivar/efivar_37.bb 
b/meta/recipes-bsp/efivar/efivar_37.bb
index 6340020cef..fc36913f30 100644
--- a/meta/recipes-bsp/efivar/efivar_37.bb
+++ b/meta/recipes-bsp/efivar/efivar_37.bb
@@ -7,7 +7,7 @@ LIC_FILES_CHKSUM = 
"file://COPYING;md5=6626bb1e20189cfa95f2c508ba286393"
 
 COMPATIBLE_HOST = "(i.86|x86_64|arm|aarch64).*-linux"
 
-SRC_URI = "git://github.com/rhinstaller/efivar.git;branch=master \
+SRC_URI = 
"git://github.com/rhinstaller/efivar.git;branch=master;protocol=https \
file://determinism.patch \
file://no-werror.patch"
 SRCREV = "c1d6b10e1ed4ba2be07f385eae5bceb694478a10"
diff --git a/meta/recipes-bsp/opensbi/opensbi_0.9.bb 
b/meta/recipes-bsp/opensbi/opensbi_0.9.bb
index 

[OE-core] [honister][PATCH 24/26] scripts/convert-srcuri: Update SRC_URI conversion script to handle github url changes

2021-11-09 Thread Anuj Mittal
From: Richard Purdie 

Github are dropping support for git:// protocol fetching. Update the script
to learn about corner cases found in the previous conversion and
support remapping the github urls as needed too.

Signed-off-by: Richard Purdie 
(cherry picked from commit e59fe8279b209f67ff79b9d6dbb69389a64db236)
Signed-off-by: Anuj Mittal 
---
 scripts/contrib/convert-srcuri.py | 16 +++-
 1 file changed, 15 insertions(+), 1 deletion(-)

diff --git a/scripts/contrib/convert-srcuri.py 
b/scripts/contrib/convert-srcuri.py
index 4bf9e3013d..5b362ea2e8 100755
--- a/scripts/contrib/convert-srcuri.py
+++ b/scripts/contrib/convert-srcuri.py
@@ -19,19 +19,33 @@ if len(sys.argv) < 2:
 sys.exit(1)
 
 def processfile(fn):
+def matchline(line):
+if "MIRROR" in line or ".*" in line or "GNOME_GIT" in line:
+return False
+return True
 print("processing file '%s'" % fn)
 try:
+if "distro_alias.inc" in fn or "linux-yocto-custom.bb" in fn:
+return
 fh, abs_path = tempfile.mkstemp()
 modified = False
 with os.fdopen(fh, 'w') as new_file:
 with open(fn, "r") as old_file:
 for line in old_file:
-if ("git://" in line or "gitsm://" in line) and "branch=" 
not in line and "MIRROR" not in line and ".*" not in line:
+if ("git://" in line or "gitsm://" in line) and "branch=" 
not in line and matchline(line):
 if line.endswith('"\n'):
 line = line.replace('"\n', ';branch=master"\n')
 elif line.endswith(" \\\n"):
 line = line.replace(' \\\n', ';branch=master \\\n')
 modified = True
+if ("git://" in line or "gitsm://" in line) and 
"github.com" in line and "protocol=https" not in line and matchline(line):
+if "protocol=git" in line:
+line = line.replace('protocol=git', 
'protocol=https')
+elif line.endswith('"\n'):
+line = line.replace('"\n', ';protocol=https"\n')
+elif line.endswith(" \\\n"):
+line = line.replace(' \\\n', ';protocol=https 
\\\n')
+modified = True
 new_file.write(line)
 if modified:
 shutil.copymode(fn, abs_path)
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158046): 
https://lists.openembedded.org/g/openembedded-core/message/158046
Mute This Topic: https://lists.openembedded.org/mt/86932332/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 23/26] meta/scripts: Manual git url branch additions

2021-11-09 Thread Anuj Mittal
From: Richard Purdie 

Following the scripted conversion adding branches to git://
SRC_URI entries, add the remaining references, mainly in the selftests
and recipetool.

Signed-off-by: Richard Purdie 
(cherry picked from commit 5340c0d688036c1be6c938f05d8a8c1e3b49ec38)
Signed-off-by: Anuj Mittal 
---
 meta/conf/distro/include/default-distrovars.inc | 2 +-
 meta/lib/oeqa/selftest/cases/devtool.py | 4 ++--
 meta/lib/oeqa/selftest/cases/recipetool.py  | 6 +++---
 meta/lib/oeqa/selftest/cases/sstatetests.py | 2 +-
 scripts/lib/recipetool/create.py| 3 +++
 5 files changed, 10 insertions(+), 7 deletions(-)

diff --git a/meta/conf/distro/include/default-distrovars.inc 
b/meta/conf/distro/include/default-distrovars.inc
index f91df632d5..fb0f1097da 100644
--- a/meta/conf/distro/include/default-distrovars.inc
+++ b/meta/conf/distro/include/default-distrovars.inc
@@ -53,5 +53,5 @@ KERNEL_IMAGETYPES ??= "${KERNEL_IMAGETYPE}"
 # The CONNECTIVITY_CHECK_URIS are used to test whether we can succesfully
 # fetch from the network (and warn you if not). To disable the test set
 # the variable to be empty.
-# Git example url: 
git://git.yoctoproject.org/yocto-firewall-test;protocol=git;rev=master
+# Git example url: 
git://git.yoctoproject.org/yocto-firewall-test;protocol=git;rev=master;branch=master
 CONNECTIVITY_CHECK_URIS ?= "https://www.example.com/;
diff --git a/meta/lib/oeqa/selftest/cases/devtool.py 
b/meta/lib/oeqa/selftest/cases/devtool.py
index f495e84c79..d2b31af80e 100644
--- a/meta/lib/oeqa/selftest/cases/devtool.py
+++ b/meta/lib/oeqa/selftest/cases/devtool.py
@@ -340,7 +340,7 @@ class DevtoolAddTests(DevtoolBase):
 checkvars['LIC_FILES_CHKSUM'] = 
'file://COPYING;md5=b234ee4d69f5fce4486a80fdaf4a4263'
 checkvars['S'] = '${WORKDIR}/git'
 checkvars['PV'] = '0.1+git${SRCPV}'
-checkvars['SRC_URI'] = 
'git://git.yoctoproject.org/git/dbus-wait;protocol=https'
+checkvars['SRC_URI'] = 
'git://git.yoctoproject.org/git/dbus-wait;protocol=https;branch=master'
 checkvars['SRCREV'] = srcrev
 checkvars['DEPENDS'] = set(['dbus'])
 self._test_recipe_contents(recipefile, checkvars, [])
@@ -904,7 +904,7 @@ class DevtoolUpdateTests(DevtoolBase):
 self._check_repo_status(os.path.dirname(recipefile), expected_status)
 
 result = runCmd('git diff %s' % os.path.basename(recipefile), 
cwd=os.path.dirname(recipefile))
-addlines = ['SRCREV = ".*"', 'SRC_URI = 
"git://git.infradead.org/mtd-utils.git"']
+addlines = ['SRCREV = ".*"', 'SRC_URI = 
"git://git.infradead.org/mtd-utils.git;branch=master"']
 srcurilines = src_uri.split()
 srcurilines[0] = 'SRC_URI = "' + srcurilines[0]
 srcurilines.append('"')
diff --git a/meta/lib/oeqa/selftest/cases/recipetool.py 
b/meta/lib/oeqa/selftest/cases/recipetool.py
index c2a53815d0..8dc00ac10e 100644
--- a/meta/lib/oeqa/selftest/cases/recipetool.py
+++ b/meta/lib/oeqa/selftest/cases/recipetool.py
@@ -357,7 +357,7 @@ class RecipetoolTests(RecipetoolBase):
 tempsrc = os.path.join(self.tempdir, 'srctree')
 os.makedirs(tempsrc)
 recipefile = os.path.join(self.tempdir, 'libmatchbox.bb')
-srcuri = 'git://git.yoctoproject.org/libmatchbox'
+srcuri = 'git://git.yoctoproject.org/libmatchbox;branch=master'
 result = runCmd(['recipetool', 'create', '-o', recipefile, srcuri + 
";rev=9f7cf8895ae2d39c465c04cc78e918c157420269", '-x', tempsrc])
 self.assertTrue(os.path.isfile(recipefile), 'recipetool did not create 
recipe file; output:\n%s' % result.output)
 checkvars = {}
@@ -447,7 +447,7 @@ class RecipetoolTests(RecipetoolBase):
 self.assertTrue(os.path.isfile(recipefile))
 checkvars = {}
 checkvars['LICENSE'] = set(['Apache-2.0'])
-checkvars['SRC_URI'] = 
'git://github.com/mesonbuild/meson;protocol=https'
+checkvars['SRC_URI'] = 
'git://github.com/mesonbuild/meson;protocol=https;branch=master'
 inherits = ['setuptools3']
 self._test_recipe_contents(recipefile, checkvars, inherits)
 
@@ -514,7 +514,7 @@ class RecipetoolTests(RecipetoolBase):
 self.assertTrue(os.path.isfile(recipefile))
 checkvars = {}
 checkvars['LICENSE'] = set(['GPLv2'])
-checkvars['SRC_URI'] = 
'git://git.yoctoproject.org/git/matchbox-terminal;protocol=http'
+checkvars['SRC_URI'] = 
'git://git.yoctoproject.org/git/matchbox-terminal;protocol=http;branch=master'
 inherits = ['pkgconfig', 'autotools']
 self._test_recipe_contents(recipefile, checkvars, inherits)
 
diff --git a/meta/lib/oeqa/selftest/cases/sstatetests.py 
b/meta/lib/oeqa/selftest/cases/sstatetests.py
index 874f439282..7e0ed0dac1 100644
--- a/meta/lib/oeqa/selftest/cases/sstatetests.py
+++ b/meta/lib/oeqa/selftest/cases/sstatetests.py
@@ -39,7 +39,7 @@ class SStateTests(SStateBase):
 
 recipefile = os.path.join(tempdir, "recipes-test", "dbus-wait-test", 

[OE-core] [honister][PATCH 21/26] pseudo: Add fcntl64 wrapper

2021-11-09 Thread Anuj Mittal
From: Richard Purdie 

Add fcntl64 wrapper which hopefully fixes issues seen in findutils and the find
command in the libtool removal code when built with LFS compile flags on Gentoo.

Signed-off-by: Richard Purdie 
(cherry picked from commit f26867fe4daec7299f59a82ae4a0d70cceb3e082)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-devtools/pseudo/pseudo_git.bb | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/pseudo/pseudo_git.bb 
b/meta/recipes-devtools/pseudo/pseudo_git.bb
index 7acb1d64d5..f9e3b46910 100644
--- a/meta/recipes-devtools/pseudo/pseudo_git.bb
+++ b/meta/recipes-devtools/pseudo/pseudo_git.bb
@@ -13,7 +13,7 @@ SRC_URI:append:class-nativesdk = " \
 file://older-glibc-symbols.patch"
 SRC_URI[prebuilt.sha256sum] = 
"ed9f456856e9d86359f169f46a70ad7be4190d6040282b84c8d97b99072485aa"
 
-SRCREV = "0cda3ba5f94aed8d50652a99ee9c502975aa2926"
+SRCREV = "d34f2f6cedccf8488730001bcbde6bb7499f8814"
 S = "${WORKDIR}/git"
 PV = "1.9.0+git${SRCPV}"
 
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158044): 
https://lists.openembedded.org/g/openembedded-core/message/158044
Mute This Topic: https://lists.openembedded.org/mt/86932330/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 20/26] linunistring: Add missing gperf-native dependency

2021-11-09 Thread Anuj Mittal
From: Richard Purdie 

Signed-off-by: Richard Purdie 
(cherry picked from commit 73d3efbaeb2f412ab8d3491d2da3f3124fc009f3)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-support/libunistring/libunistring_0.9.10.bb | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta/recipes-support/libunistring/libunistring_0.9.10.bb 
b/meta/recipes-support/libunistring/libunistring_0.9.10.bb
index 0a7b18ed08..589faacb05 100644
--- a/meta/recipes-support/libunistring/libunistring_0.9.10.bb
+++ b/meta/recipes-support/libunistring/libunistring_0.9.10.bb
@@ -18,6 +18,7 @@ LIC_FILES_CHKSUM = 
"file://COPYING.LIB;md5=6a6a8e020838b23406c81b19c1d46df6 \
 
file://README;beginline=45;endline=65;md5=08287d16ba8d839faed8d2dc14d7d6a5 \
 
file://doc/libunistring.texi;md5=287fa6075f78a3c85c1a52b0a92547cd \
"
+DEPENDS = "gperf-native"
 
 SRC_URI = "${GNU_MIRROR}/libunistring/libunistring-${PV}.tar.gz \
file://0001-Unset-need_charset_alias-when-building-for-musl.patch \
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158041): 
https://lists.openembedded.org/g/openembedded-core/message/158041
Mute This Topic: https://lists.openembedded.org/mt/86932327/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 22/26] meta: Add explict branch to git SRC_URIs

2021-11-09 Thread Anuj Mittal
From: Richard Purdie 

There is uncertainty about the default branch name in git going forward.
To try and cover the different possible outcomes, add branch names to all
git:// and gitsm:// SRC_URI entries.

This update was made with the script added to contrib in this patch which
aims to help others convert other layers.

Signed-off-by: Richard Purdie 
(cherry picked from commit b51c405faf6f8c0365f7533bfaf470d79152a463)
Signed-off-by: Anuj Mittal 
---
 .../devtool/devtool-upgrade-test2_git.bb  |  2 +-
 .../devtool-upgrade-test2_git.bb.upgraded |  2 +-
 .../git-submodule-test/git-submodule-test.bb  |  2 +-
 meta/classes/devupstream.bbclass  |  2 +-
 meta/conf/bitbake.conf|  2 +-
 meta/lib/oeqa/selftest/cases/fetch.py |  2 +-
 meta/recipes-bsp/efibootmgr/efibootmgr_17.bb  |  2 +-
 meta/recipes-bsp/efivar/efivar_37.bb  |  2 +-
 meta/recipes-bsp/u-boot/libubootenv_0.3.2.bb  |  2 +-
 meta/recipes-bsp/u-boot/u-boot-common.inc |  2 +-
 .../connman/connman-gnome_0.7.bb  |  2 +-
 .../libnss-mdns/libnss-mdns_0.15.1.bb |  2 +-
 .../mobile-broadband-provider-info_git.bb |  2 +-
 meta/recipes-core/dbus-wait/dbus-wait_git.bb  |  2 +-
 meta/recipes-core/fts/fts_1.2.7.bb|  2 +-
 meta/recipes-core/glibc/glibc-version.inc |  2 +-
 meta/recipes-core/ifupdown/ifupdown_0.8.36.bb |  2 +-
 .../initscripts/init-system-helpers_1.60.bb   |  2 +-
 meta/recipes-core/musl/libucontext_git.bb |  2 +-
 meta/recipes-core/musl/musl-obstack.bb|  2 +-
 meta/recipes-core/musl/musl-utils.bb  |  2 +-
 meta/recipes-core/musl/musl_git.bb|  2 +-
 meta/recipes-core/ncurses/ncurses.inc |  2 +-
 meta/recipes-core/psplash/psplash_git.bb  |  2 +-
 .../update-rc.d/update-rc.d_0.8.bb|  2 +-
 .../bootchart2/bootchart2_0.14.9.bb   |  2 +-
 .../btrfs-tools/btrfs-tools_5.13.1.bb |  2 +-
 .../createrepo-c/createrepo-c_0.17.4.bb   |  2 +-
 meta/recipes-devtools/distcc/distcc_3.4.bb|  2 +-
 meta/recipes-devtools/dnf/dnf_4.8.0.bb|  2 +-
 meta/recipes-devtools/e2fsprogs/e2fsprogs.inc |  2 +-
 .../erofs-utils/erofs-utils_1.3.bb|  2 +-
 meta/recipes-devtools/file/file_5.40.bb   |  2 +-
 meta/recipes-devtools/glide/glide_0.13.3.bb   |  2 +-
 .../gnu-config/gnu-config_git.bb  |  2 +-
 .../libcomps/libcomps_0.1.17.bb   |  2 +-
 .../librepo/librepo_1.14.1.bb |  2 +-
 meta/recipes-devtools/mtd/mtd-utils_git.bb|  2 +-
 .../patchelf/patchelf_0.13.bb |  2 +-
 .../squashfs-tools/squashfs-tools_git.bb  |  2 +-
 .../systemd-bootchart_234.bb  |  2 +-
 .../tcf-agent/tcf-agent_git.bb|  2 +-
 meta/recipes-devtools/unfs3/unfs3_git.bb  |  2 +-
 .../rust-hello-world/rust-hello-world_git.bb  |  2 +-
 meta/recipes-extended/bzip2/bzip2_1.0.8.bb|  2 +-
 .../go-examples/go-helloworld_0.1.bb  |  2 +-
 .../iputils/iputils_20210722.bb   |  2 +-
 .../recipes-extended/libaio/libaio_0.3.112.bb |  2 +-
 meta/recipes-extended/libnsl/libnsl2_git.bb   |  2 +-
 .../recipes-extended/libnss-nis/libnss-nis.bb |  2 +-
 .../libsolv/libsolv_0.7.19.bb |  2 +-
 meta/recipes-extended/ltp/ltp_20210524.bb |  2 +-
 .../net-tools/net-tools_2.10.bb   |  2 +-
 meta/recipes-extended/procps/procps_3.3.17.bb |  2 +-
 meta/recipes-extended/psmisc/psmisc_23.4.bb   |  2 +-
 .../rpcsvc-proto/rpcsvc-proto.bb  |  2 +-
 .../stress-ng/stress-ng_0.13.00.bb|  2 +-
 .../xinetd/xinetd_2.3.15.4.bb |  2 +-
 meta/recipes-gnome/libportal/libportal_0.4.bb |  2 +-
 .../glslang/glslang_11.5.0.bb |  2 +-
 .../igt-gpu-tools/igt-gpu-tools_git.bb|  2 +-
 .../libfakekey/libfakekey_git.bb  |  2 +-
 .../libmatchbox/libmatchbox_1.12.bb   |  2 +-
 .../matchbox-wm/matchbox-wm_1.2.2.bb  |  2 +-
 .../spir/spirv-headers_1.5.4.bb   |  2 +-
 .../spir/spirv-tools_2021.2.bb|  2 +-
 .../vulkan/vulkan-loader_1.2.182.0.bb |  2 +-
 .../vulkan/vulkan-samples_git.bb  |  2 +-
 .../xorg-driver/xf86-video-intel_git.bb   |  2 +-
 meta/recipes-kernel/blktrace/blktrace_git.bb  |  2 +-
 meta/recipes-kernel/cryptodev/cryptodev.inc   |  2 +-
 meta/recipes-kernel/dtc/dtc.inc   |  2 +-
 .../kern-tools/kern-tools-native_git.bb   |  2 +-
 meta/recipes-kernel/kmod/kmod.inc |  2 +-
 meta/recipes-kernel/powertop/powertop_2.14.bb |  2 +-
 .../systemtap/systemtap_git.inc   |  2 +-
 meta/recipes-sato/l3afpad/l3afpad_git.bb  |  2 +-
 .../matchbox-config-gtk_0.2.bb|  2 +-
 .../matchbox-desktop/matchbox-desktop_2.2.bb  |  2 +-
 .../matchbox-panel-2/matchbox-panel-2_2.11.bb |  2 +-
 .../matchbox-terminal_0.2.bb  |  2 +-
 .../matchbox-theme-sato_0.2.bb|  2 +-
 

[OE-core] [honister][PATCH 19/26] bitbake.conf: Use wayland distro feature for native builds

2021-11-09 Thread Anuj Mittal
From: Tom Hochstein 

The wayland-scanner is missing from SDKs with weston, but the weston build
requires wayland-scanner. Allow the distro feature in order to include
the wayland-scanner packages via nativesdk-packagegroup-sdk-host.bb.

Signed-off-by: Tom Hochstein 
Signed-off-by: Richard Purdie 
(cherry picked from commit 858cc6f257e22e39df83f4808ea27c6d12cd1b80)
Signed-off-by: Anuj Mittal 
---
 meta/conf/bitbake.conf | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 9274322e3a..c2cb2f0d9d 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -850,8 +850,8 @@ DISTRO_FEATURES_NATIVESDK ?= "x11"
 
 # Normally target distro features will not be applied to native builds:
 # Native distro features on this list will use the target feature value
-DISTRO_FEATURES_FILTER_NATIVE ?= "api-documentation debuginfod opengl"
-DISTRO_FEATURES_FILTER_NATIVESDK ?= "api-documentation debuginfod opengl"
+DISTRO_FEATURES_FILTER_NATIVE ?= "api-documentation debuginfod opengl wayland"
+DISTRO_FEATURES_FILTER_NATIVESDK ?= "api-documentation debuginfod opengl 
wayland"
 
 DISTRO_FEATURES_BACKFILL = "pulseaudio sysvinit gobject-introspection-data 
ldconfig"
 MACHINE_FEATURES_BACKFILL = "rtc qemu-usermode"
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158040): 
https://lists.openembedded.org/g/openembedded-core/message/158040
Mute This Topic: https://lists.openembedded.org/mt/86932326/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 18/26] nativesdk-packagegroup-sdk-host.bb: Update host tools for wayland

2021-11-09 Thread Anuj Mittal
From: Tom Hochstein 

The wayland-scanner host tool required to build weston is moved to the
wayland-tools package, so update the SDK host tools list accordingly.

Also, the weston build requires wayland-scanner.pc to find wayland-scanner,
so add wayland-dev.

Signed-off-by: Tom Hochstein 
Signed-off-by: Richard Purdie 
(cherry picked from commit 31ed91bdbb0ec05730fb98d7cc523bb46aca50e3)
Signed-off-by: Anuj Mittal 
---
 .../packagegroups/nativesdk-packagegroup-sdk-host.bb| 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-core/packagegroups/nativesdk-packagegroup-sdk-host.bb 
b/meta/recipes-core/packagegroups/nativesdk-packagegroup-sdk-host.bb
index 39e5002bb7..9166a0851f 100644
--- a/meta/recipes-core/packagegroups/nativesdk-packagegroup-sdk-host.bb
+++ b/meta/recipes-core/packagegroups/nativesdk-packagegroup-sdk-host.bb
@@ -25,7 +25,7 @@ RDEPENDS:${PN} = "\
 nativesdk-makedevs \
 nativesdk-cmake \
 nativesdk-meson \
-${@bb.utils.contains('DISTRO_FEATURES', 'wayland', 'nativesdk-wayland', 
'', d)} \
+${@bb.utils.contains('DISTRO_FEATURES', 'wayland', 
'nativesdk-wayland-tools nativesdk-wayland-dev', '', d)} \
 nativesdk-sdk-provides-dummy \
 nativesdk-bison \
 nativesdk-flex \
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158039): 
https://lists.openembedded.org/g/openembedded-core/message/158039
Mute This Topic: https://lists.openembedded.org/mt/86932325/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 17/26] wayland: Fix wayland-tools packaging

2021-11-09 Thread Anuj Mittal
From: Tom Hochstein 

There are some packaging problems due to the wayland-tools packaging
implementation. The wayland-tools package currently looks like this:

wayland-tools
└── usr
├── bin
│   └── wayland-scanner
└── share
└── wayland
├── wayland.dtd
├── wayland-scanner.mk
└── wayland.xml

The files wayland.dtd and wayland.xml belong in the main package,
while wayland-scanner.mk belongs in wayland-dev.

Fix the wayland.dtd and wayland.xml packaging by prepending the
wayland-tools package and dropping the main package FILES variable
override. The file wayland-scanner.mk is included in the main
package by default, and so must be explicitly added to wayland-dev.

Signed-off-by: Tom Hochstein 
Signed-off-by: Richard Purdie 
(cherry picked from commit a31fbec45d24df5b74091940d0e0b2daf34d8492)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-graphics/wayland/wayland_1.19.0.bb | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/meta/recipes-graphics/wayland/wayland_1.19.0.bb 
b/meta/recipes-graphics/wayland/wayland_1.19.0.bb
index d6e468497d..5f8b972f76 100644
--- a/meta/recipes-graphics/wayland/wayland_1.19.0.bb
+++ b/meta/recipes-graphics/wayland/wayland_1.19.0.bb
@@ -52,10 +52,10 @@ sysroot_stage_all:append:class-target () {
cp ${STAGING_DATADIR_NATIVE}/aclocal/wayland-scanner.m4 
${SYSROOT_DESTDIR}/${datadir}/aclocal/
 }
 
-PACKAGES += "${PN}-tools"
+PACKAGES =+ "${PN}-tools"
 
-FILES:${PN} = "${libdir}/*${SOLIBS}"
-FILES:${PN}-tools += "${bindir} ${datadir}/wayland"
+FILES:${PN}-tools = "${bindir}/wayland-scanner"
+FILES:${PN}-dev += "${datadir}/${BPN}/wayland-scanner.mk"
 
 BBCLASSEXTEND = "native nativesdk"
 
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158038): 
https://lists.openembedded.org/g/openembedded-core/message/158038
Mute This Topic: https://lists.openembedded.org/mt/86932311/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 16/26] libx11-compose-data: Update LICENSE to better reflect reality

2021-11-09 Thread Anuj Mittal
From: Peter Kjellerstedt 

There are no traces of neither the BSD-2-Clause license nor the
BSD-4-Clause license being used in the code. There is one occurrence
of the BSD-1-Clause license. On the other hand, HPND and
HPND-sell-variant are all over the place.

Signed-off-by: Peter Kjellerstedt 
Signed-off-by: Richard Purdie 
(cherry picked from commit b0f30792fd0ea41f1d1590dbe0452c956e018c82)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-graphics/xorg-lib/libx11-compose-data_1.6.8.bb | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-graphics/xorg-lib/libx11-compose-data_1.6.8.bb 
b/meta/recipes-graphics/xorg-lib/libx11-compose-data_1.6.8.bb
index e53ccc6aea..796980b7ca 100644
--- a/meta/recipes-graphics/xorg-lib/libx11-compose-data_1.6.8.bb
+++ b/meta/recipes-graphics/xorg-lib/libx11-compose-data_1.6.8.bb
@@ -8,7 +8,7 @@ python () {
 
 require xorg-lib-common.inc
 
-LICENSE = "MIT & MIT-style & BSD-4-Clause & BSD-2-Clause"
+LICENSE = "MIT & MIT-style & BSD-1-Clause & HPND & HPND-sell-variant"
 LIC_FILES_CHKSUM = "file://COPYING;md5=172255dee66bb0151435b2d5d709fcf7"
 
 SRC_URI[md5sum] = "c5fa5a86a20e3591bed6c046498d4b8f"
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158037): 
https://lists.openembedded.org/g/openembedded-core/message/158037
Mute This Topic: https://lists.openembedded.org/mt/86932310/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 15/26] libx11: Update LICENSE to better reflect reality

2021-11-09 Thread Anuj Mittal
From: Peter Kjellerstedt 

There are no traces of neither the BSD-2-Clause license nor the
BSD-4-Clause license being used in the code. There is one occurrence
of the BSD-1-Clause license. On the other hand, HPND and
HPND-sell-variant are all over the place.

Signed-off-by: Peter Kjellerstedt 
Signed-off-by: Richard Purdie 
(cherry picked from commit 5cd90092e21ad245df40a60feed3598dd9c6b98b)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-graphics/xorg-lib/libx11_1.7.2.bb | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-graphics/xorg-lib/libx11_1.7.2.bb 
b/meta/recipes-graphics/xorg-lib/libx11_1.7.2.bb
index 7ee2a9c16a..f429daaf47 100644
--- a/meta/recipes-graphics/xorg-lib/libx11_1.7.2.bb
+++ b/meta/recipes-graphics/xorg-lib/libx11_1.7.2.bb
@@ -20,7 +20,7 @@ SRC_URI[sha256sum] = 
"1cfa35e37aaabbe4792e9bb690468efefbfbf6b147d9c69d6f90d13c30
 PROVIDES = "virtual/libx11"
 
 XORG_PN = "libX11"
-LICENSE = "MIT & MIT-style & BSD-4-Clause & BSD-2-Clause"
+LICENSE = "MIT & MIT-style & BSD-1-Clause & HPND & HPND-sell-variant"
 LIC_FILES_CHKSUM = "file://COPYING;md5=172255dee66bb0151435b2d5d709fcf7"
 
 DEPENDS += "xorgproto xtrans libxcb"
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158036): 
https://lists.openembedded.org/g/openembedded-core/message/158036
Mute This Topic: https://lists.openembedded.org/mt/86932309/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 14/26] libpcre/libpcre2: correct SRC_URI

2021-11-09 Thread Anuj Mittal
From: Alexander Kanavin 

http://ftp.pcre.org is down, take sources according to links on
http://www.pcre.org

Signed-off-by: Alexander Kanavin 
Signed-off-by: Richard Purdie 
(cherry picked from commit 81ba0ba3e8d9c08b8dc69c24fb1d91446739229b)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-support/libpcre/libpcre2_10.37.bb | 4 +++-
 meta/recipes-support/libpcre/libpcre_8.45.bb   | 2 +-
 2 files changed, 4 insertions(+), 2 deletions(-)

diff --git a/meta/recipes-support/libpcre/libpcre2_10.37.bb 
b/meta/recipes-support/libpcre/libpcre2_10.37.bb
index e0ead59da6..ccedf688d7 100644
--- a/meta/recipes-support/libpcre/libpcre2_10.37.bb
+++ b/meta/recipes-support/libpcre/libpcre2_10.37.bb
@@ -10,7 +10,9 @@ SECTION = "devel"
 LICENSE = "BSD-3-Clause"
 LIC_FILES_CHKSUM = "file://LICENCE;md5=6b3022283c9a79238d521848ea9dcb4d"
 
-SRC_URI = "https://ftp.pcre.org/pub/pcre/pcre2-${PV}.tar.bz2;
+SRC_URI = 
"https://github.com/PhilipHazel/pcre2/releases/download/pcre2-${PV}/pcre2-${PV}.tar.bz2;
+
+UPSTREAM_CHECK_URI = "https://github.com/PhilipHazel/pcre2/releases;
 
 SRC_URI[sha256sum] = 
"4d95a96e8b80529893b4562be12648d798b957b1ba1aae39606bbc2ab956d270"
 
diff --git a/meta/recipes-support/libpcre/libpcre_8.45.bb 
b/meta/recipes-support/libpcre/libpcre_8.45.bb
index 76b20f5f08..46fedbae48 100644
--- a/meta/recipes-support/libpcre/libpcre_8.45.bb
+++ b/meta/recipes-support/libpcre/libpcre_8.45.bb
@@ -7,7 +7,7 @@ HOMEPAGE = "http://www.pcre.org;
 SECTION = "devel"
 LICENSE = "BSD-3-Clause"
 LIC_FILES_CHKSUM = "file://LICENCE;md5=b5d5d1a69a24ea2718263f1ff85a1c58"
-SRC_URI = "https://ftp.pcre.org/pub/pcre/pcre-${PV}.tar.bz2 \
+SRC_URI = "${SOURCEFORGE_MIRROR}/pcre/pcre-${PV}.tar.bz2 \
file://run-ptest \
file://Makefile \
"
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158035): 
https://lists.openembedded.org/g/openembedded-core/message/158035
Mute This Topic: https://lists.openembedded.org/mt/86932308/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 13/26] kernel-devsrc: Add vdso.lds and other build files for riscv64 as well

2021-11-09 Thread Anuj Mittal
From: Khem Raj 

These additional bits are needed on riscv64 as well
Fixes
make[1]: *** No rule to make target 'arch/riscv/kernel/vdso/vdso.lds', needed 
by 'arch/riscv/kernel/vdso/vdso.so.dbg'.  Stop.
make: *** [arch/riscv/Makefile:114: vdso_prepare] Error 2

Signed-off-by: Khem Raj 
Cc: Bruce Ashfield 
Signed-off-by: Richard Purdie 
(cherry picked from commit 446972600ed51ca75a2a4e579cdc3e6dd2e05195)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-kernel/linux/kernel-devsrc.bb | 10 --
 1 file changed, 8 insertions(+), 2 deletions(-)

diff --git a/meta/recipes-kernel/linux/kernel-devsrc.bb 
b/meta/recipes-kernel/linux/kernel-devsrc.bb
index d39573965f..f22fac5bd6 100644
--- a/meta/recipes-kernel/linux/kernel-devsrc.bb
+++ b/meta/recipes-kernel/linux/kernel-devsrc.bb
@@ -109,8 +109,8 @@ do_install() {
fi
fi
 
-   if [ "${ARCH}" = "arm64" ]; then
-   cp -a --parents arch/arm64/kernel/vdso/vdso.lds $kerneldir/build/
+   if [ "${ARCH}" = "arm64" -o "${ARCH}" = "riscv" ]; then
+   cp -a --parents arch/${ARCH}/kernel/vdso/vdso.lds $kerneldir/build/
fi
if [ "${ARCH}" = "powerpc" ]; then
cp -a --parents arch/powerpc/kernel/vdso32/vdso32.lds 
$kerneldir/build 2>/dev/null || :
@@ -185,6 +185,12 @@ do_install() {
cp -a --parents arch/${ARCH}/kernel/vdso32/* $kerneldir/build/ 
2>/dev/null || :
cp -a --parents arch/${ARCH}/kernel/vdso64/* $kerneldir/build/ 
2>/dev/null || :
fi
+   if [ "${ARCH}" = "riscv" ]; then
+cp -a --parents arch/riscv/kernel/vdso/*gettimeofday.* 
$kerneldir/build/
+cp -a --parents arch/riscv/kernel/vdso/note.S $kerneldir/build/
+cp -a --parents arch/riscv/kernel/vdso/gen_vdso_offsets.sh 
$kerneldir/build/
+   cp -a --parents arch/riscv/kernel/vdso/* $kerneldir/build/ 
2>/dev/null || :
+   fi
 
# include the machine specific headers for ARM variants, if available.
if [ "${ARCH}" = "arm" ]; then
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158034): 
https://lists.openembedded.org/g/openembedded-core/message/158034
Mute This Topic: https://lists.openembedded.org/mt/86932306/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 11/26] create-spdx: Set the Organization field via a variable

2021-11-09 Thread Anuj Mittal
From: Andres Beltran 

Currently, the "Organization" field for SBOMs is hard-coded in
create-spdx. Create a new variable SPDX_ORG to make this field more
generic.

Signed-off-by: Andres Beltran 
Signed-off-by: Richard Purdie 
(cherry picked from commit f239814f3f5d9bd54de54b0f2a5081067336e32b)
Signed-off-by: Anuj Mittal 
---
 meta/classes/create-spdx.bbclass | 10 ++
 1 file changed, 6 insertions(+), 4 deletions(-)

diff --git a/meta/classes/create-spdx.bbclass b/meta/classes/create-spdx.bbclass
index c35dbe1184..eb1d446f3f 100644
--- a/meta/classes/create-spdx.bbclass
+++ b/meta/classes/create-spdx.bbclass
@@ -28,6 +28,8 @@ SPDX_NAMESPACE_PREFIX ??= "http://spdx.org/spdxdoc;
 
 SPDX_LICENSES ??= "${COREBASE}/meta/files/spdx-licenses.json"
 
+SPDX_ORG ??= "OpenEmbedded ()"
+
 do_image_complete[depends] = "virtual/kernel:do_create_spdx"
 
 def get_doc_namespace(d, doc):
@@ -415,7 +417,7 @@ python do_create_spdx() {
 doc.creationInfo.comment = "This document was created by analyzing recipe 
files during the build."
 doc.creationInfo.licenseListVersion = 
d.getVar("SPDX_LICENSE_DATA")["licenseListVersion"]
 doc.creationInfo.creators.append("Tool: OpenEmbedded Core 
create-spdx.bbclass")
-doc.creationInfo.creators.append("Organization: OpenEmbedded ()")
+doc.creationInfo.creators.append("Organization: %s" % d.getVar("SPDX_ORG"))
 doc.creationInfo.creators.append("Person: N/A ()")
 
 recipe = oe.spdx.SPDXPackage()
@@ -519,7 +521,7 @@ python do_create_spdx() {
 package_doc.creationInfo.comment = "This document was created by 
analyzing packages created during the build."
 package_doc.creationInfo.licenseListVersion = 
d.getVar("SPDX_LICENSE_DATA")["licenseListVersion"]
 package_doc.creationInfo.creators.append("Tool: OpenEmbedded Core 
create-spdx.bbclass")
-package_doc.creationInfo.creators.append("Organization: 
OpenEmbedded ()")
+package_doc.creationInfo.creators.append("Organization: %s" % 
d.getVar("SPDX_ORG"))
 package_doc.creationInfo.creators.append("Person: N/A ()")
 package_doc.externalDocumentRefs.append(recipe_ref)
 
@@ -653,7 +655,7 @@ python do_create_runtime_spdx() {
 runtime_doc.creationInfo.comment = "This document was created by 
analyzing package runtime dependencies."
 runtime_doc.creationInfo.licenseListVersion = 
d.getVar("SPDX_LICENSE_DATA")["licenseListVersion"]
 runtime_doc.creationInfo.creators.append("Tool: OpenEmbedded Core 
create-spdx.bbclass")
-runtime_doc.creationInfo.creators.append("Organization: 
OpenEmbedded ()")
+runtime_doc.creationInfo.creators.append("Organization: %s" % 
d.getVar("SPDX_ORG"))
 runtime_doc.creationInfo.creators.append("Person: N/A ()")
 
 package_ref = oe.spdx.SPDXExternalDocumentRef()
@@ -813,7 +815,7 @@ python image_combine_spdx() {
 doc.creationInfo.comment = "This document was created by analyzing the 
source of the Yocto recipe during the build."
 doc.creationInfo.licenseListVersion = 
d.getVar("SPDX_LICENSE_DATA")["licenseListVersion"]
 doc.creationInfo.creators.append("Tool: OpenEmbedded Core 
create-spdx.bbclass")
-doc.creationInfo.creators.append("Organization: OpenEmbedded ()")
+doc.creationInfo.creators.append("Organization: %s" % d.getVar("SPDX_ORG"))
 doc.creationInfo.creators.append("Person: N/A ()")
 
 image = oe.spdx.SPDXPackage()
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158032): 
https://lists.openembedded.org/g/openembedded-core/message/158032
Mute This Topic: https://lists.openembedded.org/mt/86932304/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 12/26] meson: set objcopy in the cross and native toolchain files

2021-11-09 Thread Anuj Mittal
From: Ross Burton 

Signed-off-by: Ross Burton 
Signed-off-by: Richard Purdie 
(cherry picked from commit 0a589998e717ae3865f0db5abe6005ab4eee86d9)
Signed-off-by: Anuj Mittal 
---
 meta/classes/meson.bbclass | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/meta/classes/meson.bbclass b/meta/classes/meson.bbclass
index da58cb4bec..4ba70de3dc 100644
--- a/meta/classes/meson.bbclass
+++ b/meta/classes/meson.bbclass
@@ -48,6 +48,7 @@ ar = ${@meson_array('AR', d)}
 nm = ${@meson_array('NM', d)}
 strip = ${@meson_array('STRIP', d)}
 readelf = ${@meson_array('READELF', d)}
+objcopy = ${@meson_array('OBJCOPY', d)}
 pkgconfig = 'pkg-config'
 llvm-config = 'llvm-config${LLVMVERSION}'
 cups-config = 'cups-config'
@@ -85,6 +86,7 @@ ar = ${@meson_array('BUILD_AR', d)}
 nm = ${@meson_array('BUILD_NM', d)}
 strip = ${@meson_array('BUILD_STRIP', d)}
 readelf = ${@meson_array('BUILD_READELF', d)}
+objcopy = ${@meson_array('BUILD_OBJCOPY', d)}
 pkgconfig = 'pkg-config-native'
 
 [built-in options]
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158033): 
https://lists.openembedded.org/g/openembedded-core/message/158033
Mute This Topic: https://lists.openembedded.org/mt/86932305/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 09/26] strace: fix build against 5.15 kernel/kernel-headers

2021-11-09 Thread Anuj Mittal
From: Bruce Ashfield 

kernel 5.15 removed ipx.h from the uapi, but strace hasn't adjusted
its tests to the removal.

There is a WIP patch on the esyr/5.15 branch that solves the problem,
so we grab it here, adjust for context and fix our build problem.

When strace updates to 5.15, and we can bump our version and drop
this patch.

Upstream-Status: Backport [commit cca828197c0e16c2599129114]

Signed-off-by: Bruce Ashfield 
Signed-off-by: Richard Purdie 
(cherry picked from commit a8c4ba727251e53494a4aec483fcc51982e6fb75)
Signed-off-by: Anuj Mittal 
---
 ...1-Avoid-relying-on-presence-of-ipx.h.patch | 151 ++
 meta/recipes-devtools/strace/strace_5.14.bb   |   1 +
 2 files changed, 152 insertions(+)
 create mode 100644 
meta/recipes-devtools/strace/strace/0001-Avoid-relying-on-presence-of-ipx.h.patch

diff --git 
a/meta/recipes-devtools/strace/strace/0001-Avoid-relying-on-presence-of-ipx.h.patch
 
b/meta/recipes-devtools/strace/strace/0001-Avoid-relying-on-presence-of-ipx.h.patch
new file mode 100644
index 00..6df673fa95
--- /dev/null
+++ 
b/meta/recipes-devtools/strace/strace/0001-Avoid-relying-on-presence-of-ipx.h.patch
@@ -0,0 +1,151 @@
+From 197f712ea96c12dcabc9fe98889a425d61ad6a60 Mon Sep 17 00:00:00 2001
+From: Eugene Syromyatnikov 
+Date: Wed, 3 Nov 2021 00:48:59 +0100
+Subject: [PATCH] Avoid relying on presence of ipx.h
+
+After Linux has broken UAPI in commit v5.15-rc1~157^2~207, it is well
+possible that neither kernel nor libc (such as musl, for example)
+provide IPX-related header.  Avoid relying on its presence
+in the strace's code and conditionalise the relevant checks in the tests.
+
+* configure.ac (AC_CHECK_HEADERS): Add linux/ipx.h.
+* src/net.c: Remove / includes.
+* src/sockaddr.c: Likewise.
+(IPX_NODE_LEN): New macro constant.
+(struct sockaddr_ipx): New type definition.
+* src/xlat/sock_ipx_options.in (IPX_TYPE): Provide a fallback value.
+* tests/net-sockaddr.c [!HAVE_LINUX_IPX_H]: Do not include
+.
+[!HAVE_LINUX_IPX_H && HAVE_NETIPX_IPX_H]: Include .
+[!(HAVE_LINUX_IPX_H || defined HAVE_NETIPX_IPX_H)]: Do not define
+check_ipx.
+[!(HAVE_LINUX_IPX_H || defined HAVE_NETIPX_IPX_H)] (main): Do not call
+check_ipx.
+
+Closes: https://github.com/strace/strace/issues/201
+
+Upstream-Status: backport [commit cca828197c0e1 branch esyr/5.15]
+
+[bva: changed context to apply to a released strace 5.14 tarball]
+Signed-off-by: Bruce Ashfield 
+
+---
+ configure.ac |  1 +
+ src/net.c|  5 -
+ src/sockaddr.c   | 16 ++--
+ src/xlat/sock_ipx_options.in |  2 +-
+ tests/net-sockaddr.c | 10 +-
+ 5 files changed, 21 insertions(+), 13 deletions(-)
+
+Index: strace-5.14/configure.ac
+===
+--- strace-5.14.orig/configure.ac
 strace-5.14/configure.ac
+@@ -423,6 +423,7 @@
+   elf.h
+   gcov.h
+   iconv.h
++  linux/ipx.h
+   mqueue.h
+   netinet/sctp.h
+   netipx/ipx.h
+Index: strace-5.14/src/net.c
+===
+--- strace-5.14.orig/src/net.c
 strace-5.14/src/net.c
+@@ -28,11 +28,6 @@
+ #include 
+ #include 
+ #include 
+-#ifdef HAVE_NETIPX_IPX_H
+-# include 
+-#else
+-# include 
+-#endif
+ 
+ #include 
+ #include "netlink.h"
+Index: strace-5.14/src/sockaddr.c
+===
+--- strace-5.14.orig/src/sockaddr.c
 strace-5.14/src/sockaddr.c
+@@ -24,12 +24,6 @@
+ #include 
+ #include 
+ 
+-#ifdef HAVE_NETIPX_IPX_H
+-# include 
+-#else
+-# include 
+-#endif
+-
+ #include "xlat/addrfams.h"
+ #include "xlat/arp_hardware_types.h"
+ #include "xlat/ethernet_protocols.h"
+@@ -45,6 +39,16 @@
+ const size_t arp_hardware_types_size = ARRAY_SIZE(arp_hardware_types) - 1;
+ const size_t ethernet_protocols_size = ARRAY_SIZE(ethernet_protocols) - 1;
+ 
++#define IPX_NODE_LEN  6
++struct sockaddr_ipx {
++  uint16_t sipx_family;
++  uint16_t sipx_port;
++  uint32_t sipx_network;
++  unsigned char sipx_node[IPX_NODE_LEN];
++  uint8_t sipx_type;
++  unsigned char sipx_zero;
++};
++
+ static void
+ print_sockaddr_data_un(struct tcb *tcp, const void *const buf, const int 
addrlen)
+ {
+Index: strace-5.14/src/xlat/sock_ipx_options.in
+===
+--- strace-5.14.orig/src/xlat/sock_ipx_options.in
 strace-5.14/src/xlat/sock_ipx_options.in
+@@ -1 +1 @@
+-IPX_TYPE
++IPX_TYPE  1
+Index: strace-5.14/tests/net-sockaddr.c
+===
+--- strace-5.14.orig/tests/net-sockaddr.c
 strace-5.14/tests/net-sockaddr.c
+@@ -24,7 +24,11 @@
+ #include 
+ #include 
+ #include 
+-#include 
++#if defined HAVE_LINUX_IPX_H
++# include 
++#elif defined HAVE_NETIPX_IPX_H
++# include 
++#endif
+ #ifdef HAVE_BLUETOOTH_BLUETOOTH_H
+ # include 
+ # include 
+@@ -269,6 +273,7 @@
+   printf("connect(-1, 

[OE-core] [honister][PATCH 10/26] sstate: another fix for touching files inside pseudo

2021-11-09 Thread Anuj Mittal
From: Jose Quaresma 

This patch is a fixup for 676757f "sstate: fix touching files inside pseudo"

running the 'id' command inside the sstate_unpack_package
function shows that this funcion run inside the pseudo:

 uid=0(root) gid=0(root) groups=0(root)

The check for [ -w ${SSTATE_PKG} ] and [ -O ${SSTATE_PKG}.siginfo ]
will always return true and the touch can fail when the real user
don't have permission or in readonly filesystem.

As the documentation refers:
- the file test operator "-w" check if the file has write permission
(for the user running the test).
- the file test operator "-O" check if you are owner of file

We can avoid this test running the touch and mask any return errors
that we have.

(From OE-Core rev: 29fc85997ade490ae46ffca37ef8e1a56957c876)

Signed-off-by: Jose Quaresma 
Signed-off-by: Richard Purdie 
(cherry picked from commit 5b9210d66c78bb3f79056e5586cea7b0edd714a9)
Signed-off-by: Anuj Mittal 
---
 meta/classes/sstate.bbclass | 12 ++--
 1 file changed, 6 insertions(+), 6 deletions(-)

diff --git a/meta/classes/sstate.bbclass b/meta/classes/sstate.bbclass
index 1f37383598..ba2c9fee35 100644
--- a/meta/classes/sstate.bbclass
+++ b/meta/classes/sstate.bbclass
@@ -888,12 +888,12 @@ python sstate_report_unihash() {
 #
 sstate_unpack_package () {
tar -xvzf ${SSTATE_PKG}
-   # update .siginfo atime on local/NFS mirror
-   [ -O ${SSTATE_PKG}.siginfo ] && [ -w ${SSTATE_PKG}.siginfo ] && [ -h 
${SSTATE_PKG}.siginfo ] && touch -a ${SSTATE_PKG}.siginfo
-   # Use "! -w ||" to return true for read only files
-   [ ! -w ${SSTATE_PKG} ] || touch --no-dereference ${SSTATE_PKG}
-   [ ! -w ${SSTATE_PKG}.sig ] || [ ! -e ${SSTATE_PKG}.sig ] || touch 
--no-dereference ${SSTATE_PKG}.sig
-   [ ! -w ${SSTATE_PKG}.siginfo ] || [ ! -e ${SSTATE_PKG}.siginfo ] || 
touch --no-dereference ${SSTATE_PKG}.siginfo
+   # update .siginfo atime on local/NFS mirror if it is a symbolic link
+   [ ! -h ${SSTATE_PKG}.siginfo ] || touch -a ${SSTATE_PKG}.siginfo 
2>/dev/null || true
+   # update each symbolic link instead of any referenced file
+   touch --no-dereference ${SSTATE_PKG} 2>/dev/null || true
+   [ ! -e ${SSTATE_PKG}.sig ] || touch --no-dereference ${SSTATE_PKG}.sig 
2>/dev/null || true
+   [ ! -e ${SSTATE_PKG}.siginfo ] || touch --no-dereference 
${SSTATE_PKG}.siginfo 2>/dev/null || true
 }
 
 BB_HASHCHECK_FUNCTION = "sstate_checkhashes"
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158031): 
https://lists.openembedded.org/g/openembedded-core/message/158031
Mute This Topic: https://lists.openembedded.org/mt/86932303/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 07/26] linux-yocto/5.10: update to v5.10.76

2021-11-09 Thread Anuj Mittal
From: Bruce Ashfield 

Updating linux-yocto/5.10 to the latest korg -stable release that comprises
the following commits:

378e85d1aeb5 Linux 5.10.76
cfa79faf7e1f pinctrl: stm32: use valid pin identifier in 
stm32_pinctrl_resume()
c56c801391c3 ARM: 9122/1: select HAVE_FUTEX_CMPXCHG
d088db8637bb selftests: bpf: fix backported ASSERT_FALSE
3a845fa00fd7 e1000e: Separate TGP board type from SPT
021b6d11e590 tracing: Have all levels of checks prevent recursion
3a0dc2e35a5d net: mdiobus: Fix memory leak in __mdiobus_register
cfe9266213c4 bpf, test, cgroup: Use sk_{alloc,free} for test cases
188907c25218 s390/pci: fix zpci_zdev_put() on reserve
f18b90e9366f can: isotp: isotp_sendmsg(): fix TX buffer concurrent access 
in isotp_sendmsg()
2304dfb548a4 scsi: core: Fix shost->cmd_per_lun calculation in 
scsi_add_host_with_dma()
c58654f344dd net: hns3: fix for miscalculation of rx unused desc
96fe5061291d sched/scs: Reset the shadow stack when idle_task_exit
96f0aebf29be scsi: qla2xxx: Fix a memory leak in an error path of 
qla2x00_process_els()
90c8e8c0829b scsi: iscsi: Fix set_param() handling
0eb254479685 Input: snvs_pwrkey - add clk handling
ea9c1f5d8a3a perf/x86/msr: Add Sapphire Rapids CPU support
7a5a1f09c8b4 libperf tests: Fix test_stat_cpu
e56a3e7ae353 ALSA: hda: avoid write to STATESTS if controller is in reset
85c8d8c1609d platform/x86: intel_scu_ipc: Update timeout value in comment
9f591cbdbed3 isdn: mISDN: Fix sleeping function called from invalid context
ab4f542b515b ARM: dts: spear3xx: Fix gmac node
15d3ad79885b net: stmmac: add support for dwmac 3.40a
f9d16a428489 btrfs: deal with errors when checking if a dir entry exists 
during log replay
369db2a91d5c ALSA: hda: intel: Allow repeatedly probing on codec 
configuration errors
81d8e70cdce4 gcc-plugins/structleak: add makefile var for disabling 
structleak
69078a94365a net: hns3: fix the max tx size according to user manual
f40c2281d2c0 drm: mxsfb: Fix NULL pointer dereference crash on unload
96835b68d7b3 net: bridge: mcast: use multicast_membership_interval for 
IGMPv3
0e033cb40761 selftests: netfilter: remove stray bash debug line
f8a6541345c2 netfilter: Kconfig: use 'default y' instead of 'm' for bool 
config option
7f221ccbee4e isdn: cpai: check ctr->cnr to avoid array index out of bound
77c0ef979e32 nfc: nci: fix the UAF of rf_conn_info object
8f042315fcc4 KVM: nVMX: promptly process interrupts delivered while in 
guest mode
b41fd8f5d2ad mm, slub: fix incorrect memcg slab count for bulk free
568f906340b4 mm, slub: fix potential memoryleak in kmem_cache_open()
48843dd23c7b mm, slub: fix mismatch between reconstructed freelist depth 
and cnt
c5c2a80368e9 powerpc/idle: Don't corrupt back chain when going idle
197ec50b2df1 KVM: PPC: Book3S HV: Make idle_kvm_start_guest() return 0 if 
it went to guest
fbd724c49bea KVM: PPC: Book3S HV: Fix stack handling in 
idle_kvm_start_guest()
9258f58432c5 powerpc64/idle: Fix SP offsets when saving GPRs
3e16d9d525a7 net: dsa: mt7530: correct ds->num_ports
16802fa4c33e audit: fix possible null-pointer dereference in 
audit_filter_rules
0d867a359979 ASoC: DAPM: Fix missing kctl change notifications
a2606acf418e ALSA: hda/realtek: Add quirk for Clevo PC50HS
6411397b6d7a ALSA: usb-audio: Provide quirk for Sennheiser GSP670 Headset
b721500c979b vfs: check fd has read access in kernel_read_file_from_fd()
895ceeff31b1 elfcore: correct reference to CONFIG_UML
3cda4bfffd4f userfaultfd: fix a race between writeprotect and exit_mmap()
93be0eeea14c ocfs2: mount fails with buffer overflow in strlen
f1b98569e81c ocfs2: fix data corruption after conversion from inline format
1727e8688d2e ceph: fix handling of "meta" errors
603d4bcc0fcd ceph: skip existing superblocks that are blocklisted or shut 
down when mounting
d48db508f911 can: j1939: j1939_xtp_rx_rts_session_new(): abort TP less than 
9 bytes
5abc9b9d3ca5 can: j1939: j1939_xtp_rx_dat_one(): cancel session if receive 
TP.DT with error length
864e1a24 can: j1939: j1939_netdev_start(): fix UAF for rx_kref of 
j1939_priv
ecfccb1c58c9 can: j1939: j1939_tp_rxtimer(): fix errant alert in 
j1939_tp_rxtimer
053bc12df0d6 can: isotp: isotp_sendmsg(): add result check for 
wait_event_interruptible()
0917fb04069a can: isotp: isotp_sendmsg(): fix return error on FC timeout on 
TX path
28f28e4bc3a5 can: peak_pci: peak_pci_remove(): fix UAF
9697ad6395f9 can: peak_usb: pcan_usb_fd_decode_status(): fix back to 
ERROR_ACTIVE state notification
4758e92e75ca can: rcar_can: fix suspend/resume
4a0928c3ebca net: enetc: fix ethtool counter name for PM0_TERR
00ad7a015409 drm/panel: ilitek-ili9881c: Fix sync for Feixin K101-IM2BYL02 
panel
eccd00728b1a ice: Add missing E810 device ids
6418508a3ac2 e1000e: Fix packet loss on Tiger Lake and 

[OE-core] [honister][PATCH 08/26] linux-yocto-rt/5.10: update to -rt54

2021-11-09 Thread Anuj Mittal
From: Bruce Ashfield 

Integrating the following commit(s) to linux-yocto-rt/5.10:

f01089784fd6 Linux 5.10.73-rt54
f34df8f3c666 Linux 5.10.65-rt53
271c5e6e4064 Linux 5.10.59-rt52
1a4bba4bc32c locking/rwsem-rt: Remove might_sleep() in __up_read()
ff591a2bdcfb Linux 5.10.59-rt51
8d185ac23c11 Linux 5.10.58-rt50
2c0fd44153f5 Linux 5.10.56-rt49
8b083d3c993c printk: Enhance the condition check of msleep in pr_flush()
448cd29e3bc9 Linux 5.10.56-rt48

Signed-off-by: Bruce Ashfield 
Signed-off-by: Richard Purdie 
(cherry picked from commit 7c7dc8f38cf1e874a7722389c95d895e10855d9a)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb 
b/meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb
index 34bb95e4fc..c210667350 100644
--- a/meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-rt_5.10.bb
@@ -11,7 +11,7 @@ python () {
 raise bb.parse.SkipRecipe("Set PREFERRED_PROVIDER_virtual/kernel to 
linux-yocto-rt to enable it")
 }
 
-SRCREV_machine ?= "f7d2419be110c618b74cbaddaafbabf4a886b91b"
+SRCREV_machine ?= "f01089784fd6234111851aad756297e0f258276c"
 SRCREV_meta ?= "e1979ceb171bc91ef2cb71cfcde548a101dab687"
 
 SRC_URI = 
"git://git.yoctoproject.org/linux-yocto.git;branch=${KBRANCH};name=machine \
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158029): 
https://lists.openembedded.org/g/openembedded-core/message/158029
Mute This Topic: https://lists.openembedded.org/mt/86932301/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 05/26] opkg: Fix poor operator combination choice

2021-11-09 Thread Anuj Mittal
From: Richard Purdie 

Combining :append with += rarely makes sense. Improve it to use the standard
format (and tweak the implied spacing).

Signed-off-by: Richard Purdie 
(cherry picked from commit 768766dc007ebe9b4bc38d425584be03fbdb98c1)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-devtools/opkg/opkg_0.4.5.bb | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/opkg/opkg_0.4.5.bb 
b/meta/recipes-devtools/opkg/opkg_0.4.5.bb
index ef18ccf63a..8152fa0658 100644
--- a/meta/recipes-devtools/opkg/opkg_0.4.5.bb
+++ b/meta/recipes-devtools/opkg/opkg_0.4.5.bb
@@ -60,7 +60,7 @@ do_install_ptest () {
sed -i -e '/@PYTHONPATH=. $(PYTHON) $^/a\\t@if [ "$$?" != "0" ];then 
echo "FAIL:"$^;else echo "PASS:"$^;fi' ${D}${PTEST_PATH}/tests/Makefile
 }
 
-WARN_QA:append += "openssl-deprecation"
+WARN_QA:append = " openssl-deprecation"
 QAPKGTEST[openssl-deprecation] = "package_qa_check_openssl_deprecation"
 def package_qa_check_openssl_deprecation (package, d, messages):
 sane = True
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158026): 
https://lists.openembedded.org/g/openembedded-core/message/158026
Mute This Topic: https://lists.openembedded.org/mt/86932297/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 06/26] linux-yocto/5.14: update to v5.14.15

2021-11-09 Thread Anuj Mittal
From: Bruce Ashfield 

Updating linux-yocto/5.14 to the latest korg -stable release that comprises
the following commits:

b46092c7497e Linux 5.14.15
96e4ea34f6d7 pinctrl: stm32: use valid pin identifier in 
stm32_pinctrl_resume()
4850e9e3c6a3 ARM: 9122/1: select HAVE_FUTEX_CMPXCHG
80344938e468 e1000e: Separate TGP board type from SPT
0c4e87ba11eb net: mdiobus: Fix memory leak in __mdiobus_register
2f4356963624 bpf, test, cgroup: Use sk_{alloc,free} for test cases
4e5d794a2743 s390/pci: fix zpci_zdev_put() on reserve
e27170d5f2fc s390/pci: cleanup resources only if necessary
2be38f02ec89 scsi: core: Fix shost->cmd_per_lun calculation in 
scsi_add_host_with_dma()
ff261f9aa654 autofs: fix wait name hash calculation in autofs_wait()
1009f098dfbe drm/kmb: Limit supported mode to 1080p
217d42e8b835 drm/kmb: Enable alpha blended second plane
c1ad040dbea8 net/mlx5: Lag, change multipath and bonding to be mutually 
exclusive
d2ec7d208d8e net/mlx5: Lag, move lag destruction to a workqueue
42b6431f1c17 net: hns3: fix for miscalculation of rx unused desc
f1972f14f16e sched/scs: Reset the shadow stack when idle_task_exit
c4813d308517 mm/thp: decrease nr_thps in file's mapping on THP split
a7fbb56e6c94 scsi: qla2xxx: Fix a memory leak in an error path of 
qla2x00_process_els()
c8c1b2183fb8 scsi: mpi3mr: Fix duplicate device entries when scanning 
through sysfs
ce527668277c scsi: storvsc: Fix validation for unsolicited incoming packets
08d82a9b65e7 scsi: iscsi: Fix set_param() handling
6408a4c8da2f ASoC: codec: wcd938x: Add irq config support
9eb2aaede632 Input: snvs_pwrkey - add clk handling
9dd0389d77b9 perf/x86/msr: Add Sapphire Rapids CPU support
11d6811cbde0 libperf tests: Fix test_stat_cpu
65eec1fb58c1 libperf test evsel: Fix build error on !x86 architectures
b6062308c510 spi-mux: Fix false-positive lockdep splats
722ef19a161c spi: Fix deadlock when adding SPI controllers on SPI buses
785d69099ef4 ALSA: hda: avoid write to STATESTS if controller is in reset
3972b03ed085 platform/x86: intel_scu_ipc: Update timeout value in comment
6659008140b4 platform/x86: intel_scu_ipc: Increase virtual timeout to 10s
f5966ba53013 isdn: mISDN: Fix sleeping function called from invalid context
ef24577a52ba ARM: dts: spear3xx: Fix gmac node
834cc3fc2b99 net: stmmac: add support for dwmac 3.40a
0c878175dd2f btrfs: deal with errors when checking if a dir entry exists 
during log replay
051995bd0f42 ALSA: hda: intel: Allow repeatedly probing on codec 
configuration errors
9906da162dc8 objtool: Update section header before relocations
e73e72be194e objtool: Check for gelf_update_rel[a] failures
515e03331255 bitfield: build kunit tests without structleak plugin
3f66b6e01c82 thunderbolt: build kunit tests without structleak plugin
d9f94a8ec35a device property: build kunit tests without structleak plugin
2c793a67d71b iio/test-format: build kunit tests without structleak plugin
930f561aae28 gcc-plugins/structleak: add makefile var for disabling 
structleak
1d1af4da1c44 drm/msm/a6xx: Serialize GMU communication
bbdd158b40b6 kunit: fix reference count leak in kfree_at_end
dfcc47a1fe36 KVM: MMU: Reset mmu->pkru_mask to avoid stale data
e647d75565ab net: hns3: fix the max tx size according to user manual
b0e6db0656dd drm: mxsfb: Fix NULL pointer dereference crash on unload
56a3d9637b77 KVM: SEV-ES: Set guest_state_protected after VMSA update
d469678d6b50 net: bridge: mcast: use multicast_membership_interval for 
IGMPv3
8f20259f186e selftests: netfilter: remove stray bash debug line
057aef8df940 netfilter: Kconfig: use 'default y' instead of 'm' for bool 
config option
cc20226e218a isdn: cpai: check ctr->cnr to avoid array index out of bound
6197eb050cfa nfc: nci: fix the UAF of rf_conn_info object
fb82d4dbee95 KVM: x86: remove unnecessary arguments from 
complete_emulator_pio_in
66e46fe3f276 KVM: x86: split the two parts of emulator_pio_in
9887c1668ada KVM: x86: check for interrupts before deciding whether to exit 
the fast path
169577c8840e KVM: x86: leave vcpu->arch.pio.count alone in 
emulator_pio_in_out
62a1a254ed83 KVM: SEV-ES: reduce ghcb_sa_len to 32 bits
3f54362dc7d7 KVM: SEV-ES: go over the sev_pio_data buffer in multiple 
passes if needed
4988e000b3a8 KVM: SEV-ES: fix length of string I/O
727286b23f93 KVM: SEV-ES: keep INS functions together
98c55c508df0 KVM: SEV-ES: clean up kvm_sev_es_ins/outs
abcae3cd6272 KVM: SEV-ES: rename guest_ins_data to sev_pio_data
6697ceb9f6cd KVM: SEV: Flush cache on non-coherent systems before 
RECEIVE_UPDATE_DATA
495bd03b6ba5 KVM: nVMX: promptly process interrupts delivered while in 
guest mode
dc94b8b3f28a mm, slub: fix incorrect memcg slab count for bulk free
159d8cfbd042 mm, slub: fix potential use-after-free in slab_debugfs_fops

[OE-core] [honister][PATCH 04/26] linux-firmware: upgrade 20210919 -> 20211027

2021-11-09 Thread Anuj Mittal
From: Alexander Kanavin 

License-Update: additional firmwares listed

Signed-off-by: Alexander Kanavin 
Signed-off-by: Richard Purdie 
(cherry picked from commit 1ca3fb1c7f11e04bf8d8bf59901ddd60178cb13c)
Signed-off-by: Anuj Mittal 
---
 ...{linux-firmware_20210919.bb => linux-firmware_20211027.bb} | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
 rename meta/recipes-kernel/linux-firmware/{linux-firmware_20210919.bb => 
linux-firmware_20211027.bb} (99%)

diff --git a/meta/recipes-kernel/linux-firmware/linux-firmware_20210919.bb 
b/meta/recipes-kernel/linux-firmware/linux-firmware_20211027.bb
similarity index 99%
rename from meta/recipes-kernel/linux-firmware/linux-firmware_20210919.bb
rename to meta/recipes-kernel/linux-firmware/linux-firmware_20211027.bb
index 48c01d99fe..97d42e98e2 100644
--- a/meta/recipes-kernel/linux-firmware/linux-firmware_20210919.bb
+++ b/meta/recipes-kernel/linux-firmware/linux-firmware_20211027.bb
@@ -132,7 +132,7 @@ LIC_FILES_CHKSUM = 
"file://LICENCE.Abilis;md5=b5ee3f410780e56711ad48eadc22b8bc \
 file://LICENCE.xc4000;md5=0ff51d2dc49fce04814c9155081092f0 
\
 file://LICENCE.xc5000;md5=1e170c13175323c32c7f4d0998d53f66 
\
 
file://LICENCE.xc5000c;md5=12b02efa3049db65d524aeb418dd87ca \
-file://WHENCE;md5=76f012f7e9b2260d34eccf5726374f08 \
+file://WHENCE;md5=d627873bd934d7c52b2c8191304a8eb7 \
 "
 
 # These are not common licenses, set NO_GENERIC_LICENSE for them
@@ -205,7 +205,7 @@ PE = "1"
 
 SRC_URI = "${KERNELORG_MIRROR}/linux/kernel/firmware/${BPN}-${PV}.tar.xz"
 
-SRC_URI[sha256sum] = 
"2fb22a5d7d23bf1f5800ab8152b39a00a445fbf4923de5a01b59d3f6253f0a9f"
+SRC_URI[sha256sum] = 
"bc2657dd8eb82386a9a7ec6df9ccf31c32c7e9073c05d37786c1edc273f9440a"
 
 inherit allarch
 
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158025): 
https://lists.openembedded.org/g/openembedded-core/message/158025
Mute This Topic: https://lists.openembedded.org/mt/86932296/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 03/26] dpkg: Install dkpg-perl scripts to versioned perl directory

2021-11-09 Thread Anuj Mittal
From: Manuel Leonhardt 

Install dpkg-perl scripts to versioned perl directory, otherwise the
following traceback happens when running, e.g. dpkg-architecture on the
target:

Can't locate Dpkg.pm in @INC (you may need to install the Dpkg module)
  (@INC contains: /usr/lib/perl5/site_perl/5.30.1/aarch64-linux
  /usr/lib/perl5/site_perl/5.30.1
  /usr/lib/perl5/vendor_perl/5.30.1/aarch64-linux
  /usr/lib/perl5/vendor_perl/5.30.1
  /usr/lib/perl5/5.30.1/aarch64-linux
  /usr/lib/perl5/5.30.1 .) at /usr/bin/dpkg-architecture line 25.

Cc: Richard Purdie 
Signed-off-by: Manuel Leonhardt 
Signed-off-by: Richard Purdie 
(cherry picked from commit bdd4757ae057c7b3bfe27353fa25c4d7807a86ce)
Signed-off-by: Anuj Mittal 
---
 meta/recipes-devtools/dpkg/dpkg.inc | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/meta/recipes-devtools/dpkg/dpkg.inc 
b/meta/recipes-devtools/dpkg/dpkg.inc
index b6807b004f..74074cfdd7 100644
--- a/meta/recipes-devtools/dpkg/dpkg.inc
+++ b/meta/recipes-devtools/dpkg/dpkg.inc
@@ -15,7 +15,7 @@ inherit autotools gettext perlnative pkgconfig perl-version 
update-alternatives
 
 PERL:class-native = "${STAGING_BINDIR_NATIVE}/perl-native/perl"
 
-export PERL_LIBDIR = "${libdir}/perl/${@get_perl_version(d)}"
+export PERL_LIBDIR = "${libdir}/perl5/${@get_perl_version(d)}"
 PERL_LIBDIR:class-native = "${libdir}/perl-native/perl/${@get_perl_version(d)}"
 
 EXTRA_OECONF = "\
@@ -66,7 +66,7 @@ FILES:update-alternatives-dpkg = 
"${bindir}/update-alternatives ${localstatedir}
 RPROVIDES:update-alternatives-dpkg += "update-alternatives"
 
 PACKAGES += "${PN}-perl"
-FILES:${PN}-perl = "${libdir}/perl/${@get_perl_version(d)}"
+FILES:${PN}-perl = "${libdir}/perl5/${@get_perl_version(d)}"
 
 RDEPENDS:${PN}-perl += "perl-module-carp perl-module-constant \
 perl-module-cwd perl-module-digest \
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158024): 
https://lists.openembedded.org/g/openembedded-core/message/158024
Mute This Topic: https://lists.openembedded.org/mt/86932294/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 02/26] sstate: Account for reserved characters when shortening sstate filenames

2021-11-09 Thread Anuj Mittal
From: Manuel Leonhardt 

Previously, when shortening sstate filenames, the reserved
characters for .siginfo were not considered, when siginfo=False,
resulting in differently shortend filenames for the sstate and siginfo
files. With this change, the filenames of the truncated sstate and
siginfo files have the same basename, just as is already the case for
untruncated filenames.

Making sure that the .siginfo files always have the filename of the
corresponding sstate file plus its .siginfo suffix, also when being
truncated, makes it easier to manage the sstate cache and an sstate
mirror outside of Bitbake/Yocto.

Signed-off-by: Manuel Leonhardt 
Cc: Richard Purdie 
Signed-off-by: Richard Purdie 
(cherry picked from commit c2e0e43b7123cf5149833e0072c8edaea3629112)
Signed-off-by: Anuj Mittal 
---
 meta/classes/sstate.bbclass | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/classes/sstate.bbclass b/meta/classes/sstate.bbclass
index 240ae111ee..1f37383598 100644
--- a/meta/classes/sstate.bbclass
+++ b/meta/classes/sstate.bbclass
@@ -20,7 +20,7 @@ def generate_sstatefn(spec, hash, taskname, siginfo, d):
 components = spec.split(":")
 # Fields 0,5,6 are mandatory, 1 is most useful, 2,3,4 are just for 
information
 # 7 is for the separators
-avail = (254 - len(hash + "_" + taskname + extension) - 
len(components[0]) - len(components[1]) - len(components[5]) - 
len(components[6]) - 7) // 3
+avail = (limit - len(hash + "_" + taskname + extension) - 
len(components[0]) - len(components[1]) - len(components[5]) - 
len(components[6]) - 7) // 3
 components[2] = components[2][:avail]
 components[3] = components[3][:avail]
 components[4] = components[4][:avail]
-- 
2.31.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158023): 
https://lists.openembedded.org/g/openembedded-core/message/158023
Mute This Topic: https://lists.openembedded.org/mt/86932293/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [honister][PATCH 00/26] Review request

2021-11-09 Thread Anuj Mittal
Next set of changes for honister. Please review. No issues seen while
testing except for an intermittent qemu shutdown failure.

Thanks,

Anuj

The following changes since commit 3cbe3e6f932151800793854ad5d3569dc6f36ab1:

  qemu.inc: Remove empty egg-info directories before running meson (2021-11-03 
00:40:35 +0800)

are available in the Git repository at:

  git://push.openembedded.org/openembedded-core-contrib anujm/honister

Alexander Kanavin (2):
  linux-firmware: upgrade 20210919 -> 20211027
  libpcre/libpcre2: correct SRC_URI

Andres Beltran (1):
  create-spdx: Set the Organization field via a variable

Bruce Ashfield (4):
  linux-yocto/5.14: update to v5.14.15
  linux-yocto/5.10: update to v5.10.76
  linux-yocto-rt/5.10: update to -rt54
  strace: fix build against 5.15 kernel/kernel-headers

Jose Quaresma (1):
  sstate: another fix for touching files inside pseudo

Kai Kang (1):
  squashfs-tools: fix CVE-2021-41072

Khem Raj (1):
  kernel-devsrc: Add vdso.lds and other build files for riscv64 as well

Manuel Leonhardt (2):
  sstate: Account for reserved characters when shortening sstate
filenames
  dpkg: Install dkpg-perl scripts to versioned perl directory

Peter Kjellerstedt (2):
  libx11: Update LICENSE to better reflect reality
  libx11-compose-data: Update LICENSE to better reflect reality

Richard Purdie (8):
  opkg: Fix poor operator combination choice
  linunistring: Add missing gperf-native dependency
  pseudo: Add fcntl64 wrapper
  meta: Add explict branch to git SRC_URIs
  meta/scripts: Manual git url branch additions
  scripts/convert-srcuri: Update SRC_URI conversion script to handle
github url changes
  recipes: Update github.com urls to use https
  go-helloworld/glide: Fix urls

Ross Burton (1):
  meson: set objcopy in the cross and native toolchain files

Tom Hochstein (3):
  wayland: Fix wayland-tools packaging
  nativesdk-packagegroup-sdk-host.bb: Update host tools for wayland
  bitbake.conf: Use wayland distro feature for native builds

 .../devtool/devtool-upgrade-test2_git.bb  |   2 +-
 .../devtool-upgrade-test2_git.bb.upgraded |   2 +-
 .../git-submodule-test/git-submodule-test.bb  |   2 +-
 meta/classes/create-spdx.bbclass  |  10 +-
 meta/classes/devupstream.bbclass  |   2 +-
 meta/classes/meson.bbclass|   2 +
 meta/classes/sstate.bbclass   |  14 +-
 meta/conf/bitbake.conf|   6 +-
 .../distro/include/default-distrovars.inc |   2 +-
 meta/lib/oeqa/selftest/cases/devtool.py   |   4 +-
 meta/lib/oeqa/selftest/cases/fetch.py |   2 +-
 meta/lib/oeqa/selftest/cases/recipetool.py|   6 +-
 meta/lib/oeqa/selftest/cases/sstatetests.py   |   2 +-
 meta/recipes-bsp/efibootmgr/efibootmgr_17.bb  |   2 +-
 meta/recipes-bsp/efivar/efivar_37.bb  |   2 +-
 meta/recipes-bsp/opensbi/opensbi_0.9.bb   |   2 +-
 meta/recipes-bsp/u-boot/libubootenv_0.3.2.bb  |   2 +-
 meta/recipes-bsp/u-boot/u-boot-common.inc |   2 +-
 .../connman/connman-gnome_0.7.bb  |   2 +-
 .../libnss-mdns/libnss-mdns_0.15.1.bb |   2 +-
 .../libuv/libuv_1.42.0.bb |   2 +-
 .../mobile-broadband-provider-info_git.bb |   2 +-
 meta/recipes-core/dbus-wait/dbus-wait_git.bb  |   2 +-
 meta/recipes-core/fts/fts_1.2.7.bb|   2 +-
 .../glibc/cross-localedef-native_2.34.bb  |   2 +-
 meta/recipes-core/glibc/glibc-version.inc |   2 +-
 meta/recipes-core/ifupdown/ifupdown_0.8.36.bb |   2 +-
 .../initscripts/init-system-helpers_1.60.bb   |   2 +-
 meta/recipes-core/libxcrypt/libxcrypt.inc |   2 +-
 meta/recipes-core/musl/libucontext_git.bb |   2 +-
 meta/recipes-core/musl/musl-obstack.bb|   2 +-
 meta/recipes-core/musl/musl-utils.bb  |   2 +-
 meta/recipes-core/musl/musl_git.bb|   2 +-
 meta/recipes-core/ncurses/ncurses.inc |   2 +-
 .../nativesdk-packagegroup-sdk-host.bb|   2 +-
 meta/recipes-core/psplash/psplash_git.bb  |   2 +-
 meta/recipes-core/systemd/systemd.inc |   2 +-
 .../update-rc.d/update-rc.d_0.8.bb|   2 +-
 .../bootchart2/bootchart2_0.14.9.bb   |   2 +-
 .../btrfs-tools/btrfs-tools_5.13.1.bb |   2 +-
 .../createrepo-c/createrepo-c_0.17.4.bb   |   2 +-
 meta/recipes-devtools/distcc/distcc_3.4.bb|   2 +-
 meta/recipes-devtools/dnf/dnf_4.8.0.bb|   2 +-
 meta/recipes-devtools/dpkg/dpkg.inc   |   4 +-
 meta/recipes-devtools/e2fsprogs/e2fsprogs.inc |   2 +-
 .../erofs-utils/erofs-utils_1.3.bb|   2 +-
 meta/recipes-devtools/file/file_5.40.bb   |   2 +-
 meta/recipes-devtools/glide/glide_0.13.3.bb   |   2 +-
 .../gnu-config/gnu-config_git.bb  |   2 +-
 .../libcomps/libcomps_0.1.17.bb   |   2 +-
 meta/recipes-devtools/libdnf/libdnf_0.63.1.bb |   2 +-
 .../librepo/librepo_1.14.1.bb |   2 +-
 meta/recipes-devtools/llvm/llvm_git.bb|   2 +-
 

[OE-core] [honister][PATCH 01/26] squashfs-tools: fix CVE-2021-41072

2021-11-09 Thread Anuj Mittal
From: Kai Kang 

Backport patch to fix CVE-2021-41072. And 3 more ancestor commits are
backported too, otherwise it fails to compile.

CVE: CVE-2021-41072

Ref:
* https://nvd.nist.gov/vuln/detail/CVE-2021-41072

Signed-off-by: Kai Kang 
Signed-off-by: Anuj Mittal 
---
 .../CVE-2021-41072-requisite-1.patch  | 135 
 .../CVE-2021-41072-requisite-2.patch  | 108 ++
 .../CVE-2021-41072-requisite-3.patch  | 326 ++
 .../squashfs-tools/CVE-2021-41072.patch   | 325 +
 .../squashfs-tools/squashfs-tools_git.bb  |   4 +
 5 files changed, 898 insertions(+)
 create mode 100644 
meta/recipes-devtools/squashfs-tools/squashfs-tools/CVE-2021-41072-requisite-1.patch
 create mode 100644 
meta/recipes-devtools/squashfs-tools/squashfs-tools/CVE-2021-41072-requisite-2.patch
 create mode 100644 
meta/recipes-devtools/squashfs-tools/squashfs-tools/CVE-2021-41072-requisite-3.patch
 create mode 100644 
meta/recipes-devtools/squashfs-tools/squashfs-tools/CVE-2021-41072.patch

diff --git 
a/meta/recipes-devtools/squashfs-tools/squashfs-tools/CVE-2021-41072-requisite-1.patch
 
b/meta/recipes-devtools/squashfs-tools/squashfs-tools/CVE-2021-41072-requisite-1.patch
new file mode 100644
index 00..d01b5c6871
--- /dev/null
+++ 
b/meta/recipes-devtools/squashfs-tools/squashfs-tools/CVE-2021-41072-requisite-1.patch
@@ -0,0 +1,135 @@
+The commit is required by the fix for CVE-2021-41072.
+
+Upstream-Status: Backport 
[https://github.com/plougher/squashfs-tools/commit/80b8441]
+
+Signed-off-by: Kai Kang 
+
+From 80b8441a37fcf8bf07dacf24d9d6c6459a0f6e36 Mon Sep 17 00:00:00 2001
+From: Phillip Lougher 
+Date: Sun, 12 Sep 2021 19:58:19 +0100
+Subject: [PATCH] unsquashfs: use squashfs_closedir() to delete directory
+
+Signed-off-by: Phillip Lougher 
+---
+ squashfs-tools/unsquash-1.c|  3 +--
+ squashfs-tools/unsquash-1234.c | 11 +--
+ squashfs-tools/unsquash-2.c|  3 +--
+ squashfs-tools/unsquash-3.c|  3 +--
+ squashfs-tools/unsquash-4.c|  3 +--
+ squashfs-tools/unsquashfs.c|  7 ---
+ squashfs-tools/unsquashfs.h|  1 +
+ 7 files changed, 14 insertions(+), 17 deletions(-)
+
+diff --git a/squashfs-tools/unsquash-1.c b/squashfs-tools/unsquash-1.c
+index acba821..7598499 100644
+--- a/squashfs-tools/unsquash-1.c
 b/squashfs-tools/unsquash-1.c
+@@ -373,8 +373,7 @@ static struct dir *squashfs_opendir(unsigned int 
block_start, unsigned int offse
+   return dir;
+ 
+ corrupted:
+-  free(dir->dirs);
+-  free(dir);
++  squashfs_closedir(dir);
+   return NULL;
+ }
+ 
+diff --git a/squashfs-tools/unsquash-1234.c b/squashfs-tools/unsquash-1234.c
+index c2d4f42..0c8dfbb 100644
+--- a/squashfs-tools/unsquash-1234.c
 b/squashfs-tools/unsquash-1234.c
+@@ -25,8 +25,8 @@
+  * unsquash-4.
+  */
+ 
+-#define TRUE 1
+-#define FALSE 0
++#include "unsquashfs.h"
++
+ /*
+  * Check name for validity, name should not
+  *  - be ".", "./", or
+@@ -56,3 +56,10 @@ int check_name(char *name, int size)
+ 
+   return TRUE;
+ }
++
++
++void squashfs_closedir(struct dir *dir)
++{
++  free(dir->dirs);
++  free(dir);
++}
+diff --git a/squashfs-tools/unsquash-2.c b/squashfs-tools/unsquash-2.c
+index 0746b3d..86f62ba 100644
+--- a/squashfs-tools/unsquash-2.c
 b/squashfs-tools/unsquash-2.c
+@@ -465,8 +465,7 @@ static struct dir *squashfs_opendir(unsigned int 
block_start, unsigned int offse
+   return dir;
+ 
+ corrupted:
+-  free(dir->dirs);
+-  free(dir);
++  squashfs_closedir(dir);
+   return NULL;
+ }
+ 
+diff --git a/squashfs-tools/unsquash-3.c b/squashfs-tools/unsquash-3.c
+index 094caaa..c04aa9e 100644
+--- a/squashfs-tools/unsquash-3.c
 b/squashfs-tools/unsquash-3.c
+@@ -499,8 +499,7 @@ static struct dir *squashfs_opendir(unsigned int 
block_start, unsigned int offse
+   return dir;
+ 
+ corrupted:
+-  free(dir->dirs);
+-  free(dir);
++  squashfs_closedir(dir);
+   return NULL;
+ }
+ 
+diff --git a/squashfs-tools/unsquash-4.c b/squashfs-tools/unsquash-4.c
+index 3a1b9e1..ff62dcc 100644
+--- a/squashfs-tools/unsquash-4.c
 b/squashfs-tools/unsquash-4.c
+@@ -436,8 +436,7 @@ static struct dir *squashfs_opendir(unsigned int 
block_start, unsigned int offse
+   return dir;
+ 
+ corrupted:
+-  free(dir->dirs);
+-  free(dir);
++  squashfs_closedir(dir);
+   return NULL;
+ }
+ 
+diff --git a/squashfs-tools/unsquashfs.c b/squashfs-tools/unsquashfs.c
+index 7b590bd..04be53c 100644
+--- a/squashfs-tools/unsquashfs.c
 b/squashfs-tools/unsquashfs.c
+@@ -1350,13 +1350,6 @@ unsigned int *offset, unsigned int *type)
+ }
+ 
+ 
+-void squashfs_closedir(struct dir *dir)
+-{
+-  free(dir->dirs);
+-  free(dir);
+-}
+-
+-
+ char *get_component(char *target, char **targname)
+ {
+   char *start;
+diff --git a/squashfs-tools/unsquashfs.h b/squashfs-tools/unsquashfs.h
+index 2e9201c..5ecb2ab 100644
+--- a/squashfs-tools/unsquashfs.h
 

Re: [OE-core] [honister][PATCH] insane.bbclass: Add a check for directories that are expected to be empty

2021-11-09 Thread Anuj Mittal
On Mon, 2021-11-08 at 18:10 +0100, Peter Kjellerstedt wrote:
> From: Peter Kjellerstedt 
> 
> The empty-dirs QA check verifies that all directories specified in
> QA_EMPTY_DIRS are empty. It is possible to specify why a directory is
> expected to be empty by defining QA_EMPTY_DIRS_RECOMMENDATION:,
> which will then be included in the error message if the directory is
> not empty. If it is not specified for a directory, then "but it is
> expected to be empty" will be used.
> 
> Change-Id: Ic61019528f4b22f26e42e78125a99666ae27c7f5
> Signed-off-by: Peter Kjellerstedt 
> ---
> 
> Compared to the corresponding patch for master, there are two
> differences:
> 
> * "/var/volatile" is not added to QA_EMPTY_DIRS by default.
> * "empty-dirs" is added to WARN_QA instead of ERROR_QA.
> 
> This should make it safe to add this QA test to Honister without
> introdusing any new QA errors, while still allowing the QA test to be
> activated for those who wants to use it.

Does it have to be enabled by default?

Thanks,

Anuj

> 
>  meta/classes/insane.bbclass  | 32 +++-
>  meta/conf/documentation.conf |  2 ++
>  2 files changed, 33 insertions(+), 1 deletion(-)
> 
> diff --git a/meta/classes/insane.bbclass
> b/meta/classes/insane.bbclass
> index f2d2ca3689..7d4ba28e40 100644
> --- a/meta/classes/insane.bbclass
> +++ b/meta/classes/insane.bbclass
> @@ -27,7 +27,7 @@ WARN_QA ?= " libdir xorg-driver-abi \
>  infodir build-deps src-uri-bad symlink-to-sysroot
> multilib \
>  invalid-packageconfig host-user-contaminated uppercase-
> pn patch-fuzz \
>  mime mime-xdg unlisted-pkg-lics unhandled-features-check
> \
> -    missing-update-alternatives native-last missing-ptest \
> +    missing-update-alternatives native-last missing-ptest
> empty-dirs \
>  "
>  ERROR_QA ?= "dev-so debug-deps dev-deps debug-files arch pkgconfig
> la \
>  perms dep-cmp pkgvarcheck perm-config perm-line perm-
> link \
> @@ -50,6 +50,20 @@ ALL_QA = "${WARN_QA} ${ERROR_QA}"
>  
>  UNKNOWN_CONFIGURE_WHITELIST ?= "--enable-nls --disable-nls --
> disable-silent-rules --disable-dependency-tracking --with-libtool-
> sysroot --disable-static"
>  
> +# This is a list of directories that are expected to be empty.
> +QA_EMPTY_DIRS ?= " \
> +    /dev/pts \
> +    /media \
> +    /proc \
> +    /run \
> +    /tmp \
> +    ${localstatedir}/run \
> +"
> +# It is possible to specify why a directory is expected to be empty
> by defining
> +# QA_EMPTY_DIRS_RECOMMENDATION:, which will then be included
> in the error
> +# message if the directory is not empty. If it is not specified for
> a directory,
> +# then "but it is expected to be empty" will be used.
> +
>  def package_qa_clean_path(path, d, pkg=None):
>  """
>  Remove redundant paths from the path for display.  If pkg isn't
> set then
> @@ -917,6 +931,22 @@ def package_qa_check_unlisted_pkg_lics(package,
> d, messages):
>     "listed in LICENSE" % (package, '
> '.join(unlisted)))
>  return False
>  
> +QAPKGTEST[empty-dirs] = "package_qa_check_empty_dirs"
> +def package_qa_check_empty_dirs(pkg, d, messages):
> +    """
> +    Check for the existence of files in directories that are
> expected to be
> +    empty.
> +    """
> +
> +    pkgd = oe.path.join(d.getVar('PKGDEST'), pkg)
> +    for dir in (d.getVar('QA_EMPTY_DIRS') or "").split():
> +    empty_dir = oe.path.join(pkgd, dir)
> +    if os.path.exists(empty_dir) and os.listdir(empty_dir):
> +    recommendation =
> (d.getVar('QA_EMPTY_DIRS_RECOMMENDATION:' + dir) or
> +  "but it is expected to be empty")
> +    msg = "%s installs files in %s, %s" % (pkg, dir,
> recommendation)
> +    oe.qa.add_message(messages, "empty-dirs", msg)
> +
>  def package_qa_check_encoding(keys, encode, d):
>  def check_encoding(key, enc):
>  sane = True
> diff --git a/meta/conf/documentation.conf
> b/meta/conf/documentation.conf
> index c5a38b0764..d38a88fb49 100644
> --- a/meta/conf/documentation.conf
> +++ b/meta/conf/documentation.conf
> @@ -345,6 +345,8 @@ PYPI_SRC_URI[doc] = "The URI to use to fetch from
> pypi, default uses pythonhoste
>  
>  #Q
>  
> +QA_EMPTY_DIRS[doc] = "A list of directories that are expected to be
> empty."
> +QA_EMPTY_DIRS_RECOMMENDATION[doc] = "This specifies a recommendation
> for a directory why it must be empty, which will be included in the
> error message if the directory is not empty."
>  QMAKE_PROFILES[doc] = "Specifies your own subset of .pro files to be
> built for use with qmake."
>  
>  #R
> 
> 
> 


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158020): 
https://lists.openembedded.org/g/openembedded-core/message/158020
Mute This Topic: https://lists.openembedded.org/mt/86910911/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: 

Re: [OE-core] [PATCH v3] glibc: ptest: Add running glibc time related test suite (Y2038) with ptest

2021-11-09 Thread ?ukasz Majewski
Hi Lee Chee,

> Hi, 
> 
> I think need to fix this too 
> 

Thanks for pointing out those issues.

> AssertionError:
> The following recipes do not have a maintainer assigned to them.
> Please add an entry to meta/conf/distro/include/maintainers.inc file.
> glibc-tests
> (/home/pokybuild/yocto-worker/oe-selftest-centos/build/meta/recipes-core/glibc/glibc-tests_2.34.bb)
> 
> full log:
> https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2807/steps/15/logs/stdio
> 
> 
> also for issue with 
> "Missing or unbuildable dependency chain was:
> ['nativesdk-ptest-runner']" you may refer to these build for build
> config
> https://autobuilder.yoctoproject.org/typhoon/#/builders/23/builds/4598/steps/11/logs/stdio
> https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/3629/steps/12/logs/stdio
> 
> 

I will fix them and prepare v4.

> 
> >-Original Message-
> >From: openembedded-core@lists.openembedded.org  >c...@lists.openembedded.org> On Behalf Of ?ukasz Majewski  
> >Sent: Tuesday, 9 November, 2021 12:31 AM
> >To: Alexandre Belloni 
> >Cc: Richard Purdie ; Nathan Rossi
> >; Khem Raj ; Adhemerval
> >Zanella ; Patches and discussions
> >about the oe- core layer 
> >Subject: Re: [OE-core] [PATCH v3] glibc: ptest: Add running glibc
> >time related test suite (Y2038) with ptest
> >
> >Hi Alexandre.
> >
> >Sorry for the late reply - I've must overlooked this reply...
> >  
> >> Hello,
> >>
> >> There is a remaining issue:
> >>
> >> WARNING: Nothing RPROVIDES 'nativesdk-ptest-runner' (but
> >> virtual:nativesdk:/home/pokybuild/yocto-worker/build-appliance/build/m
> >> eta/recipes-core/glibc/glibc-tests_2.34.bb
> >> RDEPENDS on or otherwise requires it) NOTE: Runtime target
> >> 'nativesdk-ptest-runner' is unbuildable, removing... Missing or
> >> unbuildable dependency chain was: ['nativesdk-ptest-runner']  
> >
> >Could you share your setup?
> >
> >I've been trying to reproduce this problem with:
> >MACHINE=qemuarm64 bitbake core-image-ptest-all -c populate_sdk
> >
> >but no warnings were observed.
> >
> >Thanks in advance.
> >  
> >>
> >> On 28/10/2021 14:00:20+0200, ?ukasz Majewski wrote:  
> >> > This patch introduces new recipe - namely 'glibc-tests', which
> >> > builds and installs time related (to check if Y2038 support
> >> > works) glibc test suite to OE/Yocto built image.
> >> >
> >> > It reuses code from already available 'glibc-testsuite' recipe,
> >> > which is run with 'bitbake glibc-testsuite -c check' and uses
> >> > qemu to execute remotely (via SSH) tests on some emulated
> >> > machine.
> >> >
> >> > This recipe installs time related glibc tests on some rootfs
> >> > image. Afterwards, those tests can be executed on the real
> >> > hardware, to facilitate validation of it with Y2038 problem
> >> > compliance.
> >> >
> >> > To test time related subset - one needs to call:
> >> > ptest-runner glibc-tests
> >> > then change the date after Y2038 threshold for 32 bit systems:
> >> > date -s "20 JAN 2038 18:00:00"
> >> > and then run ptest-runner again.
> >> >
> >> > To facilitate debugging, source files are provided by default
> >> > with the unstripped debugging symbols. Such approach would
> >> > reduce the already complex recipe (as it inherits base glibc
> >> > one), so there is no need to also install *-dbg and *-src
> >> > packages.
> >> >
> >> > Signed-off-by: Lukasz Majewski 
> >> >
> >> > ---
> >> > Changes for v3:
> >> > - Provide missing ${PN}-ptest for PACKAGES, PROVIDES and
> >> >   RPROVIDES variables
> >> >
> >> > Changes for v2:
> >> > - Just focus on time related set of tests as those can be run as
> >> >   standalone
> >> > - Reuse of already built tests (from glibc-tests.inc) and depoloy
> >> >   them on the HW target.
> >> > - Provide single 'run-ptest' script.
> >> > - Update the recipe to run with newest poky's -master
> >> > ---
> >> >  .../distro/include/ptest-packagelists.inc |   1 +
> >> >  meta/recipes-core/glibc/glibc-tests_2.34.bb   | 112
> >> > ++ meta/recipes-core/glibc/glibc/run-ptest
> >> > | 37 ++ 3 files changed, 150 insertions(+)  create mode
> >> > 100644 meta/recipes-core/glibc/glibc-tests_2.34.bb
> >> >  create mode 100755 meta/recipes-core/glibc/glibc/run-ptest
> >> >
> >> > diff --git a/meta/conf/distro/include/ptest-packagelists.inc
> >> > b/meta/conf/distro/include/ptest-packagelists.inc index
> >> > 2e324f8da4..fd52fa72a4 100644 ---
> >> > a/meta/conf/distro/include/ptest-packagelists.inc +++
> >> > b/meta/conf/distro/include/ptest-packagelists.inc @@ -61,6 +61,7
> >> > @@ PTESTS_FAST = "\ slang-ptest \
> >> >  wayland-ptest \
> >> >  zlib-ptest \
> >> > +glibc-tests-ptest \
> >> >  "
> >> >  PTESTS_FAST:remove:mips64 = "qemu-ptest"
> >> >  PTESTS_PROBLEMS:append:mips64 = "qemu-ptest"
> >> > diff --git a/meta/recipes-core/glibc/glibc-tests_2.34.bb
> >> > b/meta/recipes-core/glibc/glibc-tests_2.34.bb new file mode
> >> > 100644 index 00..0a6920eef4
> >> > --- /dev/null
> >> > +++ 

[OE-core] [PATCH] mirrors: Add uninative mirror on kernel.org

2021-11-09 Thread Richard Purdie
At the last nas outage, we realised that we don't have good mirrors of the
uninative tarball if our main system can't be accessed. kernel.org mirrors
some Yocto Project data so we've ensured uninative is there. Add the appropriate
mirror url to make use of that.

Signed-off-by: Richard Purdie 
---
 meta/classes/mirrors.bbclass | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta/classes/mirrors.bbclass b/meta/classes/mirrors.bbclass
index ba325a658bc..75eb86a7243 100644
--- a/meta/classes/mirrors.bbclass
+++ b/meta/classes/mirrors.bbclass
@@ -62,6 +62,7 @@ ftp://.*/.* http://sources.openembedded.org/ \n \
 npm://.*/?.*http://sources.openembedded.org/ \n \
 ${CPAN_MIRROR}  http://cpan.metacpan.org/ \n \
 ${CPAN_MIRROR}  http://search.cpan.org/CPAN/ \n \
+https?$://downloads.yoctoproject.org/releases/uninative/ 
https://mirrors.kernel.org/yocto/uninative/ \n \
 "
 
 # Use MIRRORS to provide git repo fallbacks using the https protocol, for cases
-- 
2.32.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158018): 
https://lists.openembedded.org/g/openembedded-core/message/158018
Mute This Topic: https://lists.openembedded.org/mt/86930590/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] diffoscope: upgrade 189 -> 190

2021-11-09 Thread wangmy
Changelog:
[Chris Lamb]
Don't raise a traceback if we cannot de-marshal Python bytecode to support
Python 3.7 loading newer .pyc files.
(Closes: reproducible-builds/diffoscope#284)
Fix Python tests under Python 3.7 with file 5.39+.

[Vagrant Cascadian]
Skip Python bytecode testing when "file" is older than 5.39.

[Roland Clobus]
Detect whether the GNU_BUILD_ID field has been modified.

Signed-off-by: Wang Mingyu 
---
 .../diffoscope/{diffoscope_189.bb => diffoscope_190.bb} | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-support/diffoscope/{diffoscope_189.bb => 
diffoscope_190.bb} (92%)

diff --git a/meta/recipes-support/diffoscope/diffoscope_189.bb 
b/meta/recipes-support/diffoscope/diffoscope_190.bb
similarity index 92%
rename from meta/recipes-support/diffoscope/diffoscope_189.bb
rename to meta/recipes-support/diffoscope/diffoscope_190.bb
index d3c70b47c5..8303ee4693 100644
--- a/meta/recipes-support/diffoscope/diffoscope_189.bb
+++ b/meta/recipes-support/diffoscope/diffoscope_190.bb
@@ -12,7 +12,7 @@ PYPI_PACKAGE = "diffoscope"
 
 inherit pypi setuptools3
 
-SRC_URI[sha256sum] = 
"2ec8d94af13e905ec1a905ebfb2654971cf977b149d296f8bf2aeff6bcab3d8a"
+SRC_URI[sha256sum] = 
"29e3c5ce764b494771876aef3f587ed4867374a0f4e28afe39d4f0640ddb7744"
 
 RDEPENDS:${PN} += "binutils vim squashfs-tools python3-libarchive-c 
python3-magic python3-rpm"
 
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158016): 
https://lists.openembedded.org/g/openembedded-core/message/158016
Mute This Topic: https://lists.openembedded.org/mt/86929386/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] ell: upgrade 0.44 -> 0.45

2021-11-09 Thread wangmy
Fix issue with ICMPv6 and handling re-entrantly callbacks.

Signed-off-by: Wang Mingyu 
---
 meta/recipes-core/ell/{ell_0.44.bb => ell_0.45.bb} | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-core/ell/{ell_0.44.bb => ell_0.45.bb} (90%)

diff --git a/meta/recipes-core/ell/ell_0.44.bb 
b/meta/recipes-core/ell/ell_0.45.bb
similarity index 90%
rename from meta/recipes-core/ell/ell_0.44.bb
rename to meta/recipes-core/ell/ell_0.45.bb
index d1f1691645..8453720f42 100644
--- a/meta/recipes-core/ell/ell_0.44.bb
+++ b/meta/recipes-core/ell/ell_0.45.bb
@@ -17,7 +17,7 @@ inherit autotools pkgconfig
 SRC_URI = 
"https://mirrors.edge.kernel.org/pub/linux/libs/${BPN}/${BPN}-${PV}.tar.xz \
file://0001-pem.c-do-not-use-rawmemchr.patch \
"
-SRC_URI[sha256sum] = 
"41a6f8fa4d285b52cb7a5a87bda3e7370ecaac02d94aaa7ec1a23f0480b8bc3f"
+SRC_URI[sha256sum] = 
"fedfcceee56eb63ab1eb98bf120a3cfbecee50bcd893874328c889f1b381e7d7"
 
 do_configure:prepend () {
 mkdir -p ${S}/build-aux
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158015): 
https://lists.openembedded.org/g/openembedded-core/message/158015
Mute This Topic: https://lists.openembedded.org/mt/86929385/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] btrfs-tools: upgrade 5.14.2 -> 5.15

2021-11-09 Thread wangmy
Changelog v5.15 (Nov 2021)

mkfs: new defaults!
no-holes
free-space-tree
DUP for metadata unconditionally
libbtrfsutil: add missing profile defines
libbtrfs: minimize its impact on the other code, refactor and separate 
implementation where needed, cleanup afterwards, reduced header exports
documentation: introduce sphinx build and RST versions of manual pages, will 
become the new format and replace asciidoc
fixes: fix warning regarding v1 space cache when only v2 (free space tree) is 
enabled

Signed-off-by: Wang Mingyu 
---
 .../btrfs-tools/{btrfs-tools_5.14.2.bb => btrfs-tools_5.15.bb}  | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta/recipes-devtools/btrfs-tools/{btrfs-tools_5.14.2.bb => 
btrfs-tools_5.15.bb} (98%)

diff --git a/meta/recipes-devtools/btrfs-tools/btrfs-tools_5.14.2.bb 
b/meta/recipes-devtools/btrfs-tools/btrfs-tools_5.15.bb
similarity index 98%
rename from meta/recipes-devtools/btrfs-tools/btrfs-tools_5.14.2.bb
rename to meta/recipes-devtools/btrfs-tools/btrfs-tools_5.15.bb
index ba4ad0f438..399ba17e3e 100644
--- a/meta/recipes-devtools/btrfs-tools/btrfs-tools_5.14.2.bb
+++ b/meta/recipes-devtools/btrfs-tools/btrfs-tools_5.15.bb
@@ -19,7 +19,7 @@ SRC_URI = 
"git://git.kernel.org/pub/scm/linux/kernel/git/kdave/btrfs-progs.git;b

file://0001-Add-a-possibility-to-specify-where-python-modules-ar.patch \

file://0001-btrfs-tools-include-linux-const.h-to-fix-build-with-.patch \
"
-SRCREV = "35f17bc49cdf760d8f3710fe2c301b933d991fd6"
+SRCREV = "4d06e4a13d1ce1849a60b68969bc385ab736ddf7"
 S = "${WORKDIR}/git"
 
 PACKAGECONFIG ??= " \
-- 
2.25.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158017): 
https://lists.openembedded.org/g/openembedded-core/message/158017
Mute This Topic: https://lists.openembedded.org/mt/86929387/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [bitbake-devel] [oe-core][PATCH 1/2] devtools: Initial recipe for repo 2.17.3

2021-11-09 Thread Jasper Orschulko
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Hi Richard,

I think our implementation of the repo fetcher checks the (what I
believe to be) most relevant parts of your checklist (thanks for the
write-up). Martin, please corrent me if I'm missing something:

> a) network access for sources is only expected to happen in the
> do_fetch step.
> This is not enforced or tested but is required so that we can:
> 
>  i) audit the sources used (i.e. for license/manifest reasons)
>  ii) support offline builds with a suitable cache
>  iii) allow work to continue even with downtime upstream
>  iv) allow for changes upstream in incompatible ways
>  v) allow rebuilding of the software in X years time

check

> b) network access is not expected in do_unpack

check 

> c) you can take DL_DIR and use it as a mirror for offline builds

check

> d) access to the network is only made when explicitly configured in
> recipes
>  (e.g. use of AUTOREV, or use of git tags which change revision)

check

> e) fetcher output is deterministic
>  (i.e. if you fetch configuration XXX now it will match in future
> exactly in 
>  a clean build with a new DL_DIR)

check. When a fixed refspec is set within the recipe, the fetcher will
check, if all repositories in the repo manifest are set to a fixed
refspec as well and otherwise throw an error.

> f) network access is expected to work with the standard linux proxy
> variables
>  environment but only in the do_fetch tasks)

this should work, as we keep the GIT_PROXY_COMMAND environment and run
repo via runfetchcmd(). Not further tested though.

> g) access during parsing has to be minimal, a "git ls-remote" for an
> AUTOREV 
>  git recipe might be ok but you can't expect to checkout a git tree

unfortunately, do to the nature of repo, we need to clone the manifest
repo, so that we can run "git ls-remote" on the referenced git repos
and therefore ensure that 

> h) we need to provide revision information during parsing such that a
> version
>  for the recipe can be constructed.

check. We create a hash value from git ls-remote of the recipe file, as
well as the git ls-remote of each repo referenced in the manifest.

> i) versions are expected to be able to increase in a way which sorts
> allowing 
>  package feeds to operate (see PR server required for git revisions to
> sort)

check. We use the PR server and didn't notice any issues.

> j) API to query for possible version upgrades of a url is highly
> desireable to 
>  allow out automated upgrage code to function (it is implied this does
> always 
>  have network access)

check (if I understand you correctly). We support AUTOINC.

> k) Where fixes or changes to behaviour in the fetcher are made, we ask
> that 
>  test cases are added (run with "bitbake-selftest bb.tests.fetch"). We
> do 
>  have fairly extensive test coverage of the fetcher as it is the only
> way
>  to track all of it's corner cases, it still doesn't give entire
> coverage 
>  though sadly.

We are currently still missing any tests for the new fetcher. We will
add them in the course of the next days. Meanwhile, I have prepared a
demo environment so if anymeone is interested in doing some further
testing, feel free: https://github.com/Jasper-Ben/demo-kas :)

- -- 
With best regards

Jasper Orschulko
DevOps Engineer

Tel. +49 30 58 58 14 265
Fax +49 30 58 58 14 999
jasper.orschu...@iris-sensing.com

• • • • • • • • • • • • • • • • • • • • • • • • • •

iris-GmbH
infrared & intelligent sensors
Schnellerstraße 1-5 | 12439 Berlin

https://iris-sensing.com/
> 
-BEGIN PGP SIGNATURE-

iQEzBAEBCAAdFiEE4WyPMIC5Ap4+Ooo1Ygqew07VMNUFAmGKWtQACgkQYgqew07V
MNU3Lgf+PlDNyHxoCive3HL8V00KlfrsjTcuQVYiODav39n/h/cRvq8F8Wh7NiyM
Hjrr9O7MCOZLNGQiW9vBN/R6FbWESZ+sxl2nLdGH98eCYPKBurcHzvIXlJgincc+
dL1HtxDqjdk9TOHfaKAD2zc8U0tY6xu6Hgj7QIAqELt8HAwOQeIherAuIQw7g+KH
eWY5xhn8+KrY//RlnnRmDMO20LBY68bdkCOCH3kAIBfcSIzj8fzf1A4PZhGFi8AM
dydVCBMrKvPg3bfJnenZrVPijWnb82pOwjWzoZltzYxtCjqAhwevoCr8twGNDbx4
IVPcEqtMWRrf8rpQiHsZFTheap8BdA==
=hdir
-END PGP SIGNATURE-

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158014): 
https://lists.openembedded.org/g/openembedded-core/message/158014
Mute This Topic: https://lists.openembedded.org/mt/86840389/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 3/3] sstate: add a function to get the sstate file name in sstate_checkhashes

2021-11-09 Thread Jose Quaresma
Signed-off-by: Jose Quaresma 
---
 meta/classes/sstate.bbclass | 16 +++-
 1 file changed, 7 insertions(+), 9 deletions(-)

diff --git a/meta/classes/sstate.bbclass b/meta/classes/sstate.bbclass
index 88bd84a06c..0a78a2fb69 100644
--- a/meta/classes/sstate.bbclass
+++ b/meta/classes/sstate.bbclass
@@ -934,12 +934,13 @@ def sstate_checkhashes(sq_data, d, siginfo=False, 
currentcount=0, summary=True,
 
 return spec, extrapath, tname
 
+def getsstatefile(tid, siginfo, d):
+spec, extrapath, tname = getpathcomponents(tid, d)
+return extrapath + generate_sstatefn(spec, gethash(tid), tname, 
siginfo, d)
 
 for tid in sq_data['hash']:
 
-spec, extrapath, tname = getpathcomponents(tid, d)
-
-sstatefile = d.expand("${SSTATE_DIR}/" + extrapath + 
generate_sstatefn(spec, gethash(tid), tname, siginfo, d))
+sstatefile = d.expand("${SSTATE_DIR}/" + getsstatefile(tid, siginfo, 
d))
 
 if os.path.exists(sstatefile):
 found.add(tid)
@@ -1000,8 +1001,7 @@ def sstate_checkhashes(sq_data, d, siginfo=False, 
currentcount=0, summary=True,
 
 tasklist = []
 for tid in missed:
-spec, extrapath, tname = getpathcomponents(tid, d)
-sstatefile = d.expand(extrapath + generate_sstatefn(spec, 
gethash(tid), tname, siginfo, d))
+sstatefile = d.expand(getsstatefile(tid, siginfo, d))
 tasklist.append((tid, sstatefile))
 
 if tasklist:
@@ -1028,12 +1028,10 @@ def sstate_checkhashes(sq_data, d, siginfo=False, 
currentcount=0, summary=True,
 if "toaster" in inheritlist:
 evdata = {'missed': [], 'found': []};
 for tid in missed:
-spec, extrapath, tname = getpathcomponents(tid, d)
-sstatefile = d.expand(extrapath + generate_sstatefn(spec, 
gethash(tid), tname, False, d))
+sstatefile = d.expand(getsstatefile(tid, False, d))
 evdata['missed'].append((bb.runqueue.fn_from_tid(tid), 
bb.runqueue.taskname_from_tid(tid), gethash(tid), sstatefile ) )
 for tid in found:
-spec, extrapath, tname = getpathcomponents(tid, d)
-sstatefile = d.expand(extrapath + generate_sstatefn(spec, 
gethash(tid), tname, False, d))
+sstatefile = d.expand(getsstatefile(tid, False, d))
 evdata['found'].append((bb.runqueue.fn_from_tid(tid), 
bb.runqueue.taskname_from_tid(tid), gethash(tid), sstatefile ) )
 bb.event.fire(bb.event.MetadataEvent("MissedSstate", evdata), d)
 
-- 
2.33.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158013): 
https://lists.openembedded.org/g/openembedded-core/message/158013
Mute This Topic: https://lists.openembedded.org/mt/86928671/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 2/3] sstate: only search on the mirrors for the missing files

2021-11-09 Thread Jose Quaresma
The existence of missed files on the local sstate cache is the
condition to search for it on the sstate mirror.
The missed collection are populated when we search the files
on the local sstate cache.

- When we have sstate mirrors we don't need to iterate all files
again because we already know what's missing.

- When we found a file on the sstate mirror is because of they
are missing on the local sstate mirror.
So avoid checking if the hash exists on the missed collection.

- When we can't find the file on the sstate mirror we don't need
to add the hash again to the missed collection as it already exists.

Signed-off-by: Jose Quaresma 
---
 meta/classes/sstate.bbclass | 8 ++--
 1 file changed, 2 insertions(+), 6 deletions(-)

diff --git a/meta/classes/sstate.bbclass b/meta/classes/sstate.bbclass
index 3f6a1fe99f..88bd84a06c 100644
--- a/meta/classes/sstate.bbclass
+++ b/meta/classes/sstate.bbclass
@@ -989,10 +989,8 @@ def sstate_checkhashes(sq_data, d, siginfo=False, 
currentcount=0, summary=True,
 fetcher.checkstatus()
 bb.debug(2, "SState: Successful fetch test for %s" % srcuri)
 found.add(tid)
-if tid in missed:
-missed.remove(tid)
+missed.remove(tid)
 except bb.fetch2.FetchError as e:
-missed.add(tid)
 bb.debug(2, "SState: Unsuccessful fetch test for %s (%s)" % 
(srcuri, e))
 except Exception as e:
 bb.error("SState: cannot test %s: %s" % (srcuri, e))
@@ -1001,9 +999,7 @@ def sstate_checkhashes(sq_data, d, siginfo=False, 
currentcount=0, summary=True,
 bb.event.fire(bb.event.ProcessProgress(msg, len(tasklist) - 
thread_worker.tasks.qsize()), d)
 
 tasklist = []
-for tid in sq_data['hash']:
-if tid in found:
-continue
+for tid in missed:
 spec, extrapath, tname = getpathcomponents(tid, d)
 sstatefile = d.expand(extrapath + generate_sstatefn(spec, 
gethash(tid), tname, siginfo, d))
 tasklist.append((tid, sstatefile))
-- 
2.33.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158012): 
https://lists.openembedded.org/g/openembedded-core/message/158012
Mute This Topic: https://lists.openembedded.org/mt/86928670/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 1/3] sstate: cleanup the sstate mirror progress check

2021-11-09 Thread Jose Quaresma
We only have the progress bar when there are more than 100 objects.
So we can check for this and store the result to show the progress bar.

Signed-off-by: Jose Quaresma 
---
 meta/classes/sstate.bbclass | 9 +
 1 file changed, 5 insertions(+), 4 deletions(-)

diff --git a/meta/classes/sstate.bbclass b/meta/classes/sstate.bbclass
index 849723d4dc..3f6a1fe99f 100644
--- a/meta/classes/sstate.bbclass
+++ b/meta/classes/sstate.bbclass
@@ -996,11 +996,11 @@ def sstate_checkhashes(sq_data, d, siginfo=False, 
currentcount=0, summary=True,
 bb.debug(2, "SState: Unsuccessful fetch test for %s (%s)" % 
(srcuri, e))
 except Exception as e:
 bb.error("SState: cannot test %s: %s" % (srcuri, e))
-if len(tasklist) >= min_tasks:
+
+if progress:
 bb.event.fire(bb.event.ProcessProgress(msg, len(tasklist) - 
thread_worker.tasks.qsize()), d)
 
 tasklist = []
-min_tasks = 100
 for tid in sq_data['hash']:
 if tid in found:
 continue
@@ -1011,7 +1011,8 @@ def sstate_checkhashes(sq_data, d, siginfo=False, 
currentcount=0, summary=True,
 if tasklist:
 nproc = min(int(d.getVar("BB_NUMBER_THREADS")), len(tasklist))
 
-if len(tasklist) >= min_tasks:
+progress = len(tasklist) >= 100
+if progress:
 msg = "Checking sstate mirror object availability"
 bb.event.fire(bb.event.ProcessStarted(msg, len(tasklist)), d)
 
@@ -1024,7 +1025,7 @@ def sstate_checkhashes(sq_data, d, siginfo=False, 
currentcount=0, summary=True,
 pool.wait_completion()
 bb.event.disable_threadlock()
 
-if len(tasklist) >= min_tasks:
+if progress:
 bb.event.fire(bb.event.ProcessFinished(msg), d)
 
 inheritlist = d.getVar("INHERIT")
-- 
2.33.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158011): 
https://lists.openembedded.org/g/openembedded-core/message/158011
Mute This Topic: https://lists.openembedded.org/mt/86928669/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] gdb-cross: add dependency on gmp-native

2021-11-09 Thread Martin Jansa
* it was already added for target and cross-canadian gdb in:
  commit 4643d1eb222151384f77d13a936537aae5ca3fe6
  Author: Khem Raj 
  Date:   Fri Nov 5 17:37:33 2021 -0700

gdb: Add dependency on libgmp

gdb 11 has added this library as must have

* but gdb-cross.inc overwrites DEPENDS from gdb-common.inc
  and needs the dependency as well as shown in log.do_compile:

  checking for libgmp... no
  configure: error: GMP is missing or unusable
  make[1]: *** [Makefile:9418: configure-gdb] Error 1

  and in gdb-cross-i686/11.1-r0/build-i686-oe-linux/gdb/config.log:

  configure:10402: checking for libgmp
  configure:10422: gcc  -o conftest 
-isystem/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/include
 -O2 -pipe 
-isystem/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/include
 
-I/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/include
  
-L/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/lib
 
-L/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/lib
 -Wl,--enable-new-dtags 
-Wl,-rpath-link,/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/lib
 
-Wl,-rpath-link,/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/lib
 
-Wl,-rpath,/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr/lib
 
-Wl,-rpath,/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/lib
 -Wl,-O1 -Wl,--allow-shlib-undefined 
-Wl,--dynamic-linker=/OE/tmp-glibc/sysroots-uninative/x86_64-linux/lib/ld-linux-x86-64.so.2
 conftest.c -lncursesw -lm -ldl  -lgmp >&5
  conftest.c:52:10: fatal error: gmp.h: No such file or directory
 52 | #include 
|  ^~~

* this fails only when the host OS doesn't have GMP installed
  otherwise it will use libgmp from host and ignore
  
--with-libgmp-prefix=/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/OE/tmp-glibc/work/x86_64-linux/gdb-cross-i686/11.1-r0/recipe-sysroot-native/usr

Signed-off-by: Martin Jansa 
---
 meta/recipes-devtools/gdb/gdb-cross.inc | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/gdb/gdb-cross.inc 
b/meta/recipes-devtools/gdb/gdb-cross.inc
index 4e50cd5ab0..9f9675c1b3 100644
--- a/meta/recipes-devtools/gdb/gdb-cross.inc
+++ b/meta/recipes-devtools/gdb/gdb-cross.inc
@@ -1,6 +1,6 @@
 require gdb-common.inc
 
-DEPENDS = "expat-native ncurses-native flex-native bison-native"
+DEPENDS = "expat-native gmp-native ncurses-native flex-native bison-native"
 
 inherit python3native pkgconfig
 
-- 
2.32.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158010): 
https://lists.openembedded.org/g/openembedded-core/message/158010
Mute This Topic: https://lists.openembedded.org/mt/86928271/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Richard Purdie
On Tue, 2021-11-09 at 10:56 +0100, Alexander Kanavin wrote:
> On Tue, 9 Nov 2021 at 10:51, Robert Yang  wrote:
> > > Maybe, but once we start doing tweaks like this, where do they stop? Hey,
> > I'd 
> > 
> > I think that it's not only a performance tweak, but this should be
> > considered
> > as
> > a bug since it would be failed to build on powerful machine, which isn't
> > good
> > for oe-core's user experience.
> > 
> 
> 
> I managed to bring down a powerful machine just yesterday by building webkit
> and llvm together at the same time. They together ate all the RAM, and someone
> in the office had to go and reset the box.
> Do I see it as a bug? Absolutely not: it's in fact my fault for not ensuring
> system resource consumption doesn't overwhelm the machine. This is the same:
> if you do not have RAM to match the cores on your specific rig, add RAM or
> limit the threads.

I can see both sides of this. If we had a pool for all the threads and the
pieces of the system all used the same pool, it would work well as implemented.
Sadly the bitbake threads, the make processes and now the compression threads
are all separate.

We do see the autobuilder break due to load issues too and on that we have
scaled back some of the defaults but not ZSTD as yet that I recall.

As such I think limiting the upper value on number of threads may be a good
compromise, both for compression and maybe for parallel make too.

Cheers,

Richard


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158009): 
https://lists.openembedded.org/g/openembedded-core/message/158009
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Alexander Kanavin
On Tue, 9 Nov 2021 at 10:51, Robert Yang  wrote:

> > Maybe, but once we start doing tweaks like this, where do they stop?
> Hey, I'd
>
> I think that it's not only a performance tweak, but this should be
> considered as
> a bug since it would be failed to build on powerful machine, which isn't
> good
> for oe-core's user experience.
>

I managed to bring down a powerful machine just yesterday by building
webkit and llvm together at the same time. They together ate all the RAM,
and someone in the office had to go and reset the box.
Do I see it as a bug? Absolutely not: it's in fact my fault for not
ensuring system resource consumption doesn't overwhelm the machine. This is
the same: if you do not have RAM to match the cores on your specific rig,
add RAM or limit the threads.

Alex

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158008): 
https://lists.openembedded.org/g/openembedded-core/message/158008
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Robert Yang

Hi Alexander,

On 11/9/21 5:44 PM, Alexander Kanavin wrote:
Maybe, but once we start doing tweaks like this, where do they stop? Hey, I'd 


I think that it's not only a performance tweak, but this should be considered as
a bug since it would be failed to build on powerful machine, which isn't good
for oe-core's user experience.

// Robert

like to limit llvm and webkit threads too, they eat disproportionally large 
amounts of RAM compared to everything else! I'd rather err on the side of 
simple, striaghtforward, universal defaults, and having better documentation for 
tweaking system resource consumption. Each build system is different.


Alex

On Tue, 9 Nov 2021 at 10:40, Robert Yang > wrote:




On 11/9/21 4:41 PM, Konrad Weihmann wrote:
 >
 >
 > On 09.11.21 09:48, Robert Yang wrote:
 >> The original value is very easy to cause do_packge error when cpu 
number is
 >> larger, for example, 128 cores and 512G mem:
 >>
 >> error: create archive failed: cpio: write failed - Cannot allocate 
memory"
 >>
 >> Set the ZSTD_THREADS to half of the CPU number can avoid the error in my
 >> testing.
 >>
 >> Signed-off-by: Robert Yang mailto:liezhi.y...@windriver.com>>
 >> ---
 >>   meta/conf/bitbake.conf | 2 +-
 >>   1 file changed, 1 insertion(+), 1 deletion(-)
 >>
 >> diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
 >> index 71c1e52ad6..46ebf5113f 100644
 >> --- a/meta/conf/bitbake.conf
 >> +++ b/meta/conf/bitbake.conf
 >> @@ -833,7 +833,7 @@ XZ_DEFAULTS ?= "--memlimit=${XZ_MEMLIMIT}
 >> --threads=${XZ_THREADS}"
 >>   XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS"
 >>   # Default parallelism for zstd
 >> -ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}"
 >> +ZSTD_THREADS ?= "${@int(oe.utils.cpu_count(at_least=4)/2)}"
 >
 > Then why not just limit it for the large setups you are referring to in 
the
 > example, for instance like
 >
 > ZSTD_THREADS ?= "${@min(int(oe.utils.cpu_count(at_least=4)),  value of your choice>)}"

This sounds like a good choice.

 >
 > BTW this can be also done in your local.conf - as Alex already said,
there is

Set it in my local.conf can make it work, but it isn't good for oe-core's 
OOBE
since the issue still exists.

 > simply no reason to make it slower for everyone, while also half the
threads of

The whole build contains a lot of tasks, for lower cpu cores, the total
resources are fixed, so when zstd uses less mem, other tasks can use more.

Limit zstd's thread doesn't make the build slower, but faster in my testing,
it would be great if you can help test it. The simple testing commands are:

# Make everything ready:
$ bitbake linux-yocto

# Before the patch, set ZSTD_THREADS to 128 and run 6 times:
$ for i in `seq 0 5`; do time bitbake linux-yocto -cpackage_write_rpm -f >
before_$i.log; done

Note, the time will be printed on the screen, not the before.log, the 
before.log
is for strip the logs and then we can read the time easier.

What I get is:
real    2m12.079s
real    2m0.177s
real    1m52.426s
real    2m3.396s
real    2m16.018s
real    1m58.595s

Drop the first build time since it *may* contain parsing time, and for the 
last
five builds:

Total: 609 seconds
Average: 609 / 5.0 = 121.8


# After the patch, set ZSTD_THREADS to 64, and run 6 times:
$ for i in `seq 0 5`; do time bitbake linux-yocto -cpackage_write_rpm -f >
after_$i.log; done

What I get is:
real    1m50.017s
real    1m50.400s
real    1m53.174s
real    2m4.817s
real    1m53.476s
real    1m56.794s

Drop the first build time since it *may* contain parsing time, and for the 
last
five builds:

Total: 576 seconds
Average: 576 / 5.0 = 115.2

So the smaller number is faster than the larger one.

// Robert

 > a 128 core machine could be a trouble some setup.
 >
 > Last time I had this issue (with XZ back then) I used
 > "${@min(int(oe.utils.cpu_count(at_least=4)), 20}"
 >
 >>   ZSTD_THREADS[vardepvalue] = "1"
 >>   # Limit the number of threads that OpenMP libraries will use.
Otherwise they
 >>
 >>
 >>
 >>
 >>




-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158007): 
https://lists.openembedded.org/g/openembedded-core/message/158007
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Robert Yang

Hi Alexander,

On 11/9/21 4:21 PM, Alexander Kanavin wrote:
But does this mean we need to globally restrict this and make things twice 
slower for everyone? I'm not sure.


Please see my reply to Konrad, it doesn't cause any slower, but faster in my 
testing.


BTW, the XZ_MEMLIMIT is 50% for command xz, but there isn't a similar option for
zstd, so I have to limit ZSTD_THREADS.

// Robert




Alex

On Tue, 9 Nov 2021 at 09:12, Robert Yang > wrote:


The original value is very easy to cause do_packge error when cpu number is
larger, for example, 128 cores and 512G mem:

error: create archive failed: cpio: write failed - Cannot allocate memory"

Set the ZSTD_THREADS to half of the CPU number can avoid the error in my
testing.

Signed-off-by: Robert Yang mailto:liezhi.y...@windriver.com>>
---
  meta/conf/bitbake.conf | 2 +-
  1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 71c1e52ad6..46ebf5113f 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -833,7 +833,7 @@ XZ_DEFAULTS ?= "--memlimit=${XZ_MEMLIMIT}
--threads=${XZ_THREADS}"
  XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS"

  # Default parallelism for zstd
-ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}"
+ZSTD_THREADS ?= "${@int(oe.utils.cpu_count(at_least=4)/2)}"
  ZSTD_THREADS[vardepvalue] = "1"

  # Limit the number of threads that OpenMP libraries will use. Otherwise 
they
-- 
2.17.1






-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158006): 
https://lists.openembedded.org/g/openembedded-core/message/158006
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Alexander Kanavin
Maybe, but once we start doing tweaks like this, where do they stop? Hey,
I'd like to limit llvm and webkit threads too, they eat disproportionally
large amounts of RAM compared to everything else! I'd rather err on the
side of simple, striaghtforward, universal defaults, and having better
documentation for tweaking system resource consumption. Each build system
is different.

Alex

On Tue, 9 Nov 2021 at 10:40, Robert Yang  wrote:

>
>
> On 11/9/21 4:41 PM, Konrad Weihmann wrote:
> >
> >
> > On 09.11.21 09:48, Robert Yang wrote:
> >> The original value is very easy to cause do_packge error when cpu
> number is
> >> larger, for example, 128 cores and 512G mem:
> >>
> >> error: create archive failed: cpio: write failed - Cannot allocate
> memory"
> >>
> >> Set the ZSTD_THREADS to half of the CPU number can avoid the error in my
> >> testing.
> >>
> >> Signed-off-by: Robert Yang 
> >> ---
> >>   meta/conf/bitbake.conf | 2 +-
> >>   1 file changed, 1 insertion(+), 1 deletion(-)
> >>
> >> diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
> >> index 71c1e52ad6..46ebf5113f 100644
> >> --- a/meta/conf/bitbake.conf
> >> +++ b/meta/conf/bitbake.conf
> >> @@ -833,7 +833,7 @@ XZ_DEFAULTS ?= "--memlimit=${XZ_MEMLIMIT}
> >> --threads=${XZ_THREADS}"
> >>   XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS"
> >>   # Default parallelism for zstd
> >> -ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}"
> >> +ZSTD_THREADS ?= "${@int(oe.utils.cpu_count(at_least=4)/2)}"
> >
> > Then why not just limit it for the large setups you are referring to in
> the
> > example, for instance like
> >
> > ZSTD_THREADS ?= "${@min(int(oe.utils.cpu_count(at_least=4)),  sane
> > value of your choice>)}"
>
> This sounds like a good choice.
>
> >
> > BTW this can be also done in your local.conf - as Alex already said,
> there is
>
> Set it in my local.conf can make it work, but it isn't good for oe-core's
> OOBE
> since the issue still exists.
>
> > simply no reason to make it slower for everyone, while also half the
> threads of
>
> The whole build contains a lot of tasks, for lower cpu cores, the total
> resources are fixed, so when zstd uses less mem, other tasks can use more.
>
> Limit zstd's thread doesn't make the build slower, but faster in my
> testing,
> it would be great if you can help test it. The simple testing commands are:
>
> # Make everything ready:
> $ bitbake linux-yocto
>
> # Before the patch, set ZSTD_THREADS to 128 and run 6 times:
> $ for i in `seq 0 5`; do time bitbake linux-yocto -cpackage_write_rpm -f >
> before_$i.log; done
>
> Note, the time will be printed on the screen, not the before.log, the
> before.log
> is for strip the logs and then we can read the time easier.
>
> What I get is:
> real2m12.079s
> real2m0.177s
> real1m52.426s
> real2m3.396s
> real2m16.018s
> real1m58.595s
>
> Drop the first build time since it *may* contain parsing time, and for the
> last
> five builds:
>
> Total: 609 seconds
> Average: 609 / 5.0 = 121.8
>
>
> # After the patch, set ZSTD_THREADS to 64, and run 6 times:
> $ for i in `seq 0 5`; do time bitbake linux-yocto -cpackage_write_rpm -f >
> after_$i.log; done
>
> What I get is:
> real1m50.017s
> real1m50.400s
> real1m53.174s
> real2m4.817s
> real1m53.476s
> real1m56.794s
>
> Drop the first build time since it *may* contain parsing time, and for the
> last
> five builds:
>
> Total: 576 seconds
> Average: 576 / 5.0 = 115.2
>
> So the smaller number is faster than the larger one.
>
> // Robert
>
> > a 128 core machine could be a trouble some setup.
> >
> > Last time I had this issue (with XZ back then) I used
> > "${@min(int(oe.utils.cpu_count(at_least=4)), 20}"
> >
> >>   ZSTD_THREADS[vardepvalue] = "1"
> >>   # Limit the number of threads that OpenMP libraries will use.
> Otherwise they
> >>
> >>
> >>
> >>
> >>
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158005): 
https://lists.openembedded.org/g/openembedded-core/message/158005
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Robert Yang



On 11/9/21 4:41 PM, Konrad Weihmann wrote:



On 09.11.21 09:48, Robert Yang wrote:

The original value is very easy to cause do_packge error when cpu number is
larger, for example, 128 cores and 512G mem:

error: create archive failed: cpio: write failed - Cannot allocate memory"

Set the ZSTD_THREADS to half of the CPU number can avoid the error in my
testing.

Signed-off-by: Robert Yang 
---
  meta/conf/bitbake.conf | 2 +-
  1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 71c1e52ad6..46ebf5113f 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -833,7 +833,7 @@ XZ_DEFAULTS ?= "--memlimit=${XZ_MEMLIMIT} 
--threads=${XZ_THREADS}"

  XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS"
  # Default parallelism for zstd
-ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}"
+ZSTD_THREADS ?= "${@int(oe.utils.cpu_count(at_least=4)/2)}"


Then why not just limit it for the large setups you are referring to in the 
example, for instance like


ZSTD_THREADS ?= "${@min(int(oe.utils.cpu_count(at_least=4)), value of your choice>)}"


This sounds like a good choice.



BTW this can be also done in your local.conf - as Alex already said, there is 


Set it in my local.conf can make it work, but it isn't good for oe-core's OOBE
since the issue still exists.

simply no reason to make it slower for everyone, while also half the threads of 


The whole build contains a lot of tasks, for lower cpu cores, the total
resources are fixed, so when zstd uses less mem, other tasks can use more.

Limit zstd's thread doesn't make the build slower, but faster in my testing,
it would be great if you can help test it. The simple testing commands are:

# Make everything ready:
$ bitbake linux-yocto

# Before the patch, set ZSTD_THREADS to 128 and run 6 times:
$ for i in `seq 0 5`; do time bitbake linux-yocto -cpackage_write_rpm -f > 
before_$i.log; done


Note, the time will be printed on the screen, not the before.log, the before.log
is for strip the logs and then we can read the time easier.

What I get is:
real2m12.079s
real2m0.177s
real1m52.426s
real2m3.396s
real2m16.018s
real1m58.595s

Drop the first build time since it *may* contain parsing time, and for the last
five builds:

Total: 609 seconds
Average: 609 / 5.0 = 121.8


# After the patch, set ZSTD_THREADS to 64, and run 6 times:
$ for i in `seq 0 5`; do time bitbake linux-yocto -cpackage_write_rpm -f > 
after_$i.log; done


What I get is:
real1m50.017s
real1m50.400s
real1m53.174s
real2m4.817s
real1m53.476s
real1m56.794s

Drop the first build time since it *may* contain parsing time, and for the last
five builds:

Total: 576 seconds
Average: 576 / 5.0 = 115.2

So the smaller number is faster than the larger one.

// Robert


a 128 core machine could be a trouble some setup.

Last time I had this issue (with XZ back then) I used 
"${@min(int(oe.utils.cpu_count(at_least=4)), 20}"



  ZSTD_THREADS[vardepvalue] = "1"
  # Limit the number of threads that OpenMP libraries will use. Otherwise they






-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158004): 
https://lists.openembedded.org/g/openembedded-core/message/158004
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH v3] glibc: ptest: Add running glibc time related test suite (Y2038) with ptest

2021-11-09 Thread Lee Chee Yang
Hi, 

I think need to fix this too 

AssertionError:
The following recipes do not have a maintainer assigned to them. Please add an 
entry to meta/conf/distro/include/maintainers.inc file.
glibc-tests 
(/home/pokybuild/yocto-worker/oe-selftest-centos/build/meta/recipes-core/glibc/glibc-tests_2.34.bb)

full log:
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2807/steps/15/logs/stdio


also for issue with 
"Missing or unbuildable dependency chain was: ['nativesdk-ptest-runner']"
you may refer to these build for build config
https://autobuilder.yoctoproject.org/typhoon/#/builders/23/builds/4598/steps/11/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/3629/steps/12/logs/stdio



>-Original Message-
>From: openembedded-core@lists.openembedded.org c...@lists.openembedded.org> On Behalf Of ?ukasz Majewski
>Sent: Tuesday, 9 November, 2021 12:31 AM
>To: Alexandre Belloni 
>Cc: Richard Purdie ; Nathan Rossi
>; Khem Raj ; Adhemerval
>Zanella ; Patches and discussions about the oe-
>core layer 
>Subject: Re: [OE-core] [PATCH v3] glibc: ptest: Add running glibc time related 
>test
>suite (Y2038) with ptest
>
>Hi Alexandre.
>
>Sorry for the late reply - I've must overlooked this reply...
>
>> Hello,
>>
>> There is a remaining issue:
>>
>> WARNING: Nothing RPROVIDES 'nativesdk-ptest-runner' (but
>> virtual:nativesdk:/home/pokybuild/yocto-worker/build-appliance/build/m
>> eta/recipes-core/glibc/glibc-tests_2.34.bb
>> RDEPENDS on or otherwise requires it) NOTE: Runtime target
>> 'nativesdk-ptest-runner' is unbuildable, removing... Missing or
>> unbuildable dependency chain was: ['nativesdk-ptest-runner']
>
>Could you share your setup?
>
>I've been trying to reproduce this problem with:
>MACHINE=qemuarm64 bitbake core-image-ptest-all -c populate_sdk
>
>but no warnings were observed.
>
>Thanks in advance.
>
>>
>> On 28/10/2021 14:00:20+0200, ?ukasz Majewski wrote:
>> > This patch introduces new recipe - namely 'glibc-tests', which
>> > builds and installs time related (to check if Y2038 support works)
>> > glibc test suite to OE/Yocto built image.
>> >
>> > It reuses code from already available 'glibc-testsuite' recipe,
>> > which is run with 'bitbake glibc-testsuite -c check' and uses qemu
>> > to execute remotely (via SSH) tests on some emulated machine.
>> >
>> > This recipe installs time related glibc tests on some rootfs image.
>> > Afterwards, those tests can be executed on the real hardware, to
>> > facilitate validation of it with Y2038 problem compliance.
>> >
>> > To test time related subset - one needs to call:
>> > ptest-runner glibc-tests
>> > then change the date after Y2038 threshold for 32 bit systems:
>> > date -s "20 JAN 2038 18:00:00"
>> > and then run ptest-runner again.
>> >
>> > To facilitate debugging, source files are provided by default with
>> > the unstripped debugging symbols. Such approach would reduce the
>> > already complex recipe (as it inherits base glibc one), so there is
>> > no need to also install *-dbg and *-src packages.
>> >
>> > Signed-off-by: Lukasz Majewski 
>> >
>> > ---
>> > Changes for v3:
>> > - Provide missing ${PN}-ptest for PACKAGES, PROVIDES and
>> >   RPROVIDES variables
>> >
>> > Changes for v2:
>> > - Just focus on time related set of tests as those can be run as
>> >   standalone
>> > - Reuse of already built tests (from glibc-tests.inc) and depoloy
>> >   them on the HW target.
>> > - Provide single 'run-ptest' script.
>> > - Update the recipe to run with newest poky's -master
>> > ---
>> >  .../distro/include/ptest-packagelists.inc |   1 +
>> >  meta/recipes-core/glibc/glibc-tests_2.34.bb   | 112
>> > ++ meta/recipes-core/glibc/glibc/run-ptest   |
>> > 37 ++ 3 files changed, 150 insertions(+)  create mode 100644
>> > meta/recipes-core/glibc/glibc-tests_2.34.bb
>> >  create mode 100755 meta/recipes-core/glibc/glibc/run-ptest
>> >
>> > diff --git a/meta/conf/distro/include/ptest-packagelists.inc
>> > b/meta/conf/distro/include/ptest-packagelists.inc index
>> > 2e324f8da4..fd52fa72a4 100644 ---
>> > a/meta/conf/distro/include/ptest-packagelists.inc +++
>> > b/meta/conf/distro/include/ptest-packagelists.inc @@ -61,6 +61,7 @@
>> > PTESTS_FAST = "\ slang-ptest \
>> >  wayland-ptest \
>> >  zlib-ptest \
>> > +glibc-tests-ptest \
>> >  "
>> >  PTESTS_FAST:remove:mips64 = "qemu-ptest"
>> >  PTESTS_PROBLEMS:append:mips64 = "qemu-ptest"
>> > diff --git a/meta/recipes-core/glibc/glibc-tests_2.34.bb
>> > b/meta/recipes-core/glibc/glibc-tests_2.34.bb new file mode 100644
>> > index 00..0a6920eef4
>> > --- /dev/null
>> > +++ b/meta/recipes-core/glibc/glibc-tests_2.34.bb
>> > @@ -0,0 +1,112 @@
>> > +require glibc_${PV}.bb
>> > +require glibc-tests.inc
>> > +
>> > +inherit ptest
>> > +
>> > +SRC_URI:append = " \
>> > +  file://run-ptest \
>> > +"
>> > +
>> > +SUMMARY = "glibc tests to be run with ptest"
>> > +
>> > +# Erase some variables already set by glibc_${PV} python
>> > 

Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Jose Quaresma
Robert Yang  escreveu no dia terça, 9/11/2021
à(s) 08:12:

> The original value is very easy to cause do_packge error when cpu number is
> larger, for example, 128 cores and 512G mem:
>
> error: create archive failed: cpio: write failed - Cannot allocate memory"
>
> Set the ZSTD_THREADS to half of the CPU number can avoid the error in my
> testing.
>
> Signed-off-by: Robert Yang 
> ---
>  meta/conf/bitbake.conf | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>
> diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
> index 71c1e52ad6..46ebf5113f 100644
> --- a/meta/conf/bitbake.conf
> +++ b/meta/conf/bitbake.conf
> @@ -833,7 +833,7 @@ XZ_DEFAULTS ?= "--memlimit=${XZ_MEMLIMIT}
> --threads=${XZ_THREADS}"
>  XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS"
>
>  # Default parallelism for zstd
> -ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}"
> +ZSTD_THREADS ?= "${@int(oe.utils.cpu_count(at_least=4)/2)}"
>

This will slow down all the systems with lower cpu cores.


>  ZSTD_THREADS[vardepvalue] = "1"
>
>  # Limit the number of threads that OpenMP libraries will use. Otherwise
> they
> --
> 2.17.1
>
>
> 
>
>

-- 
Best regards,

José Quaresma

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158002): 
https://lists.openembedded.org/g/openembedded-core/message/158002
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Konrad Weihmann



On 09.11.21 09:48, Robert Yang wrote:

The original value is very easy to cause do_packge error when cpu number is
larger, for example, 128 cores and 512G mem:

error: create archive failed: cpio: write failed - Cannot allocate memory"

Set the ZSTD_THREADS to half of the CPU number can avoid the error in my
testing.

Signed-off-by: Robert Yang 
---
  meta/conf/bitbake.conf | 2 +-
  1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 71c1e52ad6..46ebf5113f 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -833,7 +833,7 @@ XZ_DEFAULTS ?= "--memlimit=${XZ_MEMLIMIT} 
--threads=${XZ_THREADS}"
  XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS"
  
  # Default parallelism for zstd

-ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}"
+ZSTD_THREADS ?= "${@int(oe.utils.cpu_count(at_least=4)/2)}"


Then why not just limit it for the large setups you are referring to in 
the example, for instance like


ZSTD_THREADS ?= "${@min(int(oe.utils.cpu_count(at_least=4)), sane value of your choice>)}"


BTW this can be also done in your local.conf - as Alex already said, 
there is simply no reason to make it slower for everyone, while also 
half the threads of a 128 core machine could be a trouble some setup.


Last time I had this issue (with XZ back then) I used 
"${@min(int(oe.utils.cpu_count(at_least=4)), 20}"



  ZSTD_THREADS[vardepvalue] = "1"
  
  # Limit the number of threads that OpenMP libraries will use. Otherwise they







-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158001): 
https://lists.openembedded.org/g/openembedded-core/message/158001
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Alexander Kanavin
But does this mean we need to globally restrict this and make things twice
slower for everyone? I'm not sure.


Alex

On Tue, 9 Nov 2021 at 09:12, Robert Yang  wrote:

> The original value is very easy to cause do_packge error when cpu number is
> larger, for example, 128 cores and 512G mem:
>
> error: create archive failed: cpio: write failed - Cannot allocate memory"
>
> Set the ZSTD_THREADS to half of the CPU number can avoid the error in my
> testing.
>
> Signed-off-by: Robert Yang 
> ---
>  meta/conf/bitbake.conf | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>
> diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
> index 71c1e52ad6..46ebf5113f 100644
> --- a/meta/conf/bitbake.conf
> +++ b/meta/conf/bitbake.conf
> @@ -833,7 +833,7 @@ XZ_DEFAULTS ?= "--memlimit=${XZ_MEMLIMIT}
> --threads=${XZ_THREADS}"
>  XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS"
>
>  # Default parallelism for zstd
> -ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}"
> +ZSTD_THREADS ?= "${@int(oe.utils.cpu_count(at_least=4)/2)}"
>  ZSTD_THREADS[vardepvalue] = "1"
>
>  # Limit the number of threads that OpenMP libraries will use. Otherwise
> they
> --
> 2.17.1
>
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#158000): 
https://lists.openembedded.org/g/openembedded-core/message/158000
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 0/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Robert Yang
The following changes since commit afad2f09ebbfe395f8fafce8218e26056479fe39:

  meson: improve SDK's wrapper to make Wraps work (2021-11-08 22:01:53 +)

are available in the Git repository at:

  git://git.openembedded.org/openembedded-core-contrib rbt/zstd
  http://cgit.openembedded.org/openembedded-core-contrib/log/?h=rbt/zstd

Robert Yang (1):
  bitbake.conf: Set ZSTD_THREADS to half of cpu number

 meta/conf/bitbake.conf | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

-- 
2.17.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#157999): 
https://lists.openembedded.org/g/openembedded-core/message/157999
Mute This Topic: https://lists.openembedded.org/mt/86926963/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 1/1] bitbake.conf: Set ZSTD_THREADS to half of cpu number

2021-11-09 Thread Robert Yang
The original value is very easy to cause do_packge error when cpu number is
larger, for example, 128 cores and 512G mem:

error: create archive failed: cpio: write failed - Cannot allocate memory"

Set the ZSTD_THREADS to half of the CPU number can avoid the error in my
testing.

Signed-off-by: Robert Yang 
---
 meta/conf/bitbake.conf | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 71c1e52ad6..46ebf5113f 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -833,7 +833,7 @@ XZ_DEFAULTS ?= "--memlimit=${XZ_MEMLIMIT} 
--threads=${XZ_THREADS}"
 XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS"
 
 # Default parallelism for zstd
-ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}"
+ZSTD_THREADS ?= "${@int(oe.utils.cpu_count(at_least=4)/2)}"
 ZSTD_THREADS[vardepvalue] = "1"
 
 # Limit the number of threads that OpenMP libraries will use. Otherwise they
-- 
2.17.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#157998): 
https://lists.openembedded.org/g/openembedded-core/message/157998
Mute This Topic: https://lists.openembedded.org/mt/86926962/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-