Re: [OE-core] [PATCH 2/2] libdrm: upgrade 2.4.103 -> 2.4.104

2021-01-25 Thread Richard Purdie
On Mon, 2021-01-25 at 13:49 +, Richard Purdie via lists.openembedded.org wrote: > On Mon, 2021-01-25 at 10:20 +0800, Wang Mingyu wrote: > > Signed-off-by: Wang Mingyu > > --- > >  .../drm/{libdrm_2.4.103.bb => libdrm_2.4.104.bb} | 4 ++-- > >  1 file changed, 2 insertions(+), 2

[OE-core][dunfell 44/47] wic: Update pseudo db when excluding content from rootfs

2021-01-25 Thread Steve Sakoman
From: Paul Barker To exclude content from the rootfs, wic makes a copy (using hardlinks if possible) of the rootfs directory and associated pseudo db, then removes files & directories as needed. However if these files and directories are removed using the python functions os.remove and

[OE-core][dunfell 45/47] wic: Add --change-directory argument

2021-01-25 Thread Steve Sakoman
From: Ricardo Ribalda Delgado This option allows to specify which part of a rootfs is going to be included, the same way the -C argument on tar. Thanks to this option we can make sure the permissions and usernames on the target partition are respected, and also simplify the creation of splitted

[OE-core][dunfell 46/47] wic: Copy rootfs dir if fstab needs updating

2021-01-25 Thread Steve Sakoman
From: Paul Barker By default, wic updates the /etc/fstab in the rootfs to include details of additional partitions described in the selected wks file. If this modification is performed in place, other tasks which create an image file from the rootfs directory (e.g. do_image_tar and

[OE-core][dunfell 37/47] bitbake.conf: Add /run/ to PSEUDO_IGNORE_PATHS

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Builds were failing on WSL2 which turns out to be due to accesses to /run/ on those systems. Add this to PSEUDO_IGNORE_PATHS to fix builds on WSL2. [YOCTO #14175] Signed-off-by: Richard Purdie (cherry picked from commit 1d1bf51217e8b4d54af28739d3271484ee5a7974)

[OE-core][dunfell 38/47] pseudo: Add lchmod wrapper

2021-01-25 Thread Steve Sakoman
From: Richard Purdie New versions of glibc have an lchmod function so we need to wrap it. Identified through a reproducibility issue in initramfs-base where /dev/console created by mknod from coreutils changed permissions depending on the host distro (mknod used the gnulib wrapper on most hosts

[OE-core][dunfell 39/47] pseudo: Update for arm host and memleak fixes/cleanup

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Pulls in: makewrappers: support architecture-overrides in wrapper modifiers makewrappers: fix Python 2 hangover Fix some memory leaks Disable deprecated function warnings Silence switch block warnings pseudo_util: don't overrun strings when looking for keys Signed-off-by:

[OE-core][dunfell 47/47] wic: Optimise fstab modification for ext2/3/4 and msdos partitions

2021-01-25 Thread Steve Sakoman
From: Paul Barker The fix for [Yocto #13994] required the rootfs directory to be copied (using hardlinks if possible) when modifying the fstab file under wic. We can optimise this copy away for filesystems where we have the tools to modify the contents of the partition image after it is

[OE-core][dunfell 42/47] wic: Ensure internal workdir is not reused

2021-01-25 Thread Steve Sakoman
From: Paul Barker If a path is specified for the internal wic working directory using the -w/--workdir argument then it must not already exist. Re-using a previous workdir could easily result in rootfs and intermediate files from a previous build being added to the current image. Signed-off-by:

[OE-core][dunfell 43/47] image_types_wic: Move wic working directory

2021-01-25 Thread Steve Sakoman
From: Paul Barker By default the wic working directory is placed under the output directory. When invoking wic under bitbake, the wic output directory is added to PSEUDO_PATHS_IGNORE to avoid issues with files being removed from outside a pseudo environment (see oe-core commit ad8f5532ff).

[OE-core][dunfell 40/47] wic: Add workdir argument

2021-01-25 Thread Steve Sakoman
From: Paul Barker This allows the path for the temporary workdir used by wic to be set when running wic from bitbake or directly from the command line. Signed-off-by: Paul Barker Signed-off-by: Richard Purdie (cherry picked from commit 2e7314ac3a3cab89de93c932e8efc75de0feb0a7) Signed-off-by:

[OE-core][dunfell 41/47] wic: Allow exec_native_cmd to run HOSTTOOLS

2021-01-25 Thread Steve Sakoman
From: Paul Barker This allows programs from HOSTTOOLS (e.g. 'install', 'rm', 'mv', etc) to be more easily executed by wic. Without this change only programs from an actual *-native recipe built by bitbake can be executed by wic. Signed-off-by: Paul Barker Signed-off-by: Richard Purdie (cherry

Re: [OE-core][dunfell 00/47] Patch review - pseudo file mode corruption fix V2

2021-01-25 Thread Steve Sakoman
On Mon, Jan 25, 2021 at 5:42 AM Paul Barker wrote: > > On Mon, 25 Jan 2021 at 14:51, Steve Sakoman wrote: > > > > Issues with undetected file mode corruption in pseudo have been identified. > > > > Fixes have been merged into master and gatesgarth over the past several > > months and > > things

Re: [OE-core] [yocto-security] OE-core CVE metrics for master on Sun 24 Jan 2021 07:15:01 AM HST

2021-01-25 Thread Richard Purdie
I'm not sure its working. For example: https://nvd.nist.gov/vuln/detail/CVE-2019-1543 which says it applies to: 1.1.0 to 1.1.0j and 1.1.1 to 1.1.1b Master has 1.1.1i which is greater than 1.1.1b so we shouldn't be shown as at risk yet the CVE is listed. Cheers, Richard On Mon, 2021-01-25 at

[OE-core] [PATCH] externalsrc: Remove task dependencies to deleted tasks

2021-01-25 Thread Tomasz Dziendzielski
The python3 recipe sets `do_create_manifest[depends] += "${PN}:do_patch"` but do_patch is removed in externalsrc and fails with: | ERROR: Task do_create_manifest in /python3_3.8.2.bb depends upon | non-existent task do_patch in /python3_3.8.2.bb It is safe to simply remove these dependencies

Re: [OE-core] [PATCH 3/4] selftest/reproducible: remove spirv-tools-dev from exclusion list

2021-01-25 Thread Richard Purdie
tools-dev', >   'swig', >   'syslinux-misc', >   'systemd-bootchart', Thanks for looking at this, unfortunately in testing it shows there is still some kind of issue: https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210125-8161_obd/packages/diff-html/ Looks like it

Re: [OE-core] [PATCH 5/5] sanity.bbclass: verify that user isn't building in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Dorinda
Thanks for the feedbacks, will update the patch. Dorinda On Jan 25, 2021 3:58 PM, "Peter Kjellerstedt" wrote: > > -Original Message- > > From: openembedded-core@lists.openembedded.org > c...@lists.openembedded.org> On Behalf Of Quentin Schulz > > Sent: den 25 januari 2021 10:22 > >

Re: [OE-core] [PATCH] sanity.bbclass: verify that user isn't building in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Dorinda
Apologies please disregard this code, the update I made against this patch didn't reflect. On Jan 25, 2021 23:48, "dorindabassey" wrote: > added a check to ensure that a user isn't building in PSEUDO_IGNORE_PATHS > > Signed-off-by: Dorinda Bassey > --- > meta/classes/sanity.bbclass | 7

Re: [OE-core] [PATCH] externalsrc: Remove task dependencies to deleted tasks

2021-01-25 Thread Richard Purdie
On Mon, 2021-01-25 at 22:01 +0100, Tomasz Dziendzielski wrote: > The python3 recipe sets `do_create_manifest[depends] += "${PN}:do_patch"` > but do_patch is removed in externalsrc and fails with: > > ERROR: Task do_create_manifest in /python3_3.8.2.bb depends upon > > non-existent task do_patch in

Re: [OE-core] [PATCH] externalsrc: Remove task dependencies to deleted tasks

2021-01-25 Thread Tomasz Dziendzielski
>would it help to change the python recipe to do: >addtask do_create_manifest after do_patch do_prepare_recipe_sysroot >? Well I think it would, I just thought it's done that way for some reason. I will submit a new patch. Best regards, Tomasz Dziendzielski -=-=-=-=-=-=-=-=-=-=-=- Links: You

Re: [OE-core] [PATCH] sanity.bbclass: verify that user isn't building in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Richard Purdie
On Tue, 2021-01-26 at 00:08 +0100, Dorinda wrote: > If a user builds in a path in PSEUDO_IGNORE_PATHS, random failures are > generated. Hence this patch adds a sanity check in sanity.bbclass to ensure > that a user isn't building in PSEUDO_IGNORE_PATHS. > > [YOCTO #14179] > > Signed-off-by:

[OE-core] OpenEmbedded Happy Hour January 27 5pm/1700 UTC

2021-01-25 Thread Denys Dmytriyenko
Hi, Just a reminder about our upcoming OpenEmbedded Happy Hour on January 27 for Europe/US timezones @ 1700/5pm UTC (12pm ET): https://www.openembedded.org/wiki/Calendar https://www.timeanddate.com/worldclock/fixedtime.html?msg=OpenEmbedded+Happy+Hour+January+27=20210127T17 -- Regards, Denys

[OE-core] [PATCH 1/2] sanity.bbclass: sanity check for if bitbake is present in PATH

2021-01-25 Thread Dorinda
If a user executes the environment script instead of sourcing it, there's an error about an empty element in PATH. This is because bitbake isn't present in environment variable PATH. Hence, this patch adds a sanity check to verify if bitbake is present in PATH and if bitbake isn't present issue

[OE-core] [PATCH] sanity.bbclass: verify that user isn't building in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Dorinda
If a user builds in a path in PSEUDO_IGNORE_PATHS, random failures are generated. Hence this patch adds a sanity check in sanity.bbclass to ensure that a user isn't building in PSEUDO_IGNORE_PATHS. [YOCTO #14179] Signed-off-by: Dorinda Bassey --- meta/classes/sanity.bbclass | 7 +++ 1

[OE-core] [PATCH] sanity.bbclass: verify that user isn't building in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Dorinda
If a user builds in a path in PSEUDO_IGNORE_PATHS, random failures are generated. Hence this patch adds a sanity check in sanity.bbclass to ensure that a user isn't building in PSEUDO_IGNORE_PATHS. [YOCTO #14179] Signed-off-by: Dorinda Bassey --- meta/classes/sanity.bbclass | 7 +++ 1

[OE-core] [PATCH] sanity.bbclass: verify that user isn't building in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Dorinda
added a check to ensure that a user isn't building in PSEUDO_IGNORE_PATHS Signed-off-by: Dorinda Bassey --- meta/classes/sanity.bbclass | 7 +++ 1 file changed, 7 insertions(+) diff --git a/meta/classes/sanity.bbclass b/meta/classes/sanity.bbclass index 2040b48595..78c0343f0d 100644 ---

[OE-core][PATCH 1/1] core-image-tiny-initramfs: Add compatiblity for aarch64

2021-01-25 Thread Jonathan Richardson via lists.openembedded.org
Update the host compatibility to include aarch64. Signed-off-by: Jonathan Richardson --- meta/recipes-core/images/core-image-tiny-initramfs.bb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-core/images/core-image-tiny-initramfs.bb

Re: [OE-core] [PATCH] libmodulemd: upgrade 2.11.2 -> 2.12.0

2021-01-25 Thread Khem Raj
In commit msg Can you mention why -Ddeveloper_build=false is dropped? On 1/24/21 9:42 PM, zhengruoqin wrote: Signed-off-by: Zheng Ruoqin --- meta/recipes-devtools/libmodulemd/libmodulemd_git.bb | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git

[OE-core] [PATCH] python3: Use addtask statement instead of task dependencies

2021-01-25 Thread Tomasz Dziendzielski
The externalsrc class deletes do_patch task which results with: | ERROR: Task do_create_manifest in /python3_3.8.2.bb depends upon | non-existent task do_patch in /python3_3.8.2.bb Use addtask to define correct order to prevent this error, since addtask mechanism accepts deleted tasks. [YOCTO

Re: [OE-core] [PATCH 3/4] selftest/reproducible: remove spirv-tools-dev from exclusion list

2021-01-25 Thread Jose Quaresma
isc', > > 'systemd-bootchart', > > Thanks for looking at this, unfortunately in testing it shows there is > still some kind of issue: > > > https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210125-8161_obd/packages/diff-html/ > > Looks like it shouldn't be

Re: [OE-core] [PATCH 3/4] selftest/reproducible: remove spirv-tools-dev from exclusion list

2021-01-25 Thread Richard Purdie
ake do that itself if we can. It may be possible to have cmake evaluate the variable with reference to the sysroot too but that is likely more complex. I'm afraid cmake isn't one of my strong areas. We do have a second issue too the autobuilder has shown up: https://autobuilder.yocto.io/pub/repro-fa

[OE-core] [PATCH] musl: Update to 1.2.2 release

2021-01-25 Thread Khem Raj
Detailed logs are here [1] * 85e0e351 release 1.2.2 * 3953aecb fix VIDIOC_DQEVENT (v4l2) ioctl fallback for pre-5.6 kernels * 30f55067 fix v4l2 buffer ioctl fallbacks for pre-5.6 kernels * db981ffb sh: fix incorrect mcontext_t member naming [1]

[OE-core][dunfell 23/47] base.bbclass: use os.path.normpath instead of just comparing WORKDIR and S as strings

2021-01-25 Thread Steve Sakoman
From: Martin Jansa * cannot use os.path.samefile, because S/B might not exist at this time yet * there is issue with PSEUDO_IGNORE_PATHS when some recipe sets e.g. S = "${WORKDIR}/" whole WORKDIR gets added to PSEUDO_IGNORE_PATHS and then the build can fail with various strange errors, in

[OE-core][dunfell 21/47] pseudo: Update to account for patches merged on branch

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Signed-off-by: Richard Purdie (cherry picked from commit ea22fb3aa1c5dd3edcd1d8b415a0843a9ee4677c) Signed-off-by: Steve Sakoman --- .../pseudo/files/abort_on_mismatch.patch | 64 .../pseudo/files/add_ignore_paths.patch | 298 --

[OE-core][dunfell 25/47] tcl: adapt to potential pseudo changes

2021-01-25 Thread Steve Sakoman
From: Mingli Yu It failed as below when rerun do_install for tcl: $ bitbake tcl $ bitbake tcl -f -cinstall [snip] | NOTE: make -j 72 DESTDIR=/build/tmp/work/core2-64-wrs-linux/tcl/8.6.10-r0/image install | abort()ing pseudo client by server request. See

[OE-core][dunfell 31/47] pseudo: Drop patches merged into upstream branch

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Signed-off-by: Richard Purdie (cherry picked from commit 7386a116222979e6de60c39d2c094d5f216fb101) Signed-off-by: Steve Sakoman --- ...ssen-indentation-of-pseudo_client_ig.patch | 69 --- ...mplify-pseudo_client_ignore_path_chr.patch | 50 --

[OE-core][dunfell 32/47] lib/oe/path: Add canonicalize()

2021-01-25 Thread Steve Sakoman
From: Peter Kjellerstedt oe.path.canonicalize() is used to canonicalize paths (i.e., remove symbolic links and "..", and make them absolute). It takes a string with paths separated by commas, and returns the canonicalized path in the same format. Signed-off-by: Peter Kjellerstedt

[OE-core][dunfell 33/47] bitbake.conf: Canonicalize paths in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Steve Sakoman
From: Peter Kjellerstedt Use oe.path.canonicalize() to canonicalize the paths in PSEUDO_IGNORE_PATHS before passing them to pseudo. This is needed since pseudo will compare them to paths that are canonicalized. Signed-off-by: Peter Kjellerstedt Signed-off-by: Richard Purdie (cherry picked

[OE-core][dunfell 28/47] pseudo: Simplify pseudo_client_ignore_path_chroot()

2021-01-25 Thread Steve Sakoman
From: Peter Kjellerstedt This also plugs a memory leak in pseudo_client_ignore_path_chroot(). Signed-off-by: Peter Kjellerstedt Signed-off-by: Richard Purdie (cherry picked from commit d85054a1c4e20a3e32fa9ab31f5859d6fbb6) Signed-off-by: Steve Sakoman ---

[OE-core][dunfell 27/47] uninative: Don't use single sstate for pseudo-native

2021-01-25 Thread Steve Sakoman
From: Richard Purdie pseudo-native is a bit special. It conditionally compiles in support for xattr, statx and statvfs amongst other options. If a pseudo-native binary is used on a system where these functions are present but it wasn't compiled in we see hard to debug permissions problems. An

[OE-core][dunfell 29/47] pseudo: Update to print PSEUDO_LOGFILE in abort message on path mismatches

2021-01-25 Thread Steve Sakoman
From: Tomasz Dziendzielski Signed-off-by: Tomasz Dziendzielski Signed-off-by: Richard Purdie (cherry picked from commit 9259d684415e3e7923de74359a4ed3487e0e9da7) Signed-off-by: Steve Sakoman --- meta/recipes-devtools/pseudo/pseudo_git.bb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)

[OE-core][dunfell 36/47] license.bbclass: Add COMMON_LICENSE_DIR and LICENSE_PATH dirs to PSEUDO_IGNORE_PATHS

2021-01-25 Thread Steve Sakoman
From: Martin Jansa * now without ${COREBASE}/meta in PSEUDO_IGNORE_PATHS after: 73d538f207 bitbake.conf: Prevent pyc file generation in pseudo context the do_package tasks are failing when LICENSE_CREATE_PACKAGE is enabled pseudo.log shows that it's because of license texts copied from

[OE-core][dunfell 34/47] wic: Pass canonicalized paths in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Steve Sakoman
From: Peter Kjellerstedt Signed-off-by: Peter Kjellerstedt Signed-off-by: Richard Purdie (cherry picked from commit 55618cbd58d6784a82e773f323723be6f722232f) Signed-off-by: Steve Sakoman --- scripts/lib/wic/partition.py | 12 +++- 1 file changed, 11 insertions(+), 1 deletion(-) diff

[OE-core][dunfell 35/47] bitbake.conf: Prevent pyc file generation in pseudo context

2021-01-25 Thread Steve Sakoman
From: Paul Barker This also effectively reverts commit b6d30c21b0: bitbake.conf: Extend PSEUDO_IGNORE_PATHS to ${COREBASE}/meta The contents of ${COREBASE}/meta were ignored as pyc files could be generated for the contents of the lib subdirectory if python modules were imported within a

[OE-core][dunfell 17/47] wic: Handle new PSEUDO_IGNORE_PATHS variable

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Adjust wic to correctly handle the new PSEUDO_IGNORE_PATH variable and avoid inode corruption issues. Signed-off-by: Richard Purdie (cherry picked from commit 13500f5234361385c365c7c35e83f99435500481) Signed-off-by: Steve Sakoman --- meta/classes/image_types_wic.bbclass

[OE-core][dunfell 18/47] pseudo: Fix statx function usage

2021-01-25 Thread Steve Sakoman
From: Richard Purdie There is magic in the posts where specific variable names have specific magic. For that magic to work, "path" needs to be used not "pathname" as is currently there. Fix this, which fixes path issues on systems using statx (Ubuntu 20.04 in particular). Signed-off-by: Richard

[OE-core][dunfell 26/47] bitbake.conf: Exclude ${CCACHE_DIR} from pseudo database

2021-01-25 Thread Steve Sakoman
From: Mingli Yu When ccache enabled as below: INHERIT += "ccache" CCACHE_DIR = "/path/build/ccache" There comes do_install failure for some recipes randomly, take linux-libc-headerswhen as example. $ cat /path/build/tmp/work/corei7-64-wrs-linux/linux-libc-headers/5.8-r0/pseudo/pseudo.log

[OE-core][dunfell 24/47] oeqa/selftest/runtime_test: Exclude gpg directory from pseudo database

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Avoid pseudo abort()s like: path mismatch [1 link]: ino 6295376 db '/tmp/oeqa-feed-sign-2mw7z81v/S.gpg-agent.yocto-native' req '/tmp/jwkivmu6'. Signed-off-by: Richard Purdie (cherry picked from commit 189630ca6cdf7ceb6cf9b8f9d86c58997f505efc) Signed-off-by: Steve Sakoman

[OE-core][dunfell 19/47] bitbake.conf: Extend PSEUDO_IGNORE_PATHS to ${COREBASE}/meta

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Unfortunately, .pyc files can be generated in meta/lib/oe which corrupt the pseudo database so we need to extend the ignore list to cover this as well. Signed-off-by: Richard Purdie (cherry picked from commit e0cb6dd689a362d8433caa14cc5a9fdd5eb44923) Signed-off-by: Steve

[OE-core][dunfell 20/47] abi_version,sanity: Tell users TMPDIR must be clean after pseudo changes

2021-01-25 Thread Steve Sakoman
From: Richard Purdie After the recent path ignore changes, there are invalid entries in exiting pseudo databases which will trip up users with the new abort() (proving how common the pseudo potential corrpution is!). Inform them a clean TMPDIR is needed. Signed-off-by: Richard Purdie (cherry

[OE-core][dunfell 22/47] pseudo: Upgrade to include mkostemp64 wrapper

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Newer systems are using this currently unwrapped glibc function, add it. [YOCTO #14080] Signed-off-by: Richard Purdie (cherry picked from commit cba4f51f0166e2c20e854ee0344be0c58769eaca) Signed-off-by: Steve Sakoman --- meta/recipes-devtools/pseudo/pseudo_git.bb | 2 +-

[OE-core][dunfell 30/47] distutils3: allow setup.py to be run from a different directory to ${S}

2021-01-25 Thread Steve Sakoman
From: Jack Mitchell Sometimes setup.py can be buried deep in a source tree. This has traditionally been solved with setting S to the subdirectory in the source. However with the new pseudo changes, some python modules make changes to files beneath ${S}, for example: S =

Re: [OE-core][dunfell 00/47] Patch review - pseudo file mode corruption fix V2

2021-01-25 Thread Paul Barker
On Mon, 25 Jan 2021 at 14:51, Steve Sakoman wrote: > > Issues with undetected file mode corruption in pseudo have been identified. > > Fixes have been merged into master and gatesgarth over the past several > months and > things seem to have stabilized enough that we can consider backporting

[OE-core][dunfell 01/47] pseudo: Switch to oe-core branch in git repo

2021-01-25 Thread Steve Sakoman
From: Richard Purdie We have a significant number of outstanding patches to pseudo. Rather than queue these up as patches, create a branch in the upstream repo and use that until such times as we have someone with the time/skills to properly review these for master in the pseudo repo.

[OE-core][dunfell 00/47] Patch review - pseudo file mode corruption fix V2

2021-01-25 Thread Steve Sakoman
Issues with undetected file mode corruption in pseudo have been identified. Fixes have been merged into master and gatesgarth over the past several months and things seem to have stabilized enough that we can consider backporting these fixes to dunfell. This is a somewhat more invasive change

[OE-core][dunfell 04/47] pseudo: fix renaming to self

2021-01-25 Thread Steve Sakoman
From: Joe Slater Pseudo tests for an item being renamed to itself only after information about it has been deleted. Move the test to before we change the database. Note that pseudo does not support renameat2(), but neither does glibc. Signed-off-by: Joe Slater Signed-off-by: Richard Purdie

[OE-core][dunfell 07/47] pseudo: Abort on mismatch patch

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Rather than doing what turns out to be a rather dangerous "fixup" if we see a file with a different path but the same inode as another file we've previously seen, throw and abort. Direct the user to a wiki page where we can maintain information about what this error means.

[OE-core][dunfell 13/47] base/bitbake.conf: Enable pseudo path filtering

2021-01-25 Thread Steve Sakoman
From: Richard Purdie This is a pretty big change to the way pseudo operates when used in OpenEmbedded. Normally, pseudo monitors and logs (adds to its database) any file created or modified whilst in a fakeroot environment. There are large numbers of files we simply don't care about the

[OE-core][dunfell 14/47] wic: Fix permissions when using exclude or include path

2021-01-25 Thread Steve Sakoman
From: Ricardo Ribalda Delgado When parameters include_path or exclude_path are passed to the rootfs plugin, it will copy the partition content into a folder and make all the modifications there. This is done using copyhardlinktree(), which does not take into consideration the content of the

[OE-core][dunfell 12/47] bitbake.conf: Remove TERM from default BB_HASHBASE_WHITELIST

2021-01-25 Thread Steve Sakoman
From: Jacob Kroon Since BitBake commit 0d5cdd0c0d65f2f81c3af0f3767fee86c4142c3a TERM is no longer preserved in the environment by BitBake, so there should be no need to whitelist it by default. Signed-off-by: Jacob Kroon Signed-off-by: Richard Purdie (cherry picked from commit

[OE-core][dunfell 06/47] pseudo: Add support for ignoring paths from the pseudo DB

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Add PSEUDO_IGNORE_PATHS, a comma separated list of path prefixes, where any files underneath are not handled by pseudo. This allows files to be left out of the pseudo datanase where we know we don't need the fake root emulation. This is particularly useful if we know these

[OE-core][dunfell 03/47] pseudo: Update to add OFC fcntl lock updates

2021-01-25 Thread Steve Sakoman
From: Richard Purdie This adds in support for the OFC fcntl ioctl lock flags, removing warnings on some more recent linux kernels. Signed-off-by: Richard Purdie (cherry picked from commit 234168f803bee2e5b0955aabaddb1d967349fb82) Signed-off-by: Steve Sakoman ---

[OE-core][dunfell 02/47] pseudo: merge in fixes for setfacl issue

2021-01-25 Thread Steve Sakoman
From: Richard Purdie [YOCTO #13959] Signed-off-by: Richard Purdie (cherry picked from commit 18fbd28c9aa0276d110839c4282a9ab75fc9f28e) Signed-off-by: Steve Sakoman --- meta/recipes-devtools/pseudo/pseudo_git.bb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git

[OE-core][dunfell 08/47] psuedo: Add tracking of linked files for fds

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Where files are link()'d and one is unlink()'d, pseudo's fd mappings can become confused. Add a patch to try and improve this for the common usecases we see. Signed-off-by: Richard Purdie (cherry picked from commit 9ce621fa2099608ca0ccbb8420b31d71cdd7b00e) Signed-off-by:

[OE-core][dunfell 09/47] pseudo: Fix xattr segfault

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Fix a NULL pointer dereference exposed by the path ignore code in xattr handling. Signed-off-by: Richard Purdie (cherry picked from commit 929a27bf6cbca94d1141d2094ae0c915d93bd3f4) Signed-off-by: Steve Sakoman --- .../pseudo/files/xattr_fix.patch | 40

[OE-core][dunfell 05/47] pseudo: Ignore mismatched inodes from the db

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Currently, where pseudo finds a database entry for an inode but the path doesn't match, it reuses that database entry metadata. This is causing real world "corruption" of file attributes. See [YOCTO #14057] for an example of this. This can happen when files are deleted

[OE-core][dunfell 10/47] pseudo: Add may unlink patch

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Mark files which are unlinked (nlink == 0) but open with fd's as "may-unlink" to avoid problematic database entries. Signed-off-by: Richard Purdie (cherry picked from commit e1e481f3608c05ab14c61bf45cd0837d7287b6a5) Signed-off-by: Steve Sakoman ---

[OE-core][dunfell 15/47] wic: Fix multi images .wks with bitbake

2021-01-25 Thread Steve Sakoman
From: Ricardo Ribalda Delgado In order to support .wks files with multiple images inside bitbake we need to explicitly set the pseudo database in use. Eg: If we try this .mks: part / --source rootfs --ondisk sda --fstype=ext4 part /export --source rootfs --rootfs=core-image-minimal-mtdutils

[OE-core][dunfell 11/47] pseudo: Add pathfix patch

2021-01-25 Thread Steve Sakoman
From: Richard Purdie Add a path to fix up handling of dirfd being passed as a full file and with path="". Signed-off-by: Richard Purdie (cherry picked from commit 3006bbe7768e4efe33d3d2d3f5786a561ecbe96f) Signed-off-by: Steve Sakoman --- .../pseudo/files/pathfix.patch| 25

[OE-core][dunfell 16/47] wic: Avoid creating invalid pseudo directory

2021-01-25 Thread Steve Sakoman
From: Ricardo Ribalda Delgado If the source of the rootfs is not a bitbake cooked image, or it is not pointing to the root of one, we call pseudo again, which will produce a new pseudo folder at rootfs/../pseudo Eg: part /etc --source rootfs --rootfs-dir=${IMAGE_ROOTFS}/home --fstype=ext4 Cc:

[OE-core] [PATCH v2 2/2] recipetool: create: only add npmsw url if required

2021-01-25 Thread Kamel Bouhara
Before adding a npmsw fetcher to a recipe we should first check if the generated shrinkwrap file contains dependencies. [YOCTO #13901] Signed-off-by: Kamel Bouhara --- scripts/lib/recipetool/create_npm.py | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git

[OE-core] [PATCH v2 1/2] npm.bbclass: make shrinkwrap file optional

2021-01-25 Thread Kamel Bouhara
Some packages don't have shrinkwrap file which means no npmsw uri is provided in the recipe. [YOCTO #13901] Signed-off-by: Kamel Bouhara --- meta/classes/npm.bbclass | 31 +-- 1 file changed, 21 insertions(+), 10 deletions(-) diff --git a/meta/classes/npm.bbclass

Re: [OE-core] Question about security_flags.inc and CC_ARCH

2021-01-25 Thread Michael Ho
Hi, Thanks for the info/comments. It's clear that it wouldn't be wise to differ the SDK compiler flags from the bitbake flags. Maybe coming back to the original point, what would the recommended way be for developers in an SDK to create debug builds of their software? Should they attempt to

Re: [OE-core] [PATCH 5/5] sanity.bbclass: verify that user isn't building in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Peter Kjellerstedt
> -Original Message- > From: openembedded-core@lists.openembedded.org c...@lists.openembedded.org> On Behalf Of Quentin Schulz > Sent: den 25 januari 2021 10:22 > To: Dorinda > Cc: openembedded-core@lists.openembedded.org > Subject: Re: [OE-core] [PATCH 5/5] sanity.bbclass: verify that

Re: [OE-core][dunfell 00/47] Patch review - pseudo file mode corruption fix V2

2021-01-25 Thread Paul Barker
On Mon, 25 Jan 2021 at 16:25, Steve Sakoman wrote: > > On Mon, Jan 25, 2021 at 5:42 AM Paul Barker wrote: > > > > On Mon, 25 Jan 2021 at 14:51, Steve Sakoman wrote: > > > > > > Issues with undetected file mode corruption in pseudo have been > > > identified. > > > > > > Fixes have been merged

Re: [OE-core] [yocto-security] OE-core CVE metrics for master on Sun 24 Jan 2021 07:15:01 AM HST

2021-01-25 Thread Lee Chee Yang
for this case the new changes only consider 1.1.1 from both 1.1.1i and 1.1.1b , do not takes the trailing "i" and "b" when comparing them , so these 2 version are treated as same version ( 1.1.1 ) when comparing them. I expected this although knowing that compare version in this way can

[OE-core] World build doesn't include any recipes other than the core recipes

2021-01-25 Thread Meh Mbeh Ida Delphine
Hi Everyone, I added meta-oe, meta-python and meta-networking layers before running my world build but from my output I get, none of the recipes of these layers are included or taken into consideration. It's almost like they weren't added. Please what could be going on? Cheers, Ida.

[OE-core] [PATCH] core-image-sato-sdk-ptest: use 3G of RAM

2021-01-25 Thread Changqing Li
[YOCTO #14164] Some ptest cases, for example, libinput ptest intermittent failure on arm64, this should caused by OOM Killer. Signed-off-by: Changqing Li --- meta/recipes-sato/images/core-image-sato-sdk-ptest.bb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git

[OE-core] [PATCH] timezone: upgrade to 2021a

2021-01-25 Thread Ovidiu Panait
Release 2021a - 2021-01-24 10:54:57 -0800 Changes to future timestamps South Sudan changes from +03 to +02 on 2021-02-01 at 00:00. (Thanks to Steffen Thorsen.) Signed-off-by: Ovidiu Panait --- meta/recipes-extended/timezone/timezone.inc | 6 +++--- 1 file changed, 3 insertions(+), 3

Re: [OE-core] [PATCH 1/2] python3-docutils: Fix bug of program rst2man cannot be found.

2021-01-25 Thread Alexander Kanavin
Please always check first if issue has been fixed upstream and needs to be backported: https://gitlab.freedesktop.org/mesa/drm/-/commit/62b9a3eee9bdaafa766e92d5bebeb4e59845c45a Alex On Mon, 25 Jan 2021 at 09:43, Alexander Kanavin via lists.openembedded.org wrote: > Wait, you need to provide a

Re: [OE-core] [PATCH 3/5] elfutils: add support for ipkg

2021-01-25 Thread Quentin Schulz
Hi Dorinda, On Sun, Jan 24, 2021 at 02:55:57PM +0100, Dorinda wrote: > debuginfod scanner 0.181 could only support RPM and scan .debs, it can now > scan .ipk > Typo here? The recipe version is 0.182 not 0.181. > Signed-off-by: Dorinda Bassey > --- > .../elfutils/elfutils_0.182.bb

Re: [OE-core] [PATCH 1/2] python3-docutils: Fix bug of program rst2man cannot be found.

2021-01-25 Thread Alexander Kanavin
Wait, you need to provide a better explanation. Where does this issue happen? And why isn't it fixed upstream? Alex On Mon, 25 Jan 2021 at 03:20, Wang Mingyu wrote: > Signed-off-by: Wang Mingyu > --- > .../python/python3-docutils_0.16.bb | 15 +++ > 1 file changed,

Re: [OE-core] [PATCH 1/5] elfutils: split libdebuginfod into its own package

2021-01-25 Thread Quentin Schulz
Hi Dorinda, On Sun, Jan 24, 2021 at 02:55:55PM +0100, Dorinda wrote: > add package options for libdebuginfod > > Signed-off-by: Dorinda Bassey > --- > meta/recipes-devtools/elfutils/elfutils_0.182.bb | 6 -- > 1 file changed, 4 insertions(+), 2 deletions(-) > > diff --git

Re: [OE-core] [PATCH 4/5] sanity.bbclass: sanity check for bitbake in PATH

2021-01-25 Thread Quentin Schulz
Hi Dorinda, On Sun, Jan 24, 2021 at 02:55:58PM +0100, Dorinda wrote: > added a sanity check to verify if bitbake is present in PATH > > Fixes: https://bugzilla.yoctoproject.org/show_bug.cgi?id=13822# > I think the convention is: [YOCTO #13822] c.f.:

Re: [OE-core] [yocto] QA notification for completed autobuilder build (yocto-3.3_M2.rc1)

2021-01-25 Thread Sangeeta Jain
Hi all, Intel and WR YP QA is planning for QA execution for YP build yocto-3.3_M2.rc1. We are planning to execute following tests for this cycle: OEQA-manual tests for following module: 1. OE-Core 2. BSP-hw Runtime auto test for following platforms: 1. MinnowTurbot 32-bit 2. Coffee Lake 3. NUC

Re: [OE-core] [PATCH] wayland: upgrade 1.18.0 -> 1.18.92

2021-01-25 Thread Alexander Kanavin
1.18.92 is a pre-release, which should be obvious from the version number. Alex On Mon, 25 Jan 2021 at 02:16, Wang Mingyu wrote: > 0001-meson-tests-add-missing-dependencies-on-protocol-hea.patch > removed since it is included in 1.18.92 > > refresh the following patches: >

Re: [OE-core] [PATCH 5/5] sanity.bbclass: verify that user isn't building in PSEUDO_IGNORE_PATHS

2021-01-25 Thread Quentin Schulz
Hi Dorinda, On Sun, Jan 24, 2021 at 02:55:59PM +0100, Dorinda wrote: > added a check to ensure that a user isn't building in PSEUDO_IGNORE_PATHS > Missing [YOCTO #14179] tag I think :) > Signed-off-by: Dorinda Bassey > --- > meta/classes/sanity.bbclass | 7 +++ > 1 file changed, 7

Re: [OE-core] [AUH] llvm: upgrading to 11.0.1 FAILED

2021-01-25 Thread Alexander Kanavin
Khem, can you get this in please? Alex On Fri, 15 Jan 2021 at 13:31, wrote: > Hello, > > this email is a notification from the Auto Upgrade Helper > that the automatic attempt to upgrade the recipe *llvm* to *11.0.1* has > Failed (devtool error). > > Detailed error information: > > The

Re: [OE-core] [PATCH 2/2] libdrm: upgrade 2.4.103 -> 2.4.104

2021-01-25 Thread Richard Purdie
On Mon, 2021-01-25 at 10:20 +0800, Wang Mingyu wrote: > Signed-off-by: Wang Mingyu > --- >  .../drm/{libdrm_2.4.103.bb => libdrm_2.4.104.bb} | 4 ++-- >  1 file changed, 2 insertions(+), 2 deletions(-) >  rename meta/recipes-graphics/drm/{libdrm_2.4.103.bb => libdrm_2.4.104.bb} >