Re: [yocto] NPM support on Dunfell

[Joel Winarske]

The takeaways using inherit npm:

1. Does not support 'scoped packages'

2. fetching is not multi-threaded.  A NPM based recipe will run uni-proc
with a considerable amount of overhead; each package is pulled and cached
independently.  Whereas "npm install" or "npm ci" runs multi-threaded.

For my use case I used base.bbclass, and implemented it all manually.  The
downside with this approach is there is no long term support via DL_DIR.

A reference for others that might hit this:
https://github.com/meta-webthings/meta-webthings/blob/dunfell/recipes/webthings-gateway/webthings-gateway_git.bb

Cheers,
Joel


On Mon, Apr 11, 2022 at 7:18 PM Joel Winarske 
wrote:

> I'm seeing some gaps and performance issues.
>
> Examples:
> 1. Setting NPM_INSTALL_DEV = "1" I am rewarded with:
>
> 169
> npm
> ERR! Could not install from
> "../../__w/meta-flutter/rpi4-drm-dunfell-latest/raspberrypi4-64/tmp/work/aarch64-poky-linux/webthings-gateway/1.0.0+gitAUTOINC+4c600fc973-r0/git/node_modules/@babel/compat-data"
> as it does not contain a package.json file.
> 170
> 
>
> The upstream build uses equivalent to:
> npm --user root --cache "${NPM_CACHE}" ci
> ./node_modules/.bin/webpack
> npm --cache "${NPM_CACHE}" prune --production
>
> 2. Running npm_do_configure is taking 48+ minutes.  Granted it's a large
> project, but basically the configure task is running uni-proc.
>
> Who is the POC supporting NPM on Dunfell?
>
> Thanks,
> Joel
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#56804): https://lists.yoctoproject.org/g/yocto/message/56804
Mute This Topic: https://lists.yoctoproject.org/mt/90410752/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[yocto] M+ & H bugs with Milestone Movements WW16

[Stephen Jolley]

All,

YP M+ or high bugs which moved to a new milestone in WW16 are listed below: 


Priority

Bug ID

Short Description

Changer

Owner

Was

Became


Medium+

  12279

enhance manifest not found warning

randy.macl...@windriver.com

kai.k...@windriver.com

3.5 M4

3.6 M1


 

  12368

persistent bitbake server does not re-parse if previous build was ctrl+C'd

richard.pur...@linuxfoundation.org

richard.pur...@linuxfoundation.org

3.5 M4

3.6 M1


 

  13123

package.PackageTests.test_gdb_hardlink_debug failed

randy.macl...@windriver.com

randy.macl...@windriver.com

3.5 M4

3.6 M1


 

  13278

If git protocol doesn't work, you get a tar.gz clone from PREMIRROR which has 
git protocol origin

richard.pur...@linuxfoundation.org

richard.pur...@linuxfoundation.org

3.5 M4

3.6 M1


 

  13311

xargs: fdleak.c:396: complain_about_leaky_fds: Assertion `no_leaks' failed.

randy.macl...@windriver.com

unassig...@yoctoproject.org

3.5 M4

3.6 M2


 

  13417

Development manual coverage of devtool

randy.macl...@windriver.com

michael.opdenac...@bootlin.com

3.6

3.6 M1


 

  13424

devupstream doesn't work with mutilib

richard.pur...@linuxfoundation.org

richard.pur...@linuxfoundation.org

3.5 M4

3.6 M1


 

  13520

many valgrind tests fail for arm64

randy.macl...@windriver.com

randy.macl...@windriver.com

3.5 M4

3.6 M1


 

  13599

Enhancement: Detect variables that shouldn't be defined in image scope, but in 
global (distro) scope

richard.pur...@linuxfoundation.org

richard.pur...@linuxfoundation.org

3.5 M4

3.6 M1


 

  13908

segfault in mb-wm on qemux86-64 intermittently

randy.macl...@windriver.com

r...@burtonini.com

3.5 M4

3.6 M2


 

  14118

systemd services not enabled when using package feed

randy.macl...@windriver.com

unassig...@yoctoproject.org

3.5 M4

3.6 M2


 

  14126

resolvconf incompatible with busybox flock

randy.macl...@windriver.com

newco...@yoctoproject.org

3.5 M4

3.6 M1


 

  14156

fetch/gitsm: submodules are fetched as mirrored and not working as expected

richard.pur...@linuxfoundation.org

richard.pur...@linuxfoundation.org

3.5 M4

3.6 M1


 

  14201

Bitbake server intermittent timeout

randy.macl...@windriver.com

unassig...@yoctoproject.org

3.5 M4

3.6 M1


 

  14263

AB-INT PTEST: lttng-tools ptest intermittent failure

randy.macl...@windriver.com

unassig...@yoctoproject.org

3.5 M4

3.6 M1


 

  14316

Write a script to populate swatbot from buildbot

randy.macl...@windriver.com

alexandre.bell...@bootlin.com

3.6

3.6 M1


 

  14368

Where can I find how to produce containers?

randy.macl...@windriver.com

michael.opdenac...@bootlin.com

3.6

3.6 M2


 

  14385

mode of sstate files created under pseudo

richard.pur...@linuxfoundation.org

richard.pur...@linuxfoundation.org

3.5 M4

3.6 M1


 

  14410

[documentation] clarity regarding specifying license of layer/recipes versus 
layer/recipe results

randy.macl...@windriver.com

michael.opdenac...@bootlin.com

3.6

3.6 M1


 

  14486

qemu rootfs copy is taking too much time

randy.macl...@windriver.com

randy.macl...@windriver.com

3.5 M4

3.6 M1


 

  14493

BB_GIT_SHALLOW is not documented

randy.macl...@windriver.com

michael.opdenac...@bootlin.com

3.6

3.6 M1


 

  14509

Add security configuration documentation

randy.macl...@windriver.com

michael.opdenac...@bootlin.com

3.6

3.6 M2


 

  14523

oe-pkgdata-util list-pkg-files doesn't ignore target-sdk-provides-dummy.bb

randy.macl...@windriver.com

randy.macl...@windriver.com

3.5 M4

3.6 M1


 

  14536

Dev Manual, "Selecting an Initialization Manager", should mention INIT_MANAGER

[yocto] Enhancements/Bugs closed WW16

[Stephen Jolley]

All,

The below were the owners of enhancements or bugs closed during the last
week!


Who

Count


richard.pur...@linuxfoundation.org

15


randy.macl...@windriver.com

8


alexandre.bell...@bootlin.com

2


tim.orl...@konsulko.com

1


gregorylu...@microsoft.com

1


matthias.schoep...@googlemail.com

1


jay.shen.t...@intel.com

1


Grand Total

29

Thanks,

 

Stephen K. Jolley

Yocto Project Program Manager

*Cell:(208) 244-4460

* Email:  sjolley.yp...@gmail.com
 

 


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#56802): https://lists.yoctoproject.org/g/yocto/message/56802
Mute This Topic: https://lists.yoctoproject.org/mt/90547643/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[yocto] Current high bug count owners for Yocto Project 3.5

[Stephen Jolley]

All,

Below is the list as of top 30 bug owners as of the end of WW16 of who have
open medium or higher bugs and enhancements against YP 3.5.   There are 8
possible work days left until the final release candidates for YP 3.5 needs
to be released.


Who

Count


r...@burtonini.com

21


david.re...@windriver.com

11


bluelightn...@bluelightning.org

6


randy.macl...@windriver.com

5


mhalst...@linuxfoundation.org

4


chee.yang@intel.com

4


sakib.sa...@windriver.com

4


hongxu@windriver.com

3


jpewhac...@gmail.com

3


saul.w...@windriver.com

2


ms...@mvista.com

2


akuster...@gmail.com

2


tim.orl...@konsulko.com

1


yi.z...@windriver.com

1


aeh...@gmail.com

1


mark.ha...@kernel.crashing.org

1


pgowda@gmail.com

1


abongwabonal...@gmail.com

1


pokyli...@reliableembeddedsystems.com

1


qi.c...@windriver.com

1


bruce.ashfi...@gmail.com

1


alejan...@enedino.org

1


thomas.per...@bootlin.com

1


open.sou...@oleksandr-kravchuk.com

1


ticot...@gmail.com

1


raj.k...@gmail.com

1


sundeep.kokko...@gmail.com

1


nicolas.deche...@linaro.org

1


jon.ma...@arm.com

1


mostthings...@gmail.com

1


Grand Total

85

Thanks,

 

Stephen K. Jolley

Yocto Project Program Manager

*Cell:(208) 244-4460

* Email:  sjolley.yp...@gmail.com
 

 


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#56801): https://lists.yoctoproject.org/g/yocto/message/56801
Mute This Topic: https://lists.yoctoproject.org/mt/90547458/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[yocto] Yocto Project Newcomer & Unassigned Bugs - Help Needed

[Stephen Jolley]

All,

 

The triage team is starting to try and collect up and classify bugs which a
newcomer to the project would be able to work on in a way which means people
can find them. They're being listed on the triage page under the appropriate
heading:

https://wiki.yoctoproject.org/wiki/Bug_Triage#Newcomer_Bugs  Also please
review:
https://www.openembedded.org/wiki/How_to_submit_a_patch_to_OpenEmbedded and
how to create a bugzilla account at:

https://bugzilla.yoctoproject.org/createaccount.cgi

The idea is these bugs should be straight forward for a person to help work
on who doesn't have deep experience with the project.  If anyone can help,
please take ownership of the bug and send patches!  If anyone needs
help/advice there are people on irc who can likely do so, or some of the
more experienced contributors will likely be happy to help too.

 

Also, the triage team meets weekly and does its best to handle the bugs
reported into the Bugzilla. The number of people attending that meeting has
fallen, as have the number of people available to help fix bugs. One of the
things we hear users report is they don't know how to help. We (the triage
team) are therefore going to start reporting out the currently 409
unassigned or newcomer bugs.

 

We're hoping people may be able to spare some time now and again to help out
with these.  Bugs are split into two types, "true bugs" where things don't
work as they should and "enhancements" which are features we'd want to add
to the system.  There are also roughly four different "priority" classes
right now,  "3.5, "3.6", "3.99" and "Future", the more pressing/urgent
issues being in "3.5" and then "3.6".

 

Please review this link and if a bug is something you would be able to help
with either take ownership of the bug, or send me (sjolley.yp...@gmail.com
 ) an e-mail with the bug number you would
like and I will assign it to you (please make sure you have a Bugzilla
account).  The list is at:
https://wiki.yoctoproject.org/wiki/Bug_Triage_Archive#Unassigned_or_Newcomer
_Bugs

 

Thanks,

 

Stephen K. Jolley

Yocto Project Program Manager

*Cell:(208) 244-4460

* Email:  sjolley.yp...@gmail.com
 

 


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#56800): https://lists.yoctoproject.org/g/yocto/message/56800
Mute This Topic: https://lists.yoctoproject.org/mt/90547324/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [yocto] [PATCH yocto-autobuilder-helper v4] Add a banner on the old documentation docs

[Abongwa Amahnui Bonalais]

I sent a more recent patch which takes care of the topmost element overlapping 
with the banner, puting it in a div called body and pushing it down so the 
banner remains on top.

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#56799): https://lists.yoctoproject.org/g/yocto/message/56799
Mute This Topic: https://lists.yoctoproject.org/mt/90519600/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[linux-yocto][v5.15/standard/base][PATCH] netfilter: conntrack: avoid useless indirection during conntrack destruction

[He Zhe]

From: Florian Westphal 

nf_ct_put() results in a usesless indirection:

nf_ct_put -> nf_conntrack_put -> nf_conntrack_destroy -> rcu readlock +
indirect call of ct_hooks->destroy().

There are two _put helpers:
nf_ct_put and nf_conntrack_put.  The latter is what should be used in
code that MUST NOT cause a linker dependency on the conntrack module
(e.g. calls from core network stack).

Everyone else should call nf_ct_put() instead.

A followup patch will convert a few nf_conntrack_put() calls to
nf_ct_put(), in particular from modules that already have a conntrack
dependency such as act_ct or even nf_conntrack itself.

Signed-off-by: Florian Westphal 
Signed-off-by: Pablo Neira Ayuso 

Backport
6ae7989c9af0 ("netfilter: conntrack: avoid useless indirection during")
which is not going to stable tree from mainline to fix the following warning,
with some necessary context tweaks.

root@intel-x86-64:~# ovs-vsctl add-br br0
device ovs-system entered promiscuous mode
[ cut here ]
WARNING: CPU: 2 PID: 711 at include/net/netfilter/nf_conntrack.h:175 
__ovs_ct_lookup+0x819/0x920 [openvswitch]
CPU: 2 PID: 711 Comm: ovs-vswitchd Not tainted 5.15.33-rt34-yocto-preempt-rt #1
Hardware name: Intel(R) Client Systems NUC7i5DNKE/NUC7i5DNB, BIOS 
DNKBLi5v.86A.0064.2019.0523.1933 05/23/2019
RIP: 0010:__ovs_ct_lookup+0x819/0x920 [openvswitch]
Code: b8 fe ff ff ff e9 69 f9 ff ff 41 0f b7 84 24 b0 00 00 00 49 8b 94 24 c0 
00 00 00 0f b6 1c 02 83 e3 0f c1 e3 02 e9 c5 fc ff ff <0f> 0b e9 86 f8 ff ff 4c 
89 f7 44 89 95 40 ff ff ff e8 61 30 fc ff
RSP: 0018:914c80a77638 EFLAGS: 00010246
RAX:  RBX: 903b139fa528 RCX: 
RDX: 0002 RSI: 914c80a77660 RDI: 
RBP: 914c80a77710 R08: 903b04819128 R09: aa605c40
R10: 914c80a779c0 R11:  R12: 903b05dd7000
R13: 0001 R14: 903b0a603c00 R15: 903b04819120
FS:  7f9256c9ba80() GS:903c65d0() knlGS:
CS:  0010 DS:  ES:  CR0: 80050033
CR2: 7ffe2fad9008 CR3: 00010a5e0002 CR4: 003706e0
DR0:  DR1:  DR2: 
DR3:  DR6: fffe0ff0 DR7: 0400
Call Trace:
 
 ? nf_ct_get_tuple+0x144/0x1f0 [nf_conntrack]
 ? nf_ct_get_tuplepr+0x5f/0x90 [nf_conntrack]
 ovs_ct_execute+0x3e1/0x5e0 [openvswitch]
 do_execute_actions+0xed/0x1ab0 [openvswitch]
 ? ovs_ct_copy_action+0x17b/0x8a0 [openvswitch]
 ? __ovs_nla_copy_actions+0x884/0xf30 [openvswitch]
 ? migrate_enable+0xd3/0x150
 ovs_execute_actions+0x62/0x140 [openvswitch]
 ? ovs_execute_actions+0x62/0x140 [openvswitch]
 ovs_packet_cmd_execute+0x294/0x310 [openvswitch]
 genl_family_rcv_msg_doit+0xe6/0x140
 genl_rcv_msg+0xde/0x1d0
 ? ovs_vport_cmd_del+0x200/0x200 [openvswitch]
 ? genl_get_cmd+0xd0/0xd0
 netlink_rcv_skb+0x55/0x100
 genl_rcv+0x29/0x40
 netlink_unicast+0x234/0x340
 netlink_sendmsg+0x226/0x470
 ? netlink_unicast+0x340/0x340
 sys_sendmsg+0x273/0x2b0
 ? sendmsg_copy_msghdr+0x7b/0xa0
 ___sys_sendmsg+0x81/0xc0
 ? do_futex+0x1c4/0xb70
 ? rt_spin_unlock+0x18/0x40
 ? __fget_light+0xa3/0x120
 __sys_sendmsg+0x62/0xb0
 ? fpregs_assert_state_consistent+0x27/0x50
 __x64_sys_sendmsg+0x1d/0x20
 do_syscall_64+0x43/0x90
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7f9256dab82d
Code: 28 89 54 24 1c 48 89 74 24 10 89 7c 24 08 e8 1a 97 f7 ff 8b 54 24 1c 48 
8b 74 24 10 41 89 c0 8b 7c 24 08 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 33 
44 89 c7 48 89 44 24 08 e8 5e 97 f7 ff 48
RSP: 002b:7ffe2fae90a0 EFLAGS: 0293 ORIG_RAX: 002e
RAX: ffda RBX: 0001 RCX: 7f9256dab82d
RDX:  RSI: 7ffe2fae9130 RDI: 0011
RBP: 7ffe2fae9f30 R08:  R09: 0001
R10: 0006 R11: 0293 R12: 55fab0216e90
R13:  R14: 55fab0216e90 R15: 7ffe2fae9130
 
---[ end trace 0002 ]---

Signed-off-by: He Zhe 
---
 include/linux/netfilter/nf_conntrack_common.h |  2 ++
 include/net/netfilter/nf_conntrack.h  |  8 ++--
 net/netfilter/nf_conntrack_core.c | 12 ++--
 3 files changed, 14 insertions(+), 8 deletions(-)

diff --git a/include/linux/netfilter/nf_conntrack_common.h 
b/include/linux/netfilter/nf_conntrack_common.h
index 700ea077ce2d..a0a587ffa021 100644
--- a/include/linux/netfilter/nf_conntrack_common.h
+++ b/include/linux/netfilter/nf_conntrack_common.h
@@ -29,6 +29,8 @@ struct nf_conntrack {
 };
 
 void nf_conntrack_destroy(struct nf_conntrack *nfct);
+
+/* like nf_ct_put, but without module dependency on nf_conntrack */
 static inline void nf_conntrack_put(struct nf_conntrack *nfct)
 {
if (nfct && atomic_dec_and_test(>use))
diff --git a/include/net/netfilter/nf_conntrack.h 
b/include/net/netfilter/nf_conntrack.h
index d24b0a34c8f0..8fc256af3df2 100644
--- a/include/net/netfilter/nf_conntrack.h
+++ 

[yocto] openjdk-11 failed to find --with-boot-jdk

[Bel Hadj Salem Talel]

Hello Everyone,

I am using meta-java, and I have openjdk-11 recipe.

The recipe has:

EXTRA_OECONF_append_class-native = "\
--with-boot-jdk=/usr/lib/jvm/openjdk-11-amd64 \
--enable-headless-only \
--enable-openjdk-only \
"

It fails with this error:

> 
> configure: error: The path given by --with-boot-jdk does not contain a
> valid Boot JDK

I tried to install openjdk-11 on my native build host, but the same error 
persists.

How can I fix this ?

Thanks,
Talel

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#56798): https://lists.yoctoproject.org/g/yocto/message/56798
Mute This Topic: https://lists.yoctoproject.org/mt/90535650/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-