[OE-core] [PATCH 3/4] selftest/recipetool: Add tests for branch parameter and srcbranch option

2021-12-06 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier The recipetool support two ways to pass a branch and fallback to master if no branch is defined. Add tests for default branch, branch parameter and srcbranch option. Signed-off-by: Stefan Herbrechtsmeier --- This commit changes the test repository from matchbox

[OE-core] [PATCH 2/4] selftest/recipetool: Split tests into separate test classes

2021-12-06 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Split tests into separate test classes to speed up individual test runs by reducing the test setup to a minimum. The pkgdata generation is only needed for the append tests and slow down the other tests. Signed-off-by: Stefan Herbrechtsmeier --- meta/lib/oeqa

[OE-core] [PATCH 1/4] recipetool: Set master branch only as fallback

2021-12-06 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier The commit 'meta/scripts: Manual git url branch additions (dc53fe75cc)' sets the branch= parameter too early to master and thereby breaks the -B/--srcbranch option. ERROR: branch= parameter and -B/--srcbranch option cannot both be specified - use one or the other

Re: [OE-core] [RFC PATCH 05/15] bitbake: fetch2: Support archives with missing search directory mode

2021-11-25 Thread Stefan Herbrechtsmeier
Am 24.11.2021 um 18:54 schrieb Richard Purdie: On Wed, 2021-11-24 at 18:11 +0100, Stefan Herbrechtsmeier wrote: Am 24.11.2021 um 16:17 schrieb Alexander Kanavin: [snip] Is such an influencing change acceptable or should I move the change to the npm class? We don't want to support

Re: [OE-core] [RFC PATCH 05/15] bitbake: fetch2: Support archives with missing search directory mode

2021-11-24 Thread Stefan Herbrechtsmeier
Am 24.11.2021 um 18:14 schrieb Alexander Kanavin: On Wed, 24 Nov 2021 at 18:11, Stefan Herbrechtsmeier <mailto:stefan.herbrechtsmeier-...@weidmueller.com>> wrote: > and shouldn't the tarball be fixed instead? How should we fix a tarball from npmjs.com <h

Re: [OE-core] [RFC PATCH 05/15] bitbake: fetch2: Support archives with missing search directory mode

2021-11-24 Thread Stefan Herbrechtsmeier
denied and shouldn't the tarball be fixed instead? How should we fix a tarball from npmjs.com? Is such an influencing change acceptable or should I move the change to the npm class? On Wed, 24 Nov 2021 at 15:48, Stefan Herbrechtsmeier <mailto:stefan.herbrechtsmeier-...@weidmueller.

Re: [OE-core] [RFC PATCH 14/15] node-red: Add version 2.1.3

2021-11-24 Thread Stefan Herbrechtsmeier
Am 24.11.2021 um 16:36 schrieb Alexander Kanavin: I do not think adding the recipe to oe-core like this is quite right, and the same holds for patch 15. It's not buildable (as oe-core lacks nodejs), it doesn't seem to meet the criteria for core inclusion, and generally before we add generated

Re: [OE-core] [RFC PATCH 15/15] node-red: Add git version

2021-11-24 Thread Stefan Herbrechtsmeier
Am 24.11.2021 um 15:58 schrieb Konrad Weihmann: On 24.11.21 15:47, Stefan Herbrechtsmeier wrote: From: Stefan Herbrechtsmeier Created via recipetool:    devtool add --npm-dev node-red-src https://github.com/node-red/node-red.git Requires openssh-native as DEPENDS to pass all unit tests

[OE-core] [RFC PATCH 14/15] node-red: Add version 2.1.3

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Created via recipetool: devtool add --npm-dev node-red https://registry.npmjs.org/node-red/-/node-red-2.1.3.tgz Signed-off-by: Stefan Herbrechtsmeier --- .../node-red/node-red_2.1.3.bb| 908 ++ 1 file changed, 908 insertions

[OE-core] [RFC PATCH 13/15] npm_build: Enable OpenSSL 3.0 legacy provider

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier The OpenSSL legacy provider supplies OpenSSL implementations of algorithms that have been deemed legacy. Node.js v16 use OpenSSL 1.1.0 by default and support legacy algorithms (example: md4 for webpack). This patch depends on a backport of [1] for nodejs. [1

[OE-core] [RFC PATCH 12/15] recipetool: npm: Add dependencies to SRC_URI and auto select classes

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create_npm.py | 243 --- 1 file changed, 222 insertions(+), 21 deletions(-) diff --git a/scripts/lib/recipetool/create_npm.py b/scripts/lib/recipetool/create_npm.py index

[OE-core] [RFC PATCH 08/15] npm_build_dist: add class to build npm package and install its dist folder

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/npm_build_dist.bbclass | 31 + 1 file changed, 31 insertions(+) create mode 100644 meta/classes/npm_build_dist.bbclass diff --git a/meta/classes/npm_build_dist.bbclass b/meta

[OE-core] [RFC PATCH 05/15] bitbake: fetch2: Support archives with missing search directory mode

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- bitbake/lib/bb/fetch2/__init__.py | 1 + 1 file changed, 1 insertion(+) diff --git a/bitbake/lib/bb/fetch2/__init__.py b/bitbake/lib/bb/fetch2/__init__.py index 05b2d2e924..8ad4e3a5ec 100644 --- a/bitbake/lib/bb/fetch2

[OE-core] [RFC PATCH 10/15] karma: add class to execute JavaScript code in real browsers

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/karma.bbclass | 18 ++ 1 file changed, 18 insertions(+) create mode 100644 meta/classes/karma.bbclass diff --git a/meta/classes/karma.bbclass b/meta/classes/karma.bbclass new file mode 100644

[OE-core] [RFC PATCH 09/15] npm_test: add class to test an npm package

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/npm_test.bbclass | 29 + 1 file changed, 29 insertions(+) create mode 100644 meta/classes/npm_test.bbclass diff --git a/meta/classes/npm_test.bbclass b/meta/classes

[OE-core] [RFC PATCH 04/15] bitbake: fetch2: Add striplevel support to unpack

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Add striplevel support to unpack tar archives into specified sub directories. The node package manager (npm) need this feature to unpack packages into its node_modules directory. Signed-off-by: Stefan Herbrechtsmeier --- bitbake/lib/bb/fetch2/__init__.py | 3

[OE-core] [RFC PATCH 11/15] angular: Add support for angular projects

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/angular.bbclass | 30 ++ 1 file changed, 30 insertions(+) create mode 100644 meta/classes/angular.bbclass diff --git a/meta/classes/angular.bbclass b/meta/classes/angular.bbclass

[OE-core] [RFC PATCH 03/15] externalsrc: Remove subsequent slash from B

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/externalsrc.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/classes/externalsrc.bbclass b/meta/classes/externalsrc.bbclass index abfe24bace..959f2d7bc3 100644 --- a/meta

[OE-core] [RFC PATCH 07/15] npm_build: add class to build and install an npm package and its dependencies

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/npm_build.bbclass | 77 ++ 1 file changed, 77 insertions(+) create mode 100644 meta/classes/npm_build.bbclass diff --git a/meta/classes/npm_build.bbclass b/meta/classes

[OE-core] [RFC PATCH 02/15] recipetool: Skip hbs extension in guess license

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index b6c4564761..d41653e7ce 100644 --- a/scripts/lib

[OE-core] [RFC PATCH 06/15] npm: Rework to use plain npm commands and avoid npm cache

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Rework the npm class to use plain npm commands and remove the usage of the npm cache to speed-up builds. Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/npm.bbclass| 340 +++- scripts/lib/devtool/standard.py | 6 +- 2

[OE-core] [RFC PATCH 01/15] openssh: Extend to provide native recipe

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/recipes-connectivity/openssh/openssh_8.8p1.bb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-connectivity/openssh/openssh_8.8p1.bb b/meta/recipes-connectivity/openssh/openssh_8.8p1

[OE-core] [RFC PATCH 00/15] Rework npm support

2021-11-24 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier This patch series rework the npm support. It contains bitbake patches and sample recipes to simplify the discussion. The series is a work in progress. Changes: * Remove the npm-shrinkwrap.json from the npm recipes and replace it with direct download urls

[OE-core] Recommended structure of npm recipes

2021-11-18 Thread Stefan Herbrechtsmeier
Hi, I would like to get some opinions from the OE experts regarding the recommended structure of npm recipes. I have test different solutions but need some advice. npm could be used to build a web browser application or a Node.js application: 1) A build of a *web browser application* with

Re: [OE-core] [PATCH 2/2] npm: Remove unnecessary configs argument from npm run command

2021-10-20 Thread Stefan Herbrechtsmeier
] https://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/meta/classes/npm.bbclass?id=fe87ab0a6a6f0c3d3fef4dd24a526dca3f9bde23 On 20.10.21 09:40, Stefan Herbrechtsmeier wrote: From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier ---   meta/classes/npm.bbclass | 2 +-   1 file

[OE-core] [PATCH 2/2] npm: Remove unnecessary configs argument from npm run command

2021-10-20 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/npm.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/classes/npm.bbclass b/meta/classes/npm.bbclass index 547c531883..ba50fcac20 100644 --- a/meta/classes/npm.bbclass +++ b/meta

[OE-core] [PATCH 1/2] recipetool: Simplify common source files skip in guess_license

2021-10-20 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 3b58d6fa82..5a267fb57c 100644 --- a/scripts

Re: [OE-core] Improve npm support to run build scripts

2021-10-19 Thread Stefan Herbrechtsmeier
Hi, Am 06.10.2021 um 11:47 schrieb Alexander Kanavin: The OE landscape is littered with unmaintained or barely maintained layers. By the looks of things, no one wants to maintain this proposed meta-nodejs layer either, which involves thousands of recipes, (so far) non-existent tooling to

Re: [OE-core] [PATCH 03/12] recipetool: Skip common source files in guess_license

2021-10-12 Thread Stefan Herbrechtsmeier
Hi Richard, Am 08.10.2021 um 14:26 schrieb Richard Purdie: On Fri, 2021-10-08 at 09:45 +0200, Konrad Weihmann wrote: On 08.10.21 09:42, Stefan Herbrechtsmeier wrote: From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool

Re: [OE-core] [PATCH 03/12] recipetool: Skip common source files in guess_license

2021-10-08 Thread Stefan Herbrechtsmeier
Am 08.10.2021 um 09:45 schrieb Konrad Weihmann: On 08.10.21 09:42, Stefan Herbrechtsmeier wrote: From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1)   scripts/lib/recipetool/create.py | 2 ++   1 file changed, 2 insertions(+) diff --git

[OE-core] [PATCH v2 12/12] recipetool: Rework crunch_license to recognize more variants

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 121 +-- 1 file changed, 97 insertions(+), 24 deletions(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool

[OE-core] [PATCH v2 11/12] npm: Use configs for npm environment and args for npm run command

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Use parameter configs of class NpmEnvironment and parameter args of function run to support a common npmrc for all run calls of a single NpmEnvironment. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) meta/classes/npm.bbclass | 14

[OE-core] [PATCH v2 08/12] recipetool: npm: Do not add package.json files to LIC_FILES_CHKSUM

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier The package.json files doesn't contain any licenses. The name of the license doesn't comply the license requirements of most liceneses. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create_npm.py | 10 -- 1 file

[OE-core] [PATCH v2 07/12] recipetool: Add support for linenumbers to licenses.csv

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Add support for linenumbers (begin and end lines) to licenses.csv. Add an optional linenumbers parameter to get_license_md5sums to support different use cases. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 12

[OE-core] [PATCH v2 03/12] recipetool: Skip common source files in guess_license

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 2 ++ 1 file changed, 2 insertions(+) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index e88a4253da..83cf25d9b7 100644

[OE-core] [PATCH v2 10/12] npm: Add variable NPM_NODEDIR with default value

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Replace the variable NPM_NODEDIR fallback to a default value inside the code with a variable NPM_NODEDIR with default value. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) meta/classes/npm.bbclass | 8 +++- 1 file changed, 3 insertions(+), 5

[OE-core] [PATCH v2 06/12] recipetool: Add logger info for missing license entries

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 3 +++ 1 file changed, 3 insertions(+) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 87b25ebc7e..a8c4cdef4a 100644

[OE-core] [PATCH v2 05/12] recipetool: ignore empty license files

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 893980a5ce

[OE-core] [PATCH v2 09/12] recipetool: npm: Use README as license fallback

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Use the README as license fallback if a license file is missing. Use the linenumbers parameter of get_license_md5sums function to determine the license text inside the README. Signed-off-by: Stefan Herbrechtsmeier --- Changes in v2: - Rework to add licenses

[OE-core] [PATCH v2 04/12] recipetool: Change default paramter fallback_licenses of function split_pkg_licenses from None to []

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 83cf25d9b7..893980a5ce

[OE-core] [PATCH v2 02/12] recipetool: Move license md5sums into CSV files

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py| 52 + scripts/lib/recipetool/licenses.csv | 37 2 files changed, 52 insertions(+), 37 deletions(-) create mode

[OE-core] [PATCH v2 01/12] npm: Add support for EXTRA_OENPM arguments

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Add support for EXTRA_OENPM arguments to set node-gyp variables for example. This allows use of shared librariess, avoid download of external sources or build from source. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) meta/classes/npm.bbclass

[OE-core] [PATCH 11/12] npm: Use configs for npm environment and args for npm run command

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Use parameter configs of class NpmEnvironment and parameter args of function run to support a common npmrc for all run calls of a single NpmEnvironment. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) meta/classes/npm.bbclass | 14

[OE-core] [PATCH 12/12] recipetool: Rework crunch_license to recognize more variants

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 121 +-- 1 file changed, 97 insertions(+), 24 deletions(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool

[OE-core] [PATCH 10/12] npm: Add variable NPM_NODEDIR with default value

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Replace the variable NPM_NODEDIR fallback to a default value inside the code with a variable NPM_NODEDIR with default value. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) meta/classes/npm.bbclass | 8 +++- 1 file changed, 3 insertions(+), 5

[OE-core] [PATCH 09/12] recipetool: npm: Use README as license fallback

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Use the README as license fallback if a license file is missing. Use the linenumbers parameter of get_license_md5sums function to determine the license text inside the README. Signed-off-by: Stefan Herbrechtsmeier --- Changes in v2: - Rework to add licenses

[OE-core] [PATCH 07/12] recipetool: Add support for linenumbers to licenses.csv

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Add support for linenumbers (begin and end lines) to licenses.csv. Add an optional linenumbers parameter to get_license_md5sums to support different use cases. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 12

[OE-core] [PATCH 08/12] recipetool: npm: Do not add package.json files to LIC_FILES_CHKSUM

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier The package.json files doesn't contain any licenses. The name of the license doesn't comply the license requirements of most liceneses. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create_npm.py | 10 -- 1 file

[OE-core] [PATCH 06/12] recipetool: Add logger info for missing license entries

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 3 +++ 1 file changed, 3 insertions(+) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 87b25ebc7e..a8c4cdef4a 100644

[OE-core] [PATCH 02/12] recipetool: Move license md5sums into CSV files

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py| 52 + scripts/lib/recipetool/licenses.csv | 37 2 files changed, 52 insertions(+), 37 deletions(-) create mode

[OE-core] [PATCH 05/12] recipetool: ignore empty license files

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 893980a5ce

[OE-core] [PATCH 01/12] npm: Add support for EXTRA_OENPM arguments

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Add support for EXTRA_OENPM arguments to set node-gyp variables for example. This allows use of shared librariess, avoid download of external sources or build from source. Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) meta/classes/npm.bbclass

[OE-core] [PATCH 04/12] recipetool: Change default paramter fallback_licenses of function split_pkg_licenses from None to []

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 83cf25d9b7..893980a5ce

[OE-core] [PATCH 03/12] recipetool: Skip common source files in guess_license

2021-10-08 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- (no changes since v1) scripts/lib/recipetool/create.py | 2 ++ 1 file changed, 2 insertions(+) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index e88a4253da..83cf25d9b7 100644

Re: [OE-core] Improve npm support to run build scripts

2021-10-08 Thread Stefan Herbrechtsmeier
Hi Tim, Am 08.10.2021 um 07:27 schrieb Tim Orling: We have discussed the severe impact on parsing time with 100k recipes. I personally worked on a node.js project with that many dependencies (but not an OE/Yocto deployment). Parsing time is already a pain point for 1000s of recipes. How do

Re: [OE-core] [PATCH 03/12] recipetool: Add optional licfiles parameter to guess_license

2021-10-07 Thread Stefan Herbrechtsmeier
Am 07.10.2021 um 12:13 schrieb Stefan Herbrechtsmeier via lists.openembedded.org: From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/scripts/lib/recipetool

Re: [OE-core] [PATCH 09/12] recipetool: npm: Pass README as fallback to guess_license if a license is missing

2021-10-07 Thread Stefan Herbrechtsmeier
Am 07.10.2021 um 12:13 schrieb Stefan Herbrechtsmeier via lists.openembedded.org: From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create_npm.py | 21 - 1 file changed, 20 insertions(+), 1 deletion(-) diff --git a/scripts

[OE-core] [PATCH 08/12] recipetool: npm: Do not add package.json files to LIC_FILES_CHKSUM

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier The package.json files doesn't contain any licenses. The name of the license doesn't comply the license requirements of most liceneses. Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create_npm.py | 10 -- 1 file changed, 10 deletions

[OE-core] [PATCH 11/12] npm: Use configs for npm environment and args for npm run command

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Use parameter configs of class NpmEnvironment and parameter args of function run to support a common npmrc for all run calls of a single NpmEnvironment. Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/npm.bbclass | 14 ++ 1 file changed, 6

[OE-core] [PATCH 12/12] recipetool: Rework crunch_license to recognize more variants

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 121 +-- 1 file changed, 97 insertions(+), 24 deletions(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 047462d389

[OE-core] [PATCH 09/12] recipetool: npm: Pass README as fallback to guess_license if a license is missing

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create_npm.py | 21 - 1 file changed, 20 insertions(+), 1 deletion(-) diff --git a/scripts/lib/recipetool/create_npm.py b/scripts/lib/recipetool/create_npm.py index c939780931

[OE-core] [PATCH 06/12] recipetool: ignore empty license files

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index d86b98ff1e..071c845ed4 100644

[OE-core] [PATCH 10/12] npm: Add variable NPM_NODEDIR with default value

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Replace the variable NPM_NODEDIR fallback to a default value inside the code with a variable NPM_NODEDIR with default value. Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/npm.bbclass | 8 +++- 1 file changed, 3 insertions(+), 5 deletions(-) diff

[OE-core] [PATCH 07/12] recipetool: Add logger info for missing license entries

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 3 +++ 1 file changed, 3 insertions(+) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 071c845ed4..047462d389 100644 --- a/scripts/lib/recipetool

[OE-core] [PATCH 02/12] recipetool: Move license md5sums into CSV files

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py| 52 + scripts/lib/recipetool/licenses.csv | 37 2 files changed, 52 insertions(+), 37 deletions(-) create mode 100644 scripts/lib

[OE-core] [PATCH 05/12] recipetool: Change default paramter fallback_licenses of function split_pkg_licenses from None to []

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index b1c8d32852..d86b98ff1e 100644 --- a/scripts/lib

[OE-core] [PATCH 03/12] recipetool: Add optional licfiles parameter to guess_license

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index e88a4253da..3bcae962a8 100644 --- a/scripts

[OE-core] [PATCH 04/12] recipetool: Skip common source files in guess_license

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- scripts/lib/recipetool/create.py | 2 ++ 1 file changed, 2 insertions(+) diff --git a/scripts/lib/recipetool/create.py b/scripts/lib/recipetool/create.py index 3bcae962a8..b1c8d32852 100644 --- a/scripts/lib/recipetool

[OE-core] [PATCH 01/12] npm: Add support for EXTRA_OENPM arguments

2021-10-07 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Add support for EXTRA_OENPM arguments to set node-gyp variables for example. This allows use of shared librariess, avoid download of external sources or build from source. Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/npm.bbclass | 5 - 1 file

Re: [OE-core] Improve npm support to run build scripts

2021-10-06 Thread Stefan Herbrechtsmeier
Hi Konrad, Am 05.10.2021 um 21:29 schrieb Konrad Weihmann: On 05.10.21 21:17, Alexander Kanavin wrote: On Tue, 5 Oct 2021 at 19:44, Stefan Herbrechtsmeier <mailto:stefan.herbrechtsmeier-...@weidmueller.com>> wrote: > A layer with thousands of recipes seems totally

Re: [OE-core] Improve npm support to run build scripts

2021-10-06 Thread Stefan Herbrechtsmeier
Hi Alex, Am 05.10.2021 um 21:17 schrieb Alexander Kanavin: On Tue, 5 Oct 2021 at 19:44, Stefan Herbrechtsmeier <mailto:stefan.herbrechtsmeier-...@weidmueller.com>> wrote: > A layer with thousands of recipes seems totally intractable. What is your concern? The

Re: [OE-core] Improve npm support to run build scripts

2021-10-06 Thread Stefan Herbrechtsmeier
Hi Robert, Am 05.10.2021 um 20:18 schrieb Robert Berger: On 05/10/2021 15:48, Stefan Herbrechtsmeier wrote: Is a layer with more more than 1000 recipes thinkable? Did you have a look at this[1]? It says: "For instance I currently am using around 10 NPM-packages, those culmi

Re: [OE-core] Improve npm support to run build scripts

2021-10-05 Thread Stefan Herbrechtsmeier
Hi Alex, Am 05.10.2021 um 15:10 schrieb Alexander Kanavin: I think the supposed workflow with the new npm.class was to use 'devtool create' which would run some npm magic to to create a single recipe that has all of the npm-fetched dependencies inside SRC_URI. There is no magic inside npm.

Re: [OE-core] Improve npm support to run build scripts

2021-10-05 Thread Stefan Herbrechtsmeier
Hi Richard, Am 05.10.2021 um 13:09 schrieb Richard Purdie: Thanks for bring this up, I've been wondering on the status of our npm support. Do you know any npm users? On Tue, 2021-10-05 at 12:04 +0200, Stefan Herbrechtsmeier wrote: I must improve the npm support for our use cases but need

[OE-core] Improve npm support to run build scripts

2021-10-05 Thread Stefan Herbrechtsmeier
Hi Jean-Marie and Richard, I must improve the npm support for our use cases but need some fundamental decisions to proceed. I need to build express and angular applications from git repositories. I have the following changes in my pipeline until now: - Support npm packages with missing

[OE-core] [PATCH 3/4] u-boot: Make UBOOT_BINARYNAME configurable

2021-09-01 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Make the u-boot binary name configurable. Use the existing variable UBOOT_BINARYNAME which is evaluated from the UBOOT_BINARY. Signed-off-by: Stefan Herbrechtsmeier --- meta/classes/uboot-config.bbclass | 4 ++-- meta/recipes-bsp/u-boot/u-boot.inc | 18

[OE-core] [PATCH 4/4] u-boot: Make SPL suffix configurable

2021-09-01 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Make the SPL suffix configurable via SPL_SUFFIX variable to support SPL binaries with suffix. The suffix is optional and empty per default. The delimiter in front of the suffix is added automatically if the suffix is not empty. A new variable SPL_BINARYFILE contains

[OE-core] [PATCH 2/4] u-boot: Remove misplaced configuration type variable

2021-09-01 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Signed-off-by: Stefan Herbrechtsmeier --- meta/recipes-bsp/u-boot/u-boot.inc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-bsp/u-boot/u-boot.inc b/meta/recipes-bsp/u-boot/u-boot.inc index 71febb6f43..a8ebcc9ea0 100644 --- a/meta

[OE-core] [PATCH 1/4] u-boot: Remove redundancy from installed and deployed SPL artifact names

2021-09-01 Thread Stefan Herbrechtsmeier
From: Stefan Herbrechtsmeier Remove redundant parts from the deployed and installed SPL artifact names of multi config configurations to match the other U-Boot artifact names. Signed-off-by: Stefan Herbrechtsmeier --- meta/recipes-bsp/u-boot/u-boot.inc | 16 1 file changed

Re: [OE-core] Application depending on gRPC not linking properly

2020-09-11 Thread Stefan Herbrechtsmeier
Hi, Am 09.09.20 um 14:56 schrieb Goran Broeckaert: I have a simple application which depends on grpc. I'm using Yocto Zeus for my project and I've written the following recipe: [snip] The linker tries to link with the -native version of gRPC instead of the target one. Can be seen in the

Re: [OE-core] Status of Go support

2020-06-25 Thread Stefan Herbrechtsmeier
Am 25.06.20 um 20:43 schrieb Paul Barker: On Thu, 25 Jun 2020 at 16:36, Stefan Herbrechtsmeier wrote: Am 24.06.20 um 22:24 schrieb Otavio Salvador: Em qua., 24 de jun. de 2020 às 17:17, Stefan Herbrechtsmeier escreveu: The go-mod.bbclass download data from the internet during do_compile

Re: [OE-core] Status of Go support

2020-06-25 Thread Stefan Herbrechtsmeier
Am 25.06.20 um 20:40 schrieb Otavio Salvador: Em qui., 25 de jun. de 2020 às 15:35, Stefan Herbrechtsmeier escreveu: Am 25.06.20 um 18:43 schrieb Otavio Salvador: Offline build, using go mod, I can only envision if we somehow provide a local server which uses the bitbake cache as source

Re: [OE-core] Status of Go support

2020-06-25 Thread Stefan Herbrechtsmeier
Am 25.06.20 um 18:43 schrieb Otavio Salvador: Em qui., 25 de jun. de 2020 às 12:36, Stefan Herbrechtsmeier escreveu: Am 24.06.20 um 22:24 schrieb Otavio Salvador: Em qua., 24 de jun. de 2020 às 17:17, Stefan Herbrechtsmeier escreveu: The go-mod.bbclass download data from the internet during

Re: [OE-core] Status of Go support

2020-06-25 Thread Stefan Herbrechtsmeier
Am 24.06.20 um 22:24 schrieb Otavio Salvador: Em qua., 24 de jun. de 2020 às 17:17, Stefan Herbrechtsmeier escreveu: The go-mod.bbclass download data from the internet during do_compile. If you cut the internet connection after a do_fetch the do_compile failed: Yes, this was the better we

Re: [OE-core] Status of Go support

2020-06-24 Thread Stefan Herbrechtsmeier
Am 23.06.20 um 21:56 schrieb Khem Raj: On 6/23/20 11:35 AM, Stefan Herbrechtsmeier wrote: Am 23.06.20 um 20:16 schrieb Khem Raj: On Tue, Jun 23, 2020 at 9:47 AM Otavio Salvador <mailto:otavio.salva...@ossystems.com.br>> wrote:     Hello Stefan,     Em ter., 23 de jun. de 2020

Re: [OE-core] Status of Go support

2020-06-23 Thread Stefan Herbrechtsmeier
Hi, Am 23.06.20 um 20:16 schrieb Khem Raj: On Tue, Jun 23, 2020 at 9:47 AM Otavio Salvador <mailto:otavio.salva...@ossystems.com.br>> wrote: Hello Stefan, Em ter., 23 de jun. de 2020 às 13:37, Stefan Herbrechtsmeier mailto:ste...@herbrechtsmeier.net>> escreveu:

[OE-core] Status of Go support

2020-06-23 Thread Stefan Herbrechtsmeier
Hi, because of the changes to the 'GO111MODULE' variable in go-dep and glide, I wonder if Go is ready for use. I would have expected the variable GO111MODULE to be set to 'off' within the go.bbclass because go could bypass the fetch task unobserved otherwise. Regards Stefan

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-27 Thread Stefan Herbrechtsmeier
Am 25.10.19 um 13:08 schrieb Adrian Bunk: On Fri, Oct 25, 2019 at 10:35:20AM +0200, Stefan Herbrechtsmeier wrote: Am 24.10.19 um 17:59 schrieb Richard Purdie: On Thu, 2019-10-24 at 18:37 +0300, Adrian Bunk wrote: On Thu, Oct 24, 2019 at 02:12:43PM +0200, Alexander Kanavin wrote: On Thu, 24

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-25 Thread Stefan Herbrechtsmeier
Hi Andre, Am 25.10.19 um 10:01 schrieb André Draszik: Hi, This has been an interesting discussion so far. I'd like to throw in something else... A couple years back I wrote a little python script to automatically generate all the required dependency recipes given an npm project's

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-25 Thread Stefan Herbrechtsmeier
Am 24.10.19 um 19:58 schrieb Alexander Kanavin: On Thu, 24 Oct 2019 at 19:45, Stefan Herbrechtsmeier mailto:ste...@herbrechtsmeier.net>> wrote: > The package-lock.json in their tarball is 600K. The project use two major version and seven different versions with 30 inst

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-25 Thread Stefan Herbrechtsmeier
Am 24.10.19 um 17:59 schrieb Richard Purdie: On Thu, 2019-10-24 at 18:37 +0300, Adrian Bunk wrote: On Thu, Oct 24, 2019 at 02:12:43PM +0200, Alexander Kanavin wrote: On Thu, 24 Oct 2019 at 14:02, Stefan Herbrechtsmeier < ste...@herbrechtsmeier.net> wrote: @Richard: What is your opinion

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-24 Thread Stefan Herbrechtsmeier
Am 24.10.19 um 16:22 schrieb Alexander Kanavin: On Thu, 24 Oct 2019 at 15:52, Stefan Herbrechtsmeier mailto:ste...@herbrechtsmeier.net>> wrote: > Yes: > http://lists.openembedded.org/pipermail/openembedded-architecture/2017-March/001270.html Do you have a

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-24 Thread Stefan Herbrechtsmeier
Hi Jean-Marie, Am 24.10.19 um 17:13 schrieb Jean-Marie LEMETAYER: Hi Stefan, On Oct 24, 2019, at 2:40 PM, Stefan Herbrechtsmeier ste...@herbrechtsmeier.net wrote: Fist we should use 'npm ci' instead of 'npm install'. Thanks for the tips, I did not know about the 'npm ci' command. Sadly

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-24 Thread Stefan Herbrechtsmeier
Am 24.10.19 um 17:13 schrieb Jean-Marie LEMETAYER: Hi Stefan, On Oct 24, 2019, at 2:01 PM, Stefan Herbrechtsmeier ste...@herbrechtsmeier.net wrote: Am 22.10.19 um 13:22 schrieb Richard Purdie: On Tue, 2019-10-22 at 11:03 +0200, Jean-Marie LEMETAYER wrote: The current NPM support have

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-24 Thread Stefan Herbrechtsmeier
Am 24.10.19 um 14:45 schrieb Alexander Kanavin: On Thu, 24 Oct 2019 at 14:40, Stefan Herbrechtsmeier mailto:ste...@herbrechtsmeier.net>> wrote: > I don't think it's at all realistic to stick to the 'one recipe per > component' in node.js world. A typical 'npm install' c

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-24 Thread Stefan Herbrechtsmeier
Am 24.10.19 um 14:12 schrieb Alexander Kanavin: On Thu, 24 Oct 2019 at 14:02, Stefan Herbrechtsmeier mailto:ste...@herbrechtsmeier.net>> wrote: @Richard: What is your opinion about the per recipe dependency? Typically OE use one recipe per project. The NPM based solution

Re: [OE-core] [RFC][PATCH 0/6] NPM refactoring

2019-10-24 Thread Stefan Herbrechtsmeier
Hi Jean-Marie, Am 22.10.19 um 13:22 schrieb Richard Purdie: On Tue, 2019-10-22 at 11:03 +0200, Jean-Marie LEMETAYER wrote: The current NPM support have several issues: - The current NPM fetcher downloads the dependency tree but not the other fetchers. The 'subdir' parameter was used to

Re: [OE-core] [RFC][PATCH 1/6] npm.bbclass: refactor the npm class

2019-10-24 Thread Stefan Herbrechtsmeier
Hi Jean-Marie, Am 22.10.19 um 11:03 schrieb Jean-Marie LEMETAYER: Many issues were related to npm dependencies badly handled: package names, installation directories, ... In fact npm is using an install algorithm [1] which is hard to reproduce / anticipate. Why do you think it is hard to

Re: [OE-core] Circular dependency of do_populate_sysroot

2019-04-08 Thread Stefan Herbrechtsmeier
Am 08.04.19 um 08:55 schrieb richard.pur...@linuxfoundation.org: On Mon, 2019-04-08 at 07:43 +0200, Stefan Herbrechtsmeier wrote: Am 07.04.2019 23:35 schrieb richard.pur...@linuxfoundation.org: You're saying A runtime depends on B and B runtime depends on A. Yes, only the run time depends

Re: [OE-core] Circular dependency of do_populate_sysroot

2019-04-07 Thread Stefan Herbrechtsmeier
Hi,Am 07.04.2019 23:35 schrieb richard.pur...@linuxfoundation.org:On Sun, 2019-04-07 at 21:18 +0200, Stefan Herbrechtsmeier wrote: > I'm working towards an integrated Node.js support without npm and > have a  problem with a circular dependency of do_populate_sysroot for > the nat

<    1   2   3   >