[OE-core] [PATCH] buildhistory-collect-srcrevs: Fix multiple SRCREV definitions

2016-10-19 Thread Tobias Hagelborn
From: Tobias Hagelborn <tobia...@axis.com> Fixed copy & paste error causing error when extracting SRCREV for packages containing multiple SRCREV definitons. Signed-off-by: Tobias Hagelborn <tobias.hagelb...@axis.com> --- scripts/buildhistory-collect-srcrevs | 2 +- 1 file chan

[OE-core] [PATCH 2/2] devtool: srctree: New command for setting up browsable source-code

2017-03-24 Thread Tobias Hagelborn
Setup a directory tree for source code according to section name. (if known). This tree is intended for code browsing ONLY. If source is moved, for instance with devtool modify, this command should be rerun to be up-to-date with that move. Signed-off-by: Tobias Hagelborn <tobia...@axis.

[OE-core] [PATCH 1/2] srctree.bbclass: Download sourcecode and make it searchable

2017-03-24 Thread Tobias Hagelborn
convenient local search in source code. Example: nfs-utils (console/network) maps to -> console/ network/ nfs-utils Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/classes/srctree.bbclass | 92 1 file changed, 92 i

[OE-core] [PATCH 0/2] Make source code browsable locally

2017-03-24 Thread Tobias Hagelborn
to SRCTREE_PN_PATH in a custom class and set SRCTREE_EXTENSION in a configuration file. Tobias Hagelborn (2): srctree.bbclass: Download sourcecode and make it searchable devtool: srctree: New command for setting up browsable source-code meta/classes/srctree.bbclass | 92

[OE-core] [PATCH v2 0/2] Make source code browsable locally - devtool srctree

2017-07-06 Thread Tobias Hagelborn
. This is done by implementing a custom dir generation function and assign to SRCTREE_PN_PATH in a custom class and set SRCTREE_EXTENSION in a configuration file. Tobias Hagelborn (2): srctree.bbclass: Download sourcecode and make it searchable devtool: srctree: New command for setting up

[OE-core] [PATCH v2 1/2] srctree.bbclass: Download sourcecode and make it searchable

2017-07-06 Thread Tobias Hagelborn
convenient local search in source code. Example: nfs-utils (console/network) maps to -> console/ network/ nfs-utils Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/classes/srctree.bbclass | 90 1 file changed, 90 i

[OE-core] [PATCH v2 2/2] devtool: srctree: New command for setting up browsable source-code

2017-07-06 Thread Tobias Hagelborn
Setup a directory tree for source code according to section name. (if known). This tree is intended for code browsing ONLY. If source is moved, for instance with devtool modify, this command should be rerun to be up-to-date with that move. Signed-off-by: Tobias Hagelborn <tobia...@axis.

[OE-core] [PATCH v3 3/4] package.py: strip_execs: Support for .ko modules

2017-06-20 Thread Tobias Hagelborn
* Support stripping of .ko modules verifying file extension and check of content "vermagic=" * Minor refactoring (removing lint errors) Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/lib/oe/package.py | 44 +--- 1

[OE-core] [PATCH v3 4/4] devtool: deploy-target: Support stripped libs and execs

2017-06-20 Thread Tobias Hagelborn
ng default behavior Config example: [Deploy] strip = true [YOCTO #11227] Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- scripts/lib/devtool/deploy.py | 32 1 file changed, 28 insertions(+), 4 deletions(-) diff --git a/scripts/lib/devtool/deploy.

[OE-core] [PATCH v3 1/4] package.py: Add function strip_execs

2017-06-20 Thread Tobias Hagelborn
Strip all executables in a directory. Utility function placed in oe-package together with run_strip. strip_execs is based on strip_sysroot from staging.bbclass Moving out datastore references in favor of function parameters. Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/

[OE-core] [PATCH v3 2/4] staging.bbclass: Make use of oe.package.strip_execs

2017-06-20 Thread Tobias Hagelborn
Make use of the library function oe.package.strip_execs for stripping sysroot executables. oe.packge.strip_execs is based on code previously residing in sysroot_strip. Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/classes/staging.bbclass

[OE-core] [PATCH v2 1/4] package.py: Add function strip_execs

2017-06-19 Thread Tobias Hagelborn
Strip all executables in a directory. Utility function placed in oe-package together with run_strip. strip_execs is based on strip_sysroot from staging.bbclass Moving out datastore references in favor of function parameters. Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/

[OE-core] [PATCH v2 4/4] devtool: deploy-target: Support stripped libs and execs

2017-06-19 Thread Tobias Hagelborn
ng default behavior Config example: [Deploy] strip = true [YOCTO #11227] Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- scripts/lib/devtool/deploy.py | 32 1 file changed, 28 insertions(+), 4 deletions(-) diff --git a/scripts/lib/devtool/deploy.

[OE-core] [PATCH v2 3/4] package.py: strip_execs: Support for .ko modules

2017-06-19 Thread Tobias Hagelborn
* Support stripping of .ko modules verifying file extension and check of content "vermagic=" * Minor refactoring (removing lint errors) Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/lib/oe/package.py | 44 +--- 1

[OE-core] [PATCH v2 2/4] staging.bbclass: Make use of oe.package.strip_execs

2017-06-19 Thread Tobias Hagelborn
Make use of the library function oe.package.strip_execs for stripping sysroot executables. oe.packge.strip_execs is based on code previously residing in sysroot_strip. Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/classes/staging.bbclass

[OE-core] [PATCH] devtool: deploy-target: Support stripped libs and execs

2017-06-14 Thread Tobias Hagelborn
t behavior * Added .ko strip support compared to original function sysroot_strip Config example: [Deploy] strip = true [YOCTO #11227] Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- scripts/lib/devtool/deploy.py | 134 -- 1 file changed, 130

Re: [OE-core] [PATCH] devtool: deploy-target: Support stripped libs and execs

2017-06-15 Thread Tobias Hagelborn
On 06/14/2017 01:35 PM, Tobias Hagelborn wrote: On 06/14/2017 11:28 AM, Richard Purdie wrote: On Wed, 2017-06-14 at 08:24 +0200, Tobias Hagelborn wrote: New devtool deploy-target option --strip which enables deploying stripped binaries, saving some space on target. * Copies the files of ${D

Re: [OE-core] [PATCH] devtool: deploy-target: Support stripped libs and execs

2017-06-14 Thread Tobias Hagelborn
On 06/14/2017 11:28 AM, Richard Purdie wrote: On Wed, 2017-06-14 at 08:24 +0200, Tobias Hagelborn wrote: New devtool deploy-target option --strip which enables deploying stripped binaries, saving some space on target. * Copies the files of ${D} into a new directory and strips them in place

Re: [OE-core] [PATCH v2 0/2] Make source code browsable locally - devtool srctree

2017-08-30 Thread Tobias Hagelborn
On 07/07/2017 07:32 AM, Tobias Hagelborn wrote: UPDATE v2: - Rebased on latest Poky - Fixed issue with bad paths - Dirname based on $PN In our organization, there is a demand to be able download source code for searching. With the use of sstate-cache this has been challenge. Also, the source

[OE-core] [PATCH v4 2/2] devtool: deploy-target: Support stripped libs and execs

2017-08-24 Thread Tobias Hagelborn
ng default behavior Config example: [Deploy] strip = true [YOCTO #11227] Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- scripts/lib/devtool/deploy.py | 33 + 1 file changed, 29 insertions(+), 4 deletions(-) diff --git a/scripts/lib/devtool/deploy.

[OE-core] [PATCH v4 0/2] devtool deploy-target --strip option

2017-08-24 Thread Tobias Hagelborn
New devtool deploy-target option --strip which enables deploying stripped binaries, saving some space on target. Updates in v4: - Updated to correct the errors found by Autobilder. - Verified devtool-deploy-target with poky-master [YOCTO #11227] Tobias Hagelborn (2): package.py: strip_execs

[OE-core] [PATCH v4 1/2] package.py: strip_execs: Support for .ko modules

2017-08-24 Thread Tobias Hagelborn
* Support stripping of .ko modules verifying file extension and check of content "vermagic=" * Minor refactoring (removing lint errors) Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/lib/oe/package.py | 44 +--- 1

Re: [OE-core] [PATCH v3 4/4] devtool: deploy-target: Support stripped libs and execs

2017-08-24 Thread Tobias Hagelborn
On 06/21/2017 12:09 PM, Jussi Kukkonen wrote: On 20 June 2017 at 10:42, Tobias Hagelborn <tobias.hagelb...@axis.com <mailto:tobias.hagelb...@axis.com>> wrote: > > New devtool deploy-target option --strip which enables deploying > stripped binaries, saving

[OE-core] [PATCH v5 2/3] package.py: strip_execs: Support for .ko modules

2017-08-25 Thread Tobias Hagelborn
* Support stripping of .ko modules verifying file extension and check of content "vermagic=" Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/lib/oe/package.py | 23 ++- 1 file changed, 14 insertions(+), 9 deletions(-) diff --git a/meta/lib/oe/p

[OE-core] [PATCH v5 3/3] devtool: deploy-target: Support stripped libs and execs

2017-08-25 Thread Tobias Hagelborn
ng default behavior Config example: [Deploy] strip = true [YOCTO #11227] Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- scripts/lib/devtool/deploy.py | 33 + 1 file changed, 29 insertions(+), 4 deletions(-) diff --git a/scripts/lib/devtool/deploy.

[OE-core] [PATCH v5 1/3] package.py: Fix some lint errors

2017-08-25 Thread Tobias Hagelborn
- rename type to exec_type not to shadow type - rename isELF is_elf --- meta/lib/oe/package.py | 19 +-- 1 file changed, 9 insertions(+), 10 deletions(-) diff --git a/meta/lib/oe/package.py b/meta/lib/oe/package.py index a79c668..839e9a2 100644 --- a/meta/lib/oe/package.py +++

[OE-core] [PATCH v5 0/3] devtool deploy-target --strip option

2017-08-25 Thread Tobias Hagelborn
New devtool deploy-target option --strip which enables deploying stripped binaries, saving some space on target. Updates in v5: - Updated according to feedback from Richard Purdie - Separate lint issue fixes - Verified devtool-deploy-target with poky-master [YOCTO #11227] Tobias Hagelborn

[OE-core] [PATCH v6 3/3] devtool: deploy-target: Support stripped libs and execs

2017-08-25 Thread Tobias Hagelborn
ng default behavior Config example: [Deploy] strip = true [YOCTO #11227] Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- scripts/lib/devtool/deploy.py | 33 + 1 file changed, 29 insertions(+), 4 deletions(-) diff --git a/scripts/lib/devtool/deploy.

[OE-core] [PATCH v6 1/3] package.py: Fix some lint errors

2017-08-25 Thread Tobias Hagelborn
- rename type to exec_type not to shadow type - rename isELF is_elf Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/lib/oe/package.py | 19 +-- 1 file changed, 9 insertions(+), 10 deletions(-) diff --git a/meta/lib/oe/package.py b/meta/lib/oe/package.py

[OE-core] [PATCH v6 2/3] package.py: strip_execs: Support for .ko modules

2017-08-25 Thread Tobias Hagelborn
* Support stripping of .ko modules verifying file extension and check of content "vermagic=" Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/lib/oe/package.py | 23 ++- 1 file changed, 14 insertions(+), 9 deletions(-) diff --git a/meta/lib/oe/p

[OE-core] [PATCH v3 1/2] srctree.bbclass: Download sourcecode and make it searchable

2017-12-13 Thread Tobias Hagelborn
convenient local search in source code. Example: nfs-utils (console/network) maps to -> console/ network/ nfs-utils Signed-off-by: Tobias Hagelborn <tobia...@axis.com> --- meta/classes/srctree.bbclass | 90 1 file changed, 90 i

[OE-core] [PATCH v3 2/2] devtool: srctree: New command for setting up browsable source-code

2017-12-13 Thread Tobias Hagelborn
Setup a directory tree for source code according to section name. (if known). This tree is intended for code browsing ONLY. If source is moved, for instance with devtool modify, this command should be rerun to be up-to-date with that move. Signed-off-by: Tobias Hagelborn <tobia...@axis.

[OE-core] [PATCH v3 0/2] Make source code browsable locally - devtool srctree

2017-12-13 Thread Tobias Hagelborn
the package source code in your own way. This is done by implementing a custom dir generation function and assign to SRCTREE_PN_PATH in a custom class and set SRCTREE_EXTENSION in a configuration file. Tobias Hagelborn (2): srctree.bbclass: Download sourcecode and make it searchable devtool

Re: [OE-core] [PATCH v2 0/2] Make source code browsable locally - devtool srctree

2017-12-13 Thread Tobias Hagelborn
On 09/05/2017 02:10 PM, Randy MacLeod wrote: On 2017-09-01 08:00 AM, Peter Kjellerstedt wrote: Well, the most common request we've gotten from the developers is that they want to be able to search through all the sources, e.g., to find out where a particular function is used. The tmp directory

[OE-core] Findings from using Hash Equivalence server

2023-09-21 Thread Tobias Hagelborn
Findings from using Hash Equivalence server at scale: = We have now used the OE Hash Equivalence server at scale in our C/I chain at our company. This has given some insights in what works and what can be improved when running this service in

[OE-core] [PATCH] hashserv: Retry and sleep if database is locked on INSERT

2023-09-21 Thread Tobias Hagelborn
From: Tobias Hagelborn Retry insert operations in case the database is locked by an external process. For instance an external cleanup or data retention transaction. Use async sleep to not block the event loop. Signed-off-by: Tobias Hagelborn --- lib/hashserv/server.py | 41

[OE-core] [PATCH] sstate.bbclass: Fetch non-existing local .sig files if needed

2023-01-26 Thread Tobias Hagelborn
the global sstate cache. If this case is detected, re-run the fetch operation to get the global .sig file (if it exists). Change-Id: Id0491af1d3a0d29b2773d1607be9edfb7fa5ad70 Signed-off-by: Tobias Hagelborn --- meta/classes-global/sstate.bbclass | 6 +- 1 file changed, 5 insertions(+), 1 deletion

[OE-core] [PATCH] sstate.bbclass: Fetch non-existing local .sig files if needed

2023-01-27 Thread Tobias Hagelborn
the global sstate cache. If this case is detected, re-run the fetch operation to get the global .sig file (if it exists). Signed-off-by: Tobias Hagelborn --- meta/classes-global/sstate.bbclass | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/meta/classes-global/sstate.bbclass b

[OE-core] [PATCHv3] sstate.bbclass: Fetch non-existing local .sig files if needed

2023-01-30 Thread Tobias Hagelborn
the global sstate cache. If this case is detected, re-run the fetch operation to get the global .sig file (if it exists). Signed-off-by: Tobias Hagelborn --- New in v3: * Use exists * Consolidate into previously existing fetch block (with new condition) meta/classes-global/sstate.bbclass | 5 +++-- 1

Re: [OE-core] [PATCH] lib/oe/gpg_sign.py: Avoid race when creating .sig files in detach_sign

2023-03-23 Thread Tobias Hagelborn
: GPG exited with code 2: gpg: signing failed: Bad passphrase The provided solution with renaming the files into final destination has proven to eliminate the issue. Cheers Tobias From: openembedded-core@lists.openembedded.org on behalf of Tobias Hagelborn Sent: Thursday, March 23, 2023

[OE-core] [PATCH] lib/oe/gpg_sign.py: Avoid race when creating .sig files in detach_sign

2023-03-23 Thread Tobias Hagelborn
Move the signature file into place only after it is successfully signed. This to avoid race and corrupted .sig files in cases multiple onging builds write to a shared sstate-cache dir. Signed-off-by: Tobias Hagelborn --- meta/lib/oe/gpg_sign.py | 25 +++-- 1 file changed, 15

Re: [OE-core] [PATCH] lib/oe/gpg_sign.py: Avoid race when creating .sig files in detach_sign

2023-03-30 Thread Tobias Hagelborn
To: Tobias Hagelborn ; openembedded-core@lists.openembedded.org Subject: Re: [OE-core] [PATCH] lib/oe/gpg_sign.py: Avoid race when creating .sig files in detach_sign On Wed, 2023-03-29 at 23:33 +0100, Richard Purdie via lists.openembedded.org wrote: > On Thu, 2023-03-23 at 11:08 +0100, Tob

Re: [OE-core] [PATCH] sstate.bbclass: Only sign packages at the time of their creation

2023-12-21 Thread Tobias Hagelborn
ers Tobias From: openembedded-core@lists.openembedded.org on behalf of Tobias Hagelborn Sent: Friday, December 22, 2023 7:09 AM To: openembedded-core@lists.openembedded.org Subject: [OE-core] [PATCH] sstate.bbclass: Only sign packages at the time of their creation Fr

[OE-core] [PATCH] sstate.bbclass: Only sign packages at the time of their creation

2023-12-21 Thread Tobias Hagelborn
From: Tobias Hagelborn The purpose of the change is to never sign a package not created by the build itself. sstate_create_package is refactored into Python and re-designed to handle signing inside the function. Thus, the signing should never apply to existing sstate packages. The function

[OE-core] [PATCH 0/1] hashserv unihash cache

2023-11-30 Thread Tobias Hagelborn
solution. We have run this cache in production now with and it seems to do OK so I would like to share it either as a contribution or an idea for improvement. Tobias Hagelborn (1): hashserv: Unihash cache lib/hashserv/server.py | 188 ++--- 1 file changed, 159

[OE-core] [PATCH 1/1] hashserv: Unihash cache

2023-11-30 Thread Tobias Hagelborn
in the unihash cache. This caches unihashes from the database that have not been written during the current session. Stats have been added for hits, misses and size of the unihash cache. Signed-off-by: Tobias Hagelborn --- lib/hashserv/server.py | 188 ++--- 1