[OE-core] [PATCH 1/1] lib/oe/package_manager.py: Fix extract for ipk and deb

[mariano . lopez]

From: Mariano Lopez 

With the move to use lists instead of strings in subprocess
calls, package extraction was broken for ipk and deb. This
fixes this issue.

Signed-off-by: Mariano Lopez 
---
 meta/lib/oe/package_manager.py | 6 +-
 1 file changed, 5 insertions(+), 1 deletion(-)

diff --git a/meta/lib/oe/package_manager.py b/meta/lib/oe/package_manager.py
index a8644cc..a02bff4 100644
--- a/meta/lib/oe/package_manager.py
+++ b/meta/lib/oe/package_manager.py
@@ -1545,11 +1545,15 @@ class OpkgDpkgPM(PackageManager):
 tmp_dir = tempfile.mkdtemp()
 current_dir = os.getcwd()
 os.chdir(tmp_dir)
+if self.d.getVar('IMAGE_PKGTYPE') == 'deb':
+data_tar = 'data.tar.xz'
+else:
+data_tar = 'data.tar.gz'
 
 try:
 cmd = [ar_cmd, 'x', pkg_path]
 output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
-cmd = [tar_cmd, 'xf', 'data.tar.*']
+cmd = [tar_cmd, 'xf', data_tar]
 output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)
 except subprocess.CalledProcessError as e:
 bb.utils.remove(tmp_dir, recurse=True)
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 2/2] oeqa/utils/qemurunner.py: Be sure to stop qemu-system

[mariano . lopez]

From: Mariano Lopez 

When runqemu fails, qemu-system process would keep running
and won't be killed, setpgrp() was used when runqemu was
a shell script but it seems it doesn't work always with python.

This would kill qemu-system explicity and to avoid leaving
it behind.

Signed-off-by: Mariano Lopez 
---
 meta/classes/testimage.bbclass| 2 ++
 meta/lib/oeqa/utils/qemurunner.py | 9 +
 2 files changed, 11 insertions(+)

diff --git a/meta/classes/testimage.bbclass b/meta/classes/testimage.bbclass
index 770ec80..7eb4038 100644
--- a/meta/classes/testimage.bbclass
+++ b/meta/classes/testimage.bbclass
@@ -171,6 +171,8 @@ def testimage_main(d):
 bb.plain(msg)
 else:
 bb.fatal("%s - FAILED - check the task log and the ssh log" % pn)
+except BlockingIOError as err:
+bb.error('runqemu failed, shutting down...')
 finally:
 signal.signal(signal.SIGTERM, tc.origsigtermhandler)
 target.stop()
diff --git a/meta/lib/oeqa/utils/qemurunner.py 
b/meta/lib/oeqa/utils/qemurunner.py
index 6927456..21bc35a 100644
--- a/meta/lib/oeqa/utils/qemurunner.py
+++ b/meta/lib/oeqa/utils/qemurunner.py
@@ -296,6 +296,7 @@ class QemuRunner:
 
 def stop(self):
 self.stop_thread()
+self.stop_qemu_system()
 if hasattr(self, "origchldhandler"):
 signal.signal(signal.SIGCHLD, self.origchldhandler)
 if self.runqemu:
@@ -320,6 +321,14 @@ class QemuRunner:
 self.qemupid = None
 self.ip = None
 
+def stop_qemu_system(self):
+if self.qemupid:
+try:
+# qemu-system behaves well and a SIGTERM is enough
+os.kill(self.qemupid, signal.SIGTERM)
+except ProcessLookupError as e:
+logger.warn('qemu-system ended unexpectedly')
+
 def stop_thread(self):
 if self.thread and self.thread.is_alive():
 self.thread.stop()
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 1/2] oeqa/utils/qemurunner.py: Add missing sys module

[mariano . lopez]

From: Mariano Lopez 

This adds the missing sys module used by the child process
to exit. It seems the exception was cached in testimage and
selftest. It seems nobody noticed this because the module
is only used for sys.exit().

Signed-off-by: Mariano Lopez 
---
 meta/lib/oeqa/utils/qemurunner.py | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta/lib/oeqa/utils/qemurunner.py 
b/meta/lib/oeqa/utils/qemurunner.py
index 8f1b5b9..6927456 100644
--- a/meta/lib/oeqa/utils/qemurunner.py
+++ b/meta/lib/oeqa/utils/qemurunner.py
@@ -7,6 +7,7 @@
 
 import subprocess
 import os
+import sys
 import time
 import signal
 import re
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 0/2] Be sure to kill qemu-system on testimage

[mariano . lopez]

From: Mariano Lopez 

With refactor of runqemu to use python instead of shel scripting,
the qemu-system process keeps running if runqemu fails. This series
will fix this and will terminate qemu-system explicity.

The following changes since commit 81021bc0aa0f64e67535f6a9551e921a64fe4395:

  yocto-project-qs, ref-manual: Added note for "resources temporarily 
unavailable" error (2017-01-11 17:23:18 +)

are available in the git repository at:

  git://git.yoctoproject.org/poky-contrib mariano/qemu_fix
  http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=mariano/qemu_fix

Mariano Lopez (2):
  oeqa/utils/qemurunner.py: Add missing sys module
  oeqa/utils/qemurunner.py: Be sure to stop qemu-system

 meta/classes/testimage.bbclass|  2 ++
 meta/lib/oeqa/utils/qemurunner.py | 10 ++
 2 files changed, 12 insertions(+)

-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 2/2] glibc: Upgrade to 2.25

[Phil Blundell]

On Fri, 2017-01-13 at 10:52 -0800, Khem Raj wrote:
> 
> I have sent a patchset with IFUNC change reverted for now until its
> fixed.

Yeah, I saw that.  But in light of recent developments it seems like it
might be better to revert the earlier NPTL patch that apparently
introduced the real problem.

p.

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH V3] python3-docutils: upgrade to 0.13.1

[Edwin Plauchu]

Changed document date field and roman.py notes
https://fossies.org/diffs/docutils/0.12_vs_0.13.1/COPYING.txt-diff.html

Signed-off-by: Edwin Plauchu 
---
 .../python/{python3-docutils_0.12.bb => python3-docutils_0.13.1.bb} | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)
 rename meta/recipes-devtools/python/{python3-docutils_0.12.bb => 
python3-docutils_0.13.1.bb} (60%)

diff --git a/meta/recipes-devtools/python/python3-docutils_0.12.bb 
b/meta/recipes-devtools/python/python3-docutils_0.13.1.bb
similarity index 60%
rename from meta/recipes-devtools/python/python3-docutils_0.12.bb
rename to meta/recipes-devtools/python/python3-docutils_0.13.1.bb
index e78fa3b..e36388c 100644
--- a/meta/recipes-devtools/python/python3-docutils_0.12.bb
+++ b/meta/recipes-devtools/python/python3-docutils_0.13.1.bb
@@ -2,13 +2,13 @@ SUMMARY = "Text processing system for documentation"
 HOMEPAGE = "http://docutils.sourceforge.net;
 SECTION = "devel/python"
 LICENSE = "PSF & BSD-2-Clause & GPLv3"
-LIC_FILES_CHKSUM = "file://COPYING.txt;md5=a722fbdc20347db7b69223594dd54574"
+LIC_FILES_CHKSUM = "file://COPYING.txt;md5=7a4646907ab9083c826280b19e103106"
 
 DEPENDS = "python3"
 
 SRC_URI = "${SOURCEFORGE_MIRROR}/docutils/docutils-${PV}.tar.gz"
-SRC_URI[md5sum] = "4622263b62c5c771c03502afa3157768"
-SRC_URI[sha256sum] = 
"c7db717810ab6965f66c8cf0398a98c9d8df982da39b4cd7f162911eb89596fa"
+SRC_URI[md5sum] = "ea4a893c633c788be9b8078b6b305d53"
+SRC_URI[sha256sum] = 
"718c0f5fb677be0f34b781e04241c4067cbd9327b66bdd8e763201130f5175be"
 
 S = "${WORKDIR}/docutils-${PV}"
 
-- 
2.1.4

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH] openssl: Use linux-aarch64 target for aarch64

[Fabio Berton]

aarch64 target was being configured for linux-generic64 but openssl has
linux-aarch64 target. Change to use linux-aarch64 as default.

Signed-off-by: Fabio Berton 
---
 meta/recipes-connectivity/openssl/openssl.inc | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-connectivity/openssl/openssl.inc 
b/meta/recipes-connectivity/openssl/openssl.inc
index 2ef8b38be8..5cca019e1d 100644
--- a/meta/recipes-connectivity/openssl/openssl.inc
+++ b/meta/recipes-connectivity/openssl/openssl.inc
@@ -84,7 +84,7 @@ do_configure () {
target=linux-elf-armeb
;;
linux-aarch64*)
-   target=linux-generic64
+   target=linux-aarch64
;;
linux-sh3)
target=debian-sh3
-- 
2.11.0

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH V2] python3-docutils: upgrade to 0.13.1

[Khem Raj]

On 1/13/17 11:32 AM, Patrick Ohly wrote:
> On Fri, 2017-01-13 at 12:13 -0600, Edwin Plauchu wrote:
>> Changed document date field and several notes about folders
> 
> Perhaps now would be a good time to start using beginline/endline
> parameters?
> 

may be it really depends on the change and I am not sure what has changed
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH V2] python3-docutils: upgrade to 0.13.1

[Patrick Ohly]

On Fri, 2017-01-13 at 12:13 -0600, Edwin Plauchu wrote:
> Changed document date field and several notes about folders

Perhaps now would be a good time to start using beginline/endline
parameters?

-- 
Best Regards, Patrick Ohly

The content of this message is my personal opinion only and although
I am an employee of Intel, the statements I make here in no way
represent Intel's position on the issue, nor am I authorized to speak
on behalf of Intel on this matter.



-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 2/2] glibc: Upgrade to 2.25

[Khem Raj]

On 1/13/17 10:45 AM, Phil Blundell wrote:
> On Wed, 2017-01-11 at 12:19 +, Burton, Ross wrote:
>> The gdk-pixbuf link does use -lpthread, is this saying that libpng
>> should be linked against pthread too?  I can replicate on demand if
>> you have any suggestions.
> 
> So, amusingly, it now appears that libpng in pthread-using programs has
> actually been a bit broken for a long time, since about glibc 2.22.
>  It's just that the failure has now become more obvious, because ld.so
> will refuse to load the binary at all rather than allowing it to load
> and having it crash later under some circumstances.
> 
> Whether the circumstances that would cause the crash (libpng calling
> longjmp) can ever arise with gdk-pixbuf is another question and I don't
> know the answer offhand.  If this can happen then it would probably be
> when dealing with a corrupted input file.
> 
> Anyway, this is definitely a glibc bug and it is now on the list of
> blockers for 2.25.  Good work by Ross in finding it!

I have sent a patchset with IFUNC change reverted for now until its fixed.

> 
> p.
> 
> 
> 
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 2/2] glibc: Upgrade to 2.25

[Phil Blundell]

On Wed, 2017-01-11 at 12:19 +, Burton, Ross wrote:
> > > The gdk-pixbuf link does use -lpthread, is this saying that libpng
should be linked against pthread too?  I can replicate on demand if
you have any suggestions.
> 
> 

So, amusingly, it now appears that libpng in pthread-using programs has
actually been a bit broken for a long time, since about glibc 2.22.
 It's just that the failure has now become more obvious, because ld.so
will refuse to load the binary at all rather than allowing it to load
and having it crash later under some circumstances.

Whether the circumstances that would cause the crash (libpng calling
longjmp) can ever arise with gdk-pixbuf is another question and I don't
know the answer offhand.  If this can happen then it would probably be
when dealing with a corrupted input file.

Anyway, this is definitely a glibc bug and it is now on the list of
blockers for 2.25.  Good work by Ross in finding it!

p.

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH V2] python3-docutils: upgrade to 0.13.1

[Khem Raj]

On 1/13/17 10:13 AM, Edwin Plauchu wrote:
> Changed document date field and several notes about folders

sorry to be picking on it again, it seems too vague still. perhaps you
can just diff the two license files are add the diff to commit msg
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH V2] python3-docutils: upgrade to 0.13.1

[Edwin Plauchu]

Changed document date field and several notes about folders

Signed-off-by: Edwin Plauchu 
---
 .../python/{python3-docutils_0.12.bb => python3-docutils_0.13.1.bb} | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)
 rename meta/recipes-devtools/python/{python3-docutils_0.12.bb => 
python3-docutils_0.13.1.bb} (60%)

diff --git a/meta/recipes-devtools/python/python3-docutils_0.12.bb 
b/meta/recipes-devtools/python/python3-docutils_0.13.1.bb
similarity index 60%
rename from meta/recipes-devtools/python/python3-docutils_0.12.bb
rename to meta/recipes-devtools/python/python3-docutils_0.13.1.bb
index e78fa3b..e36388c 100644
--- a/meta/recipes-devtools/python/python3-docutils_0.12.bb
+++ b/meta/recipes-devtools/python/python3-docutils_0.13.1.bb
@@ -2,13 +2,13 @@ SUMMARY = "Text processing system for documentation"
 HOMEPAGE = "http://docutils.sourceforge.net;
 SECTION = "devel/python"
 LICENSE = "PSF & BSD-2-Clause & GPLv3"
-LIC_FILES_CHKSUM = "file://COPYING.txt;md5=a722fbdc20347db7b69223594dd54574"
+LIC_FILES_CHKSUM = "file://COPYING.txt;md5=7a4646907ab9083c826280b19e103106"
 
 DEPENDS = "python3"
 
 SRC_URI = "${SOURCEFORGE_MIRROR}/docutils/docutils-${PV}.tar.gz"
-SRC_URI[md5sum] = "4622263b62c5c771c03502afa3157768"
-SRC_URI[sha256sum] = 
"c7db717810ab6965f66c8cf0398a98c9d8df982da39b4cd7f162911eb89596fa"
+SRC_URI[md5sum] = "ea4a893c633c788be9b8078b6b305d53"
+SRC_URI[sha256sum] = 
"718c0f5fb677be0f34b781e04241c4067cbd9327b66bdd8e763201130f5175be"
 
 S = "${WORKDIR}/docutils-${PV}"
 
-- 
2.1.4

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH] python3-docutils: upgrade to 0.13.1

[Khem Raj]

On 1/13/17 9:53 AM, Edwin Plauchu wrote:
> -LIC_FILES_CHKSUM = "file://COPYING.txt;md5=a722fbdc20347db7b69223594dd54574"
> +LIC_FILES_CHKSUM = "file://COPYING.txt;md5=7a4646907ab9083c826280b19e103106"

whatever is causign this change in checksums, document that in commit
message
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH] python3-docutils: upgrade to 0.13.1

[Edwin Plauchu]

Signed-off-by: Edwin Plauchu 
---
 .../python/{python3-docutils_0.12.bb => python3-docutils_0.13.1.bb} | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)
 rename meta/recipes-devtools/python/{python3-docutils_0.12.bb => 
python3-docutils_0.13.1.bb} (60%)

diff --git a/meta/recipes-devtools/python/python3-docutils_0.12.bb 
b/meta/recipes-devtools/python/python3-docutils_0.13.1.bb
similarity index 60%
rename from meta/recipes-devtools/python/python3-docutils_0.12.bb
rename to meta/recipes-devtools/python/python3-docutils_0.13.1.bb
index e78fa3b..e36388c 100644
--- a/meta/recipes-devtools/python/python3-docutils_0.12.bb
+++ b/meta/recipes-devtools/python/python3-docutils_0.13.1.bb
@@ -2,13 +2,13 @@ SUMMARY = "Text processing system for documentation"
 HOMEPAGE = "http://docutils.sourceforge.net;
 SECTION = "devel/python"
 LICENSE = "PSF & BSD-2-Clause & GPLv3"
-LIC_FILES_CHKSUM = "file://COPYING.txt;md5=a722fbdc20347db7b69223594dd54574"
+LIC_FILES_CHKSUM = "file://COPYING.txt;md5=7a4646907ab9083c826280b19e103106"
 
 DEPENDS = "python3"
 
 SRC_URI = "${SOURCEFORGE_MIRROR}/docutils/docutils-${PV}.tar.gz"
-SRC_URI[md5sum] = "4622263b62c5c771c03502afa3157768"
-SRC_URI[sha256sum] = 
"c7db717810ab6965f66c8cf0398a98c9d8df982da39b4cd7f162911eb89596fa"
+SRC_URI[md5sum] = "ea4a893c633c788be9b8078b6b305d53"
+SRC_URI[sha256sum] = 
"718c0f5fb677be0f34b781e04241c4067cbd9327b66bdd8e763201130f5175be"
 
 S = "${WORKDIR}/docutils-${PV}"
 
-- 
2.1.4

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v4] kernel-module-split: Append KERNEL_VERSION string to kernel module name

[ola . redell]

From: Ola Redell 

The KERNEL_VERSION string is added to kernel module package names in order
to make the kernel modules for different kernel versions distinct packages
instead of different versions of the same package. With this change, when
a new kernel is installed together with its kernel modules (e.g. by upgrade
of the packages kernel and kernel-modules) using some package manager such
as apt-get or rpm, the kernel modules for the older kernel will not be
removed. This enables a fall back to the older kernel if the new one fails.

Also, for backwards compatibility and to enable kernel version agnostic
dependencies to kernel modules, create a virtual package with the old
(shorter) kernel module package name using RPROVIDES.

Signed-off-by: Ola Redell 
---
 meta/classes/kernel-module-split.bbclass | 9 -
 1 file changed, 8 insertions(+), 1 deletion(-)

diff --git a/meta/classes/kernel-module-split.bbclass 
b/meta/classes/kernel-module-split.bbclass
index efe1b42..742320c 100644
--- a/meta/classes/kernel-module-split.bbclass
+++ b/meta/classes/kernel-module-split.bbclass
@@ -31,6 +31,7 @@ PACKAGESPLITFUNCS_prepend = "split_kernel_module_packages "
 KERNEL_MODULES_META_PACKAGE ?= "kernel-modules"
 
 KERNEL_MODULE_PACKAGE_PREFIX ?= ""
+KERNEL_MODULE_PROVIDE_VIRTUAL ?= "1"
 
 python split_kernel_module_packages () {
 import re
@@ -119,10 +120,16 @@ python split_kernel_module_packages () {
 # Avoid automatic -dev recommendations for modules ending with -dev.
 d.setVarFlag('RRECOMMENDS_' + pkg, 'nodeprrecs', 1)
 
+# Provide virtual package without postfix
+providevirt = d.getVar('KERNEL_MODULE_PROVIDE_VIRTUAL', True)
+if providevirt == "1":
+   postfix = format.split('%s')[1]
+   d.setVar('RPROVIDES_' + pkg, pkg.replace(postfix, ''))
+
 module_regex = '^(.*)\.k?o$'
 
 module_pattern_prefix = d.getVar('KERNEL_MODULE_PACKAGE_PREFIX')
-module_pattern = module_pattern_prefix + 'kernel-module-%s'
+module_pattern = module_pattern_prefix + 'kernel-module-%s-' + 
d.getVar("KERNEL_VERSION", True)
 
 postinst = d.getVar('pkg_postinst_modules')
 postrm = d.getVar('pkg_postrm_modules')
-- 
1.9.1

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Khem Raj]

On 1/13/17 6:25 AM, Burton, Ross wrote:
> 
> On 13 January 2017 at 14:19, Bruce Ashfield  > wrote:
> 
> I'm not much good with musl unfortunately, but honestly, I'm
> wondering how long we
> can keep this out with relatively few build issues. In tree, they'll
> get more attention.
> 
> 
> This is a greater problem - the kernel guys seem to think that glibc is
> the only C library worth thinking about.  Khem took the action to talk
> with musl and get their headers fixed - which I believe is just adding a
> new #define to them.

There is an idea to preprocess the kernel headers for musl systems, I
will replicate whatever action community decides on.

> 
> I'll continue stacking on 4.9 changes until they get sorted out. 
> I'll probably have some
> cycles near the end of next week to get lost in c library #ifdef's,
> if the issues are still
> around.
> 
> 
> I keep on pushing the kernel bits to mut2, so feel free to send an
> updated branch and I can merge that in too.
> 
> Ross
> 
> 
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH] zlib: update SRC_URI to fix fetching

[Alexander Kanavin]

On 01/13/2017 05:36 PM, Joshua Lock wrote:


Running checkpkg on the autobuilders won't really help as the
autobuilders rely on the bitbake invocation returning a non-zero exit
code to determine whether to mark the build step as failed, and that's
not the case when checkpkg doesn't find an update version.

If we regularly run checkpkg on the autobuilders how should we detect
that a SRC_URI change has caused the upstream version check to fail?


- run bitbake -c checkpkg world
- inspect tmp/log/checkpkg.csv for lines with 'UNKNOWN' upstream status, 
make a list of recipes that have it
- compare that list against a stored list of exceptions (currently it 
would have about 32 entries), if the lists don't match exactly, the 
upstream version check has failed.


All of this can be wrapped in poky/scripts/upstream-check-all perhaps.

Alex
--
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH] zlib: update SRC_URI to fix fetching

[Joshua Lock]

On Fri, 2017-01-13 at 16:18 +0200, Alexander Kanavin wrote:
> On 01/13/2017 03:51 PM, Lock, Joshua G wrote:
> 
> > Noted, thanks. Do we maintain a list of things we'd like people to
> > check, and how to do it, when making updates to recipes?
> 
> I don't think there's such a list, perhaps we should make one and
> place 
> it in patch guidelines wiki.

I think we should, yes please.

> > checkpkg isn't available by default (had to add distrodata to
> > INHERITS)
> > and it took me a while to realise the results are written to a file
> > I
> > have to check. If we expect people to run these checks before
> > submitting updates we'd best make it as easy as possible to know
> > what
> > the checks are and how to run them.
> 
> I think this particular check should be automated and run in
> package_qa, 
> if it's okay to access the network in that step. Is it?

I don't think we should be accessing the network during package_qa.

> Alternatively, if checkuri is regularly run somewhere, then checkpkg 
> should be as well.

We run checkuri on the autobuilders and checkpkg is used by the recipe
report tool, though that's run less frequently. 

Running checkpkg on the autobuilders won't really help as the
autobuilders rely on the bitbake invocation returning a non-zero exit
code to determine whether to mark the build step as failed, and that's
not the case when checkpkg doesn't find an update version.

If we regularly run checkpkg on the autobuilders how should we detect
that a SRC_URI change has caused the upstream version check to fail?

Joshua
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Burton, Ross]

On 13 January 2017 at 15:09, Burton, Ross  wrote:

> On 13 January 2017 at 13:00, Ross Burton  wrote:
>
>> Patrick Ohly (8):
>>   recipes: anonymous functions with priorities
>>   build.py: add preceedtask() API
>>   runqueue.py: alternative rm_work scheduler
>>   gcc-source.inc: cleanly disable do_rm_work
>>   rm_work_and_downloads.bbclass: more aggressively minimize disk usage
>>   rm_work.bbclass: clean up sooner
>>   rootfs-postcommands.bbclass: sort passwd entries
>>   insane.bbclass: print license text as part of QA message
>>
>
> This was retracted so please drop these too!


Overly concise: the rm_work and bitbake changes have a v2 and are pending
bitbake patches, so all but the last two need to be dropped. The branch is
updated.

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Burton, Ross]

On 13 January 2017 at 13:00, Ross Burton  wrote:

> Patrick Ohly (8):
>   recipes: anonymous functions with priorities
>   build.py: add preceedtask() API
>   runqueue.py: alternative rm_work scheduler
>   gcc-source.inc: cleanly disable do_rm_work
>   rm_work_and_downloads.bbclass: more aggressively minimize disk usage
>   rm_work.bbclass: clean up sooner
>   rootfs-postcommands.bbclass: sort passwd entries
>   insane.bbclass: print license text as part of QA message
>

This was retracted so please drop these too!

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 4/5] lttng-tools: upgrade to 2.9.3

[Nathan Lynch]

Nathan Lynch  writes:
> "Burton, Ross"  writes:
>
>> This upgrade is failing on the autobuilders:
>>
>> DEBUG: Executing shell function do_install_ptest_base
>> install: failed to access
>> ‘TOPDIR/tmp/work/mips64-poky-linux/lttng-tools/2.9.3-r0/image/usr/lib/lttng-tools/ptest/tests/destructive’:
>> No such file or directory
>
> I'm unable to recreate this so far.  Any idea what's going on here?
>
> Here's the relevant code from the recipe's do_install_ptest:
>
> # Copy the tests directory tree and the executables and
> # Makefiles found within.
> for d in $(find "${B}/tests" -type d -not -name .libs -printf '%P ') ; do
> find "${B}/tests/$d" -maxdepth 1 -executable -type f \
> -exec install -D -t "${D}${PTEST_PATH}/tests/$d" {} +
> test -r "${B}/tests/$d/Makefile" && \
> install -D -t "${D}${PTEST_PATH}/tests/$d" 
> "${B}/tests/$d/Makefile"
> done
>
> And the contents of ${B}/tests/destructive/:
> -rwxr-xr-x. 3 nathanl nathanl 19298 Jan 12 10:42 Makefile
> -rwxr-xr-x. 3 nathanl nathanl  6547 Jan 12 10:44 metadata-regeneration
>
> I'm guessing it's something like a directory creation race but I can't
> see it.

This seems like a plausible explanation (a difference in install -D
behavior):

http://git.savannah.gnu.org/cgit/coreutils.git/commit/?id=6c65ce4c643b038c61bd332aab5ea87a75117273

I've got coreutils 8.25 here; I assume the version on the autobuilder is
older than that but newer than 6.2.

I'll verify this theory and likely respin to work around the old
coreutils.
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 1/2] rm_work.bbclass: allow preserving additional content

[Patrick Ohly]

Hello!

Please ignored the 1/2 in the subject. There's just one patch for
OE-core, the other one I had locally needs to go into meta-swupd.

-- 
Best Regards, Patrick Ohly

The content of this message is my personal opinion only and although
I am an employee of Intel, the statements I make here in no way
represent Intel's position on the issue, nor am I authorized to speak
on behalf of Intel on this matter.



-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 0/3] rm_work enhancements

[Patrick Ohly]

This is the OE-core side of the rm_work.bbclass enhancements. Depends
on the corresponding bitbake patch series. See the OE-core "rm_work +
pybootchart enhancements" mail thread for further information.

Changes since v1:
  - now based on the (tenative!) bb.event.RecipeTaskPreProcess instead
of prioritized anonymous functions
  - no need to change the scheduler, the "completion" scheduler now
has the enhanced implementation

Patrick Ohly (3):
  gcc-source.inc: cleanly disable do_rm_work
  rm_work_and_downloads.bbclass: more aggressively minimize disk usage
  rm_work.bbclass: clean up sooner

 meta/classes/rm_work.bbclass   | 31 ++
 meta/classes/rm_work_and_downloads.bbclass | 33 +++-
 meta/recipes-devtools/gcc/gcc-source.inc   |  2 +-
 3 files changed, 54 insertions(+), 12 deletions(-)
 create mode 100644 meta/classes/rm_work_and_downloads.bbclass

base-commit: acce512a0b85853b5acf2ef07e4163a3b4f33a98
-- 
git-series 0.9.1
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 2/3] rm_work_and_downloads.bbclass: more aggressively minimize disk usage

[Patrick Ohly]

rm_work.bbclass never deletes downloaded files, even if they are not
going to be needed again during the
build. rm_work_and_downloads.bbclass is more aggressive in minimizing
the used disk space during a build, but has other disadvantages:
- sources required by different recipes need to be fetched once per
  recipe, not once per build
- incremental builds do not work reliably because sources get
  removed without ensuring that sources gets fetched again

That makes rm_work_and_downloads.bbclass useful for one-time builds in
a constrained environment (like a CI system), but not for general use.

Signed-off-by: Patrick Ohly 
---
 meta/classes/rm_work_and_downloads.bbclass | 33 +++-
 1 file changed, 33 insertions(+)
 create mode 100644 meta/classes/rm_work_and_downloads.bbclass

diff --git a/meta/classes/rm_work_and_downloads.bbclass 
b/meta/classes/rm_work_and_downloads.bbclass
new file mode 100644
index 000..7c00bea
--- /dev/null
+++ b/meta/classes/rm_work_and_downloads.bbclass
@@ -0,0 +1,33 @@
+# Author:   Patrick Ohly 
+# Copyright:Copyright (C) 2015 Intel Corporation
+#
+# This file is licensed under the MIT license, see COPYING.MIT in
+# this source distribution for the terms.
+
+# This class is used like rm_work:
+# INHERIT += "rm_work_and_downloads"
+#
+# In addition to removing local build directories of a recipe, it also
+# removes the downloaded source. This is achieved by making the DL_DIR
+# recipe-specific. While reducing disk usage, it increases network usage (for
+# example, compiling the same source for target and host implies downloading
+# the source twice).
+#
+# Because the "do_fetch" task does not get re-run after removing the downloaded
+# sources, this class is also not suitable for incremental builds.
+#
+# Where it works well is in well-connected build environments with limited
+# disk space (like TravisCI).
+
+inherit rm_work
+
+# This would ensure that the existing do_rm_work() removes the downloads,
+# but does not work because some recipes have a circular dependency between
+# WORKDIR and DL_DIR (via ${SRCPV}?).
+# DL_DIR = "${WORKDIR}/downloads"
+
+# Instead go up one level and remove ourself.
+DL_DIR = "${BASE_WORKDIR}/${MULTIMACH_TARGET_SYS}/${PN}/downloads"
+do_rm_work_append () {
+rm -rf ${DL_DIR}
+}
-- 
git-series 0.9.1
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 3/3] rm_work.bbclass: clean up sooner

[Patrick Ohly]

Having do_rm_work depend on do_build had one major disadvantage:
do_build depends on the do_build of other recipes, to ensure that
runtime dependencies also get built. The effect is that when work on a
recipe is complete and it could get cleaned up, do_rm_work still
doesn't run because it waits for those other recipes, thus leading to
more temporary disk space usage than really needed.

The right solution is to inject do_rm_work before do_build and after
all tasks of the recipe. Achieving that depends on the new bitbake
bb.event.RecipeTaskPreProcess and bb.build.preceedtask().

It can't just run in an anonymous function, because other anonymous
functions that run later may add more tasks. There's still such a
potential conflict when some future RecipeTaskPreProcess event handler
also wants to change task dependencies, but that's not a problem
now. Should it ever occur, the two handlers will have to know about
each other and cooperate to resolve the conflict.

Benchmarking (see "rm_work + pybootchart enhancements" on the OE-core
mailing list) showed that builds with the modified rm_work.bbclass
were both faster (albeit not by much) and required considerably less
disk space (14230MiB instead of 18740MiB for core-image-sato).
Interestingly enough, builds with rm_work.bbclass were also faster
than those without.

Signed-off-by: Patrick Ohly 
---
 meta/classes/rm_work.bbclass | 31 ---
 1 file changed, 20 insertions(+), 11 deletions(-)

diff --git a/meta/classes/rm_work.bbclass b/meta/classes/rm_work.bbclass
index 3516c7e..fda7bd6 100644
--- a/meta/classes/rm_work.bbclass
+++ b/meta/classes/rm_work.bbclass
@@ -18,9 +18,6 @@ BB_SCHEDULER ?= "completion"
 # Run the rm_work task in the idle scheduling class
 BB_TASK_IONICE_LEVEL_task-rm_work = "3.0"
 
-RMWORK_ORIG_TASK := "${BB_DEFAULT_TASK}"
-BB_DEFAULT_TASK = "rm_work_all"
-
 do_rm_work () {
 # If the recipe name is in the RM_WORK_EXCLUDE, skip the recipe.
 for p in ${RM_WORK_EXCLUDE}; do
@@ -97,13 +94,6 @@ do_rm_work () {
 rm -f $i
 done
 }
-addtask rm_work after do_${RMWORK_ORIG_TASK}
-
-do_rm_work_all () {
-:
-}
-do_rm_work_all[recrdeptask] = "do_rm_work"
-addtask rm_work_all after do_rm_work
 
 do_populate_sdk[postfuncs] += "rm_work_populatesdk"
 rm_work_populatesdk () {
@@ -117,7 +107,13 @@ rm_work_rootfs () {
 }
 rm_work_rootfs[cleandirs] = "${WORKDIR}/rootfs"
 
-python () {
+# We have to add the do_rmwork task already now, because all tasks are
+# meant to be defined before the RecipeTaskPreProcess event triggers.
+# The inject_rm_work event handler then merely changes task dependencies.
+addtask do_rm_work
+addhandler inject_rm_work
+inject_rm_work[eventmask] = "bb.event.RecipeTaskPreProcess"
+python inject_rm_work() {
 if bb.data.inherits_class('kernel', d):
 d.appendVar("RM_WORK_EXCLUDE", ' ' + d.getVar("PN"))
 # If the recipe name is in the RM_WORK_EXCLUDE, skip the recipe.
@@ -126,4 +122,17 @@ python () {
 if pn in excludes:
 d.delVarFlag('rm_work_rootfs', 'cleandirs')
 d.delVarFlag('rm_work_populatesdk', 'cleandirs')
+else:
+# Inject do_rm_work into the tasks of the current recipe such that 
do_build
+# depends on it and that it runs after all other tasks that block 
do_build,
+# i.e. after all work on the current recipe is done. The reason for 
taking
+# this approach instead of making do_rm_work depend on do_build is that
+# do_build inherits additional runtime dependencies on
+# other recipes and thus will typically run much later than completion 
of
+# work in the recipe itself.
+deps = bb.build.preceedtask('do_build', True, d)
+if 'do_build' in deps:
+deps.remove('do_build')
+# In practice, addtask() here merely updates the dependencies.
+bb.build.addtask('do_rm_work', 'do_build', ' '.join(deps), d)
 }
-- 
git-series 0.9.1
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 1/3] gcc-source.inc: cleanly disable do_rm_work

[Patrick Ohly]

Using "deltask" assumes that do_rm_work has been added already, which
won't be the case anymore in the upcoming improved rm_work.bbclass,
because then an anonymous python method will add do_rm_work.

Setting RM_WORK_EXCLUDE works with the current and upcoming
rm_work.bbclass and is the API that is meant to be used for excluding
recipes from cleaning, so use that.

Signed-off-by: Patrick Ohly 
---
 meta/recipes-devtools/gcc/gcc-source.inc | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/gcc/gcc-source.inc 
b/meta/recipes-devtools/gcc/gcc-source.inc
index 49bde92..0d0edb5 100644
--- a/meta/recipes-devtools/gcc/gcc-source.inc
+++ b/meta/recipes-devtools/gcc/gcc-source.inc
@@ -3,7 +3,7 @@ deltask do_compile
 deltask do_install 
 deltask do_populate_sysroot
 deltask do_populate_lic 
-deltask do_rm_work
+RM_WORK_EXCLUDE += "${PN}"
 
 inherit nopackages
 
-- 
git-series 0.9.1
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 1/2] ccache: enable max size setup for ccache dir

[Burton, Ross]

On 13 January 2017 at 14:23, Yannick Gicquel 
wrote:

> +def init_ccache():
> +# dummy python version
> +return
> +
> +init_ccache() {
> +if [ -n "${CCACHE}" ]; then
> +${CCACHE} -M ${CCACHE_MAX_SIZE}
> +fi
> +}
> +
> +do_compile_prepend() {
> +init_ccache
> +}
>

That is horrible. :)

Is it not possible to just pass -M[size] to ccache every time it's
invoked?  If it needs to be invoked on its own, then a do_compile[postfunc]
or something to trim the size after a build would be neater.

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Burton, Ross]

On 13 January 2017 at 14:32, Bruce Ashfield 
wrote:

> oh, and is this one logged in bugzilla ? (or elsewhere, I don't care .. i
> just want to have a look
> at the proposed fix so I can start a musl build and see if I can fix
> things in the background).
>

It's not in bugzilla because the patch is still pending.

Discussion is in the "musl: Upgrade to 1.1.16+ on master" thread.  I think
musl's include/netinet/in.h needs to #define
__UAPI_DEF_IF_NET_DEVICE_FLAGS_LOWER_UP_DORMANT_ECHO 0.  Khem was going to
talk to musl maintainers to discuss fixing upstream first.

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Bruce Ashfield]

On Fri, Jan 13, 2017 at 9:25 AM, Burton, Ross  wrote:

>
> On 13 January 2017 at 14:19, Bruce Ashfield 
> wrote:
>
>> I'm not much good with musl unfortunately, but honestly, I'm wondering
>> how long we
>> can keep this out with relatively few build issues. In tree, they'll get
>> more attention.
>>
>
> This is a greater problem - the kernel guys seem to think that glibc is
> the only C library worth thinking about.  Khem took the action to talk with
> musl and get their headers fixed - which I believe is just adding a new
> #define to them.
>

oh, and is this one logged in bugzilla ? (or elsewhere, I don't care .. i
just want to have a look
at the proposed fix so I can start a musl build and see if I can fix things
in the background).

Bruce


>
> I'll continue stacking on 4.9 changes until they get sorted out.  I'll
>> probably have some
>> cycles near the end of next week to get lost in c library #ifdef's, if
>> the issues are still
>> around.
>>
>
> I keep on pushing the kernel bits to mut2, so feel free to send an updated
> branch and I can merge that in too.
>
> Ross
>



-- 
"Thou shalt not follow the NULL pointer, for chaos and madness await thee
at its end"
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Bruce Ashfield]

On Fri, Jan 13, 2017 at 9:25 AM, Burton, Ross  wrote:

>
> On 13 January 2017 at 14:19, Bruce Ashfield 
> wrote:
>
>> I'm not much good with musl unfortunately, but honestly, I'm wondering
>> how long we
>> can keep this out with relatively few build issues. In tree, they'll get
>> more attention.
>>
>
> This is a greater problem - the kernel guys seem to think that glibc is
> the only C library worth thinking about.  Khem took the action to talk with
> musl and get their headers fixed - which I believe is just adding a new
> #define to them.
>

And gcc is the only compiler! ;)

FWIW I spent 6 hours over the holidays trying to fix a musl build error,
but I have no
idea how its defines work, so all I did figure out is what kernel commit
broke it  ... to
be fair, glibc is just as nuts and it the uapi headers break it, I'm just
as lost.


>
> I'll continue stacking on 4.9 changes until they get sorted out.  I'll
>> probably have some
>> cycles near the end of next week to get lost in c library #ifdef's, if
>> the issues are still
>> around.
>>
>
> I keep on pushing the kernel bits to mut2, so feel free to send an updated
> branch and I can merge that in too.
>

ok. So I'll repost the series over the weekend with more -stable, -rt and
tools tweaks. It will
overlap the old one .. if that causes a problem, let me know now, and I'll
try and make sure
it starts where the other left off instead.

Bruce


>
> Ross
>



-- 
"Thou shalt not follow the NULL pointer, for chaos and madness await thee
at its end"
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Burton, Ross]

On 13 January 2017 at 14:19, Bruce Ashfield 
wrote:

> I'm not much good with musl unfortunately, but honestly, I'm wondering how
> long we
> can keep this out with relatively few build issues. In tree, they'll get
> more attention.
>

This is a greater problem - the kernel guys seem to think that glibc is the
only C library worth thinking about.  Khem took the action to talk with
musl and get their headers fixed - which I believe is just adding a new
#define to them.

I'll continue stacking on 4.9 changes until they get sorted out.  I'll
> probably have some
> cycles near the end of next week to get lost in c library #ifdef's, if the
> issues are still
> around.
>

I keep on pushing the kernel bits to mut2, so feel free to send an updated
branch and I can merge that in too.

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 1/2] rm_work.bbclass: allow preserving additional content

[Patrick Ohly]

By default, do_rm_work either skips recipes entirely (when listed in
RM_WORK_EXCLUDE) or removes everything except for temp.

In meta-swupd, virtual image recipes collaborate on producing update
data for the base recipe. Tasks running in the base recipe need some
information from the virtual images.

Those files could be passed via a new shared work directory, but that
scatters data in even more places. It's simpler to use the normal
WORKDIR and teach rm_work.bbclass to not remove the special output
with the new RM_WORK_EXCLUDE_ITEMS.

Signed-off-by: Patrick Ohly 
---
 meta/classes/rm_work.bbclass | 10 +-
 1 file changed, 9 insertions(+), 1 deletion(-)

diff --git a/meta/classes/rm_work.bbclass b/meta/classes/rm_work.bbclass
index 64b6981..1ec63b4 100644
--- a/meta/classes/rm_work.bbclass
+++ b/meta/classes/rm_work.bbclass
@@ -10,6 +10,14 @@
 #
 # RM_WORK_EXCLUDE += "icu-native icu busybox"
 #
+# Recipes can also configure which entries in their ${WORKDIR}
+# are preserved besides temp, which already gets excluded by default
+# because it contains logs:
+# do_install_append () {
+# echo "bar" >${WORKDIR}/foo
+# }
+# RM_WORK_EXCLUDE_ITEMS += "foo"
+RM_WORK_EXCLUDE_ITEMS = "temp"
 
 # Use the completion scheduler by default when rm_work is active
 # to try and reduce disk usage
@@ -37,7 +45,7 @@ do_rm_work () {
 # failures of removing pseudo folers on NFS2/3 server.
 if [ $dir = 'pseudo' ]; then
 rm -rf $dir 2> /dev/null || true
-elif [ $dir != 'temp' ]; then
+elif ! echo '${RM_WORK_EXCLUDE_ITEMS}' | grep -q -w "$dir"; then
 rm -rf $dir
 fi
 done
-- 
2.1.4

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 2/2] cmake.bbclass: enable usage of ccache

[Yannick Gicquel]

This allows ccache usage for recipes which inherit cmake.bbclass.
Since cmake v3.4, it can be enabled using some "-D" options.

Here below are some metrics while using it for webkitgtk recipe.
(machine is a 4x core i7 @ 3.4GHz)

$ bitbake -c fetchall webkitgtk
$ time bitbake webkitgtk

real56m25.191s
user359m32.003s
sys 34m49.356s

$ bitbake -c clean webkitgtk
$ bitbake -c cleansstate webkitgtk
$ time bitbake webkitgtk

real25m19.298s
user17m57.861s
sys 6m20.157s

Signed-off-by: Yannick Gicquel 
---
 meta/classes/cmake.bbclass | 14 +-
 1 file changed, 9 insertions(+), 5 deletions(-)

diff --git a/meta/classes/cmake.bbclass b/meta/classes/cmake.bbclass
index 9e74599..737a4e0 100644
--- a/meta/classes/cmake.bbclass
+++ b/meta/classes/cmake.bbclass
@@ -4,12 +4,9 @@ OECMAKE_SOURCEPATH ?= "${S}"
 DEPENDS_prepend = "cmake-native "
 B = "${WORKDIR}/build"
 
-# We need to unset CCACHE otherwise cmake gets too confused
-CCACHE = ""
-
 # C/C++ Compiler (without cpu arch/tune arguments)
-OECMAKE_C_COMPILER ?= "`echo ${CC} | sed 's/^\([^ ]*\).*/\1/'`"
-OECMAKE_CXX_COMPILER ?= "`echo ${CXX} | sed 's/^\([^ ]*\).*/\1/'`"
+OECMAKE_C_COMPILER ?= "${@'${CC}'.replace('${CCACHE}','',1).split(' ')[0]}"
+OECMAKE_CXX_COMPILER ?= "${@'${CXX}'.replace('${CCACHE}','',1).split(' ')[0]}"
 OECMAKE_AR ?= "${AR}"
 
 # Compiler flags
@@ -108,9 +105,16 @@ cmake_do_configure() {
OECMAKE_SITEFILE=""
fi
 
+   if [ -n "${CCACHE}" ]; then
+   OECMAKE_CCACHE="-DCMAKE_C_COMPILER_LAUNCHER=${CCACHE} 
-DCMAKE_CXX_COMPILER_LAUNCHER=${CCACHE}"
+   else
+   OECMAKE_CCACHE=""
+   fi
+
cmake \
  ${OECMAKE_SITEFILE} \
  ${OECMAKE_SOURCEPATH} \
+ ${OECMAKE_CCACHE} \
  -DCMAKE_INSTALL_PREFIX:PATH=${prefix} \
  -DCMAKE_INSTALL_BINDIR:PATH=${@os.path.relpath(d.getVar('bindir'), 
d.getVar('prefix'))} \
  -DCMAKE_INSTALL_SBINDIR:PATH=${@os.path.relpath(d.getVar('sbindir'), 
d.getVar('prefix'))} \
-- 
1.9.1

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 1/2] ccache: enable max size setup for ccache dir

[Yannick Gicquel]

ccache directories are limited to 1G by default.
This patch enables the configuration of their limits, and as default
location is TMPDIR, it proposes a size limit to "0" (unlimited).

The setup can be overloaded in local.conf by setting
CCACHE_MAX_SIZE to a custom value if needed.

Signed-off-by: Yannick Gicquel 
---
 meta/classes/ccache.bbclass | 15 +++
 1 file changed, 15 insertions(+)

diff --git a/meta/classes/ccache.bbclass b/meta/classes/ccache.bbclass
index 93fcaca..8a80040 100644
--- a/meta/classes/ccache.bbclass
+++ b/meta/classes/ccache.bbclass
@@ -1,6 +1,21 @@
 CCACHE = "${@bb.utils.which(d.getVar('PATH'), 'ccache') and 'ccache '}"
 export CCACHE_DIR ?= "${TMPDIR}/ccache/${MULTIMACH_HOST_SYS}/${PN}"
 CCACHE_DISABLE[unexport] = "1"
+CCACHE_MAX_SIZE ?= "0"
 
 do_configure[dirs] =+ "${CCACHE_DIR}"
 do_kernel_configme[dirs] =+ "${CCACHE_DIR}"
+
+def init_ccache():
+# dummy python version
+return
+
+init_ccache() {
+if [ -n "${CCACHE}" ]; then
+${CCACHE} -M ${CCACHE_MAX_SIZE}
+fi
+}
+
+do_compile_prepend() {
+init_ccache
+}
-- 
1.9.1

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Bruce Ashfield]

On Fri, Jan 13, 2017 at 9:16 AM, Jussi Kukkonen 
wrote:

> On 13 January 2017 at 15:39, Bruce Ashfield 
> wrote:
> >
> >
> >
> > On Fri, Jan 13, 2017 at 8:00 AM, Ross Burton 
> wrote:
> >>
> >> Hi,
> >>
> >> Another consolidated pull.  Last run on the AB was mostly green:
> >> - byacc on beaglebone-lsb failed (upgrade removed)
> >> - checkuri failed (transient, works now)
> >> - selftest failed (fixed in branch, tests work locally now)
> >
> >
> >
> > Should I re-send my kernel queue ? It is now about 13 patches long, and
> I'm stacking
> > a few more on every couple of days.
> >
> > I assume there are still some outstanding issues with the 4.9 kernel, or
> more specifically
> > the 4.9 kernel headers ?
> >
> > If there's a pointer to the list of issues, that would be great, so I
> can help prod things
> > along (assuming I can sort out the build issues .. c libraries give me
> headaches ;)
>
>
> There's at least the connman build issue on musl with 4.9 headers:
> http://errors.yoctoproject.org/Errors/Details/116506/
>

Ah ok.

I'm not much good with musl unfortunately, but honestly, I'm wondering how
long we
can keep this out with relatively few build issues. In tree, they'll get
more attention.

I'll continue stacking on 4.9 changes until they get sorted out.  I'll
probably have some
cycles near the end of next week to get lost in c library #ifdef's, if the
issues are still
around.

Bruce


>
> Musl defines IFF_LOWER_UP which breaks compilation with linux/if.h.
> kernel has uapi/linux/libc-compat.h for similar issues with glibc but at
> least currently it does not check for musl...
>
> See other discussion "musl: Upgrade to 1.1.16+ on master".
>
>  - Jussi
>
>
>


-- 
"Thou shalt not follow the NULL pointer, for chaos and madness await thee
at its end"
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH] zlib: update SRC_URI to fix fetching

[Alexander Kanavin]

On 01/13/2017 03:51 PM, Lock, Joshua G wrote:


Noted, thanks. Do we maintain a list of things we'd like people to
check, and how to do it, when making updates to recipes?


I don't think there's such a list, perhaps we should make one and place 
it in patch guidelines wiki.



checkpkg isn't available by default (had to add distrodata to INHERITS)
and it took me a while to realise the results are written to a file I
have to check. If we expect people to run these checks before
submitting updates we'd best make it as easy as possible to know what
the checks are and how to run them.


I think this particular check should be automated and run in package_qa, 
if it's okay to access the network in that step. Is it?


Alternatively, if checkuri is regularly run somewhere, then checkpkg 
should be as well.



Alex

--
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Jussi Kukkonen]

On 13 January 2017 at 15:39, Bruce Ashfield 
wrote:
>
>
>
> On Fri, Jan 13, 2017 at 8:00 AM, Ross Burton 
wrote:
>>
>> Hi,
>>
>> Another consolidated pull.  Last run on the AB was mostly green:
>> - byacc on beaglebone-lsb failed (upgrade removed)
>> - checkuri failed (transient, works now)
>> - selftest failed (fixed in branch, tests work locally now)
>
>
>
> Should I re-send my kernel queue ? It is now about 13 patches long, and
I'm stacking
> a few more on every couple of days.
>
> I assume there are still some outstanding issues with the 4.9 kernel, or
more specifically
> the 4.9 kernel headers ?
>
> If there's a pointer to the list of issues, that would be great, so I can
help prod things
> along (assuming I can sort out the build issues .. c libraries give me
headaches ;)


There's at least the connman build issue on musl with 4.9 headers:
http://errors.yoctoproject.org/Errors/Details/116506/

Musl defines IFF_LOWER_UP which breaks compilation with linux/if.h.
kernel has uapi/linux/libc-compat.h for similar issues with glibc but at
least currently it does not check for musl...

See other discussion "musl: Upgrade to 1.1.16+ on master".

 - Jussi
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH] zlib: update SRC_URI to fix fetching

[Joshua Lock]

> On Fri, 2017-01-13 at 15:00 +0200, Alexander Kanavin wrote:
> On 01/09/2017 02:56 PM, Alexander Kanavin wrote:
> > On 01/05/2017 06:34 PM, Joshua Lock wrote:
> > > Upstream have removed the file from zlib.net as a new version has
> > > been released, switch to fetching from the official sourceforge
> > > mirror.
> > > 
> > > [YOCTO #10879]
> > 
> > If a new version has been released, you should also update to that
> > version. Also, does upstream version check (-c checkpkg) still work
> > with
> > the new SRC_URI?
> 
> Actually it doesn't, accordingly we have no way of knowing if zlib
> has a 
> new version upstream. Please do check these things when you update
> SRC_URI.

Noted, thanks. Do we maintain a list of things we'd like people to
check, and how to do it, when making updates to recipes?

checkpkg isn't available by default (had to add distrodata to INHERITS)
and it took me a while to realise the results are written to a file I
have to check. If we expect people to run these checks before
submitting updates we'd best make it as easy as possible to know what
the checks are and how to run them.

The only reference I can find to checkpkg on the OE and YP wikis is
here:

https://wiki.yoctoproject.org/wiki/How_do_I#Q:_How_do_I_ensure_that_I_a
m_using_the_latest_upstream_version_of_the_package.3F

Joshua
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Bruce Ashfield]

On Fri, Jan 13, 2017 at 8:00 AM, Ross Burton  wrote:

> Hi,
>
> Another consolidated pull.  Last run on the AB was mostly green:
> - byacc on beaglebone-lsb failed (upgrade removed)
> - checkuri failed (transient, works now)
> - selftest failed (fixed in branch, tests work locally now)
>


Should I re-send my kernel queue ? It is now about 13 patches long, and I'm
stacking
a few more on every couple of days.

I assume there are still some outstanding issues with the 4.9 kernel, or
more specifically
the 4.9 kernel headers ?

If there's a pointer to the list of issues, that would be great, so I can
help prod things
along (assuming I can sort out the build issues .. c libraries give me
headaches ;)

Cheers,

Bruce


>
> Ross
>
> The following changes since commit 29423274b1ff04e779f00aa6aae7db
> aa7ce89226:
>
>   bitbake: gitsm.py: Add force flag to git checkout command in
> update_submodules (2017-01-12 17:48:12 +)
>
> are available in the git repository at:
>
>   ssh://g...@git.yoctoproject.org/poky-contrib ross/mut
>
> for you to fetch changes up to b1f6b2b8c185b446be83b030e6f01b2c390f5716:
>
>   mpc8315e-rdb: move wks file to wic/ directory (2017-01-13 12:56:42 +)
>
> 
> Alejandro Hernandez (3):
>   gummiboot: Remove gummiboot tests
>   gummiboot: Remove old gummiboot recipe, related class and wks file
>   systemd-boot.bbclass: Fix SYSYTEMD_BOOT_CFG creation
>
> Alejandro del Castillo (2):
>   opkg: upgrade to v0.3.4
>   opkg-utils: bump SRCREV to 0.3.4 tag
>
> Alistair Francis (1):
>   runqemu: Allow the user to specity no kernel or rootFS
>
> Amarnath Valluri (2):
>   kernel: Modify kernel modules installation path.
>   linux-firmware: Modify firmware installation path
>
> Andre McCurdy (1):
>   wayland: minor recipe cleanup
>
> Andreas Müller (1):
>   python3-pygobject: add PACKAGECONFIG for cairo - enabled by default
>
> André Draszik (2):
>   lib/oe/rootfs: reliably handle alternative symlinks
>   opkg-utils: use D instead of OPKG_OFFLINE_ROOT in postrm
>
> Chen Qi (9):
>   systemd-bootchart: upgrade to 231
>   dbus/dbus-test: upgrade to 1.10.14
>   sysstat: upgrade to 11.5.3
>   grep: upgrade to 2.27
>   coreutils: upgrade to 8.26
>   selftest/eSDK.py: fix sstate dir not found error
>   selftest/bbtests.py: fix path assumption for LICENSE_DIRECTORY
>   selftest/buildoptions.py: fix path assumption for DEPLOY_DIR_SRC
>   scripts/oe-selftest: fix typo
>
> Christoph Settgast (1):
>   libdrm: enable etnaviv experimental support
>
> Derek Straka (1):
>   python-3.5-manifest: Add http module to the netclient package
>
> Ed Bartosh (11):
>   image_types.bbclass: look for wks files in /wic
>   beaglebone: add beaglebone.wks
>   wic: fix parsing of 'bitbake -e' output
>   canned-wks: remove mpc8315e-rdb.wks
>   direct.py: fix getting image name
>   wic: _exec_cmd: produce error if exit code is not 0
>   mpc8315e-rdb.conf: produce wic images for MPC8315
>   genericx86: add genericx86.wks
>   edgerouter: add edgerouter.wks
>   README.hardware: update MPC8315E-RDB section
>   mpc8315e-rdb: move wks file to wic/ directory
>
> Haiqing Bai (1):
>   kexec: ARM: fix align issue of add_buffer_phys_virt() for LPAE kernel
>
> Ioan-Adrian Ratiu (1):
>   wic/isoimage-isohybrid: remove do_stage_partition()
>
> Jose Perez Carranza (1):
>   runtime: Add cleanup for logrotate tests
>
> Juro Bystricky (1):
>   build-appliance-image: support for Toaster
>
> Khem Raj (2):
>   musl: Upgrade to 1.1.16+ on master
>   grub-git: Upgrade to tip of master and fix with glibc 2.25
>
> Leonardo Sandoval (3):
>   recipes-test: exclude recipes from world target
>   selftest: devtool: use distro agnostic recipes for devtool checks
>   selftest: runtime-test: skip image-install test for poky-tiny
>
> Linus Wallgren (1):
>   apt-package: Include maintenance scripts
>
> Mark Asselstine (1):
>   sysklogd: do more to properly work with systemd
>
> Markus Lehtonen (10):
>   oeqa.utils.metadata: re-organise host distro information
>   oeqa.utils.metadata: re-organise distro information
>   oeqa.utils.metadata: drop 'unknown' git data elements
>   oeqa.utils.metadata: fix retrieval of git branch and revision
>   oeqa.utils.metadata: rename 'revision' to 'commit'
>   oeqa.utils.metadata: add commit count information
>   oeqa.utils.metadata: have layer name as an attribute in xml
>   oeqa.utils.metadata: add bitbake revision information
>   oeqa.utils.metadata: allow storing any bitbake config variables
>   oeqa.utils.metadata: include BB_NUMBER_THREADS and PARALLEL_MAKE
>
> Maxin B. John (1):
>   sqlite3: upgrade to 3.16.2
>
> Ola x Nilsson (2):
>   externalsrc.bbclass: Add task buildclean
>   oe-selftest: devtool: Add test for 

Re: [OE-core] [PATCH v2 1/7] image-live-artifacts: Add support for creating image artifacts only

[Ylinen, Mikko]

On Fri, Jan 13, 2017 at 12:34 AM, Alejandro Hernandez <
alejandro.hernan...@linux.intel.com> wrote:

[snip]

>
> Not as far as I know, but so that would work when building something AND
> the artifacts, but what if you want to build the artifacts only?, you would
> have to build everything else as well wouldn't you?
>

My only feedback was: we could target something that gives the necessary
artifacts
without depending on any other IMAGE_FSTYPES than wic (and I was assuming
wic
is the reason why the patch exists).

Currently, for example, all "live" artifacts (including rootfs.img) are
built first to get a
wic image created. The same applies with this patch still: one would need
to specify
another image type first to get the artifacts to get wic image type built.
Furthermore, that
image type would give unnecessary build dependencies (depending on your
configuration).

It can also be argued whether the build_*_cfg() are needed here because the
wic source
plugins write their own configs.

The desired outcome (IMO) would be independent from "live" (naming wise
also).

-- Mikko
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 00/80] Consolidated pull

[Burton, Ross]

On 13 January 2017 at 13:00, Ross Burton  wrote:

> Markus Lehtonen (10):
>   oeqa.utils.metadata: re-organise host distro information
>   oeqa.utils.metadata: re-organise distro information
>   oeqa.utils.metadata: drop 'unknown' git data elements
>   oeqa.utils.metadata: fix retrieval of git branch and revision
>   oeqa.utils.metadata: rename 'revision' to 'commit'
>   oeqa.utils.metadata: add commit count information
>   oeqa.utils.metadata: have layer name as an attribute in xml
>   oeqa.utils.metadata: add bitbake revision information
>   oeqa.utils.metadata: allow storing any bitbake config variables
>   oeqa.utils.metadata: include BB_NUMBER_THREADS and PARALLEL_MAKE
>

Markus just sent a V2, so please drop these.  I'll remove them from my
branch shortly.

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 09/10] oeqa.utils.metadata: allow storing any bitbake config variables

[Markus Lehtonen]

Make it possible to store any bitbake config variables in the metadata.
Config values will be stored under a new config element in the xml report:

qemux86


The value of MACHINE is moved there instead of having a dedicated
 element.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 12 +---
 scripts/oe-selftest |  4 ++--
 2 files changed, 11 insertions(+), 5 deletions(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index a3c1b2b..08d8198 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -29,14 +29,13 @@ def metadata_from_bb():
 
 Data will be gathered using bitbake -e thanks to get_bb_vars.
 """
+metadata_config_vars = ('MACHINE')
 
 info_dict = OrderedDict()
 hostname = runCmd('hostname')
 info_dict['hostname'] = hostname.output
 data_dict = get_bb_vars()
 
-info_dict['machine'] = data_dict['MACHINE']
-
 # Distro information
 info_dict['distro'] = {'id': data_dict['DISTRO'],
'version_id': data_dict['DISTRO_VERSION'],
@@ -52,6 +51,10 @@ def metadata_from_bb():
 
 info_dict['layers'] = get_layers(data_dict['BBLAYERS'])
 info_dict['bitbake'] = git_rev_info(os.path.dirname(bb.__file__))
+
+info_dict['config'] = OrderedDict()
+for var in sorted(metadata_config_vars):
+info_dict['config'][var] = data_dict[var]
 return info_dict
 
 def metadata_from_data_store(d):
@@ -106,7 +109,10 @@ def dict_to_XML(tag, dictionary, **kwargs):
 elif isinstance(val, MutableMapping):
 child = (dict_to_XML(key, val))
 else:
-child = Element(key)
+if tag == 'config':
+child = Element('variable', name=key)
+else:
+child = Element(key)
 child.text = str(val)
 elem.append(child)
 return elem
diff --git a/scripts/oe-selftest b/scripts/oe-selftest
index be63d5e..e33ca85 100755
--- a/scripts/oe-selftest
+++ b/scripts/oe-selftest
@@ -604,7 +604,7 @@ def main():
 l_branches = {str(branch) for branch in repo.branches}
 branch = '%s/%s/%s' % (metadata['hostname'],
metadata['layers']['meta'].get('branch', 
'(nogit)'),
-   metadata['machine'])
+   metadata['config']['MACHINE'])
 
 if branch in l_branches:
 log.debug('Found branch in local repository, checking out')
@@ -634,7 +634,7 @@ def main():
   values.get('branch', '(nogit)'), 
values.get('commit', '0'*40))
 msg = 'Selftest for build %s of %s for machine %s on %s\n\n%s' % (
log_prefix[12:], metadata['distro']['pretty_name'],
-   metadata['machine'], metadata['hostname'], layer_info)
+   metadata['config']['MACHINE'], metadata['hostname'], 
layer_info)
 
 log.debug('Commiting results to local repository')
 repo.index.commit(msg)
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 10/10] oeqa.utils.metadata: include BB_NUMBER_THREADS and PARALLEL_MAKE

[Markus Lehtonen]

Inlude values of BB_NUMBER_THREADS and PARALLEL_MAKE in the metadata.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index 08d8198..cb81155 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -29,7 +29,7 @@ def metadata_from_bb():
 
 Data will be gathered using bitbake -e thanks to get_bb_vars.
 """
-metadata_config_vars = ('MACHINE')
+metadata_config_vars = ('MACHINE', 'BB_NUMBER_THREADS', 'PARALLEL_MAKE')
 
 info_dict = OrderedDict()
 hostname = runCmd('hostname')
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 06/10] oeqa.utils.metadata: add commit count information

[Markus Lehtonen]

Makes it easier to put the commits into a timeline.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index 2f7e8f2..d5cc290 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -63,7 +63,7 @@ def metadata_from_data_store(d):
 pass
 
 def get_layers(layers):
-""" Returns layer name, branch, and revision as OrderedDict. """
+"""Returns layer information in dict format"""
 from git import Repo, InvalidGitRepositoryError, NoSuchPathError
 
 layer_dict = OrderedDict()
@@ -75,6 +75,7 @@ def get_layers(layers):
 except (InvalidGitRepositoryError, NoSuchPathError):
 continue
 layer_dict[layer_name]['commit'] = repo.head.commit.hexsha
+layer_dict[layer_name]['commit_count'] = repo.head.commit.count()
 try:
 layer_dict[layer_name]['branch'] = repo.active_branch.name
 except TypeError:
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 08/10] oeqa.utils.metadata: add bitbake revision information

[Markus Lehtonen]

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 32 +++-
 1 file changed, 19 insertions(+), 13 deletions(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index 6331c21..a3c1b2b 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -51,6 +51,7 @@ def metadata_from_bb():
 info_dict['host_distro'][key] = os_release[key]
 
 info_dict['layers'] = get_layers(data_dict['BBLAYERS'])
+info_dict['bitbake'] = git_rev_info(os.path.dirname(bb.__file__))
 return info_dict
 
 def metadata_from_data_store(d):
@@ -62,24 +63,29 @@ def metadata_from_data_store(d):
 # be useful when running within bitbake.
 pass
 
-def get_layers(layers):
-"""Returns layer information in dict format"""
+def git_rev_info(path):
+"""Get git revision information as a dict"""
 from git import Repo, InvalidGitRepositoryError, NoSuchPathError
 
+info = OrderedDict()
+try:
+repo = Repo(path, search_parent_directories=True)
+except (InvalidGitRepositoryError, NoSuchPathError):
+return info
+info['commit'] = repo.head.commit.hexsha
+info['commit_count'] = repo.head.commit.count()
+try:
+info['branch'] = repo.active_branch.name
+except TypeError:
+info['branch'] = '(nobranch)'
+return info
+
+def get_layers(layers):
+"""Returns layer information in dict format"""
 layer_dict = OrderedDict()
 for layer in layers.split():
 layer_name = os.path.basename(layer)
-layer_dict[layer_name] = OrderedDict()
-try:
-repo = Repo(layer, search_parent_directories=True)
-except (InvalidGitRepositoryError, NoSuchPathError):
-continue
-layer_dict[layer_name]['commit'] = repo.head.commit.hexsha
-layer_dict[layer_name]['commit_count'] = repo.head.commit.count()
-try:
-layer_dict[layer_name]['branch'] = repo.active_branch.name
-except TypeError:
-layer_dict[layer_name]['branch'] = '(nobranch)'
+layer_dict[layer_name] = git_rev_info(layer)
 return layer_dict
 
 def write_metadata_file(file_path, metadata):
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 07/10] oeqa.utils.metadata: have layer name as an attribute in xml

[Markus Lehtonen]

Have the layer name as an attribute instead of of the name of the
element itself. That is, have  instead of
. A bit better XML design.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 8 +---
 1 file changed, 5 insertions(+), 3 deletions(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index d5cc290..6331c21 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -90,12 +90,14 @@ def write_metadata_file(file_path, metadata):
 with open(file_path, 'w') as f:
 f.write(xml_doc.toprettyxml())
 
-def dict_to_XML(tag, dictionary):
+def dict_to_XML(tag, dictionary, **kwargs):
 """ Return XML element converting dicts recursively. """
 
-elem = Element(tag)
+elem = Element(tag, **kwargs)
 for key, val in dictionary.items():
-if isinstance(val, MutableMapping):
+if tag == 'layers':
+child = (dict_to_XML('layer', val, name=key))
+elif isinstance(val, MutableMapping):
 child = (dict_to_XML(key, val))
 else:
 child = Element(key)
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 02/10] oeqa.utils.metadata: re-organise distro information

[Markus Lehtonen]

Use the same format, based on /etc/os-release, as for host distro
information.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 17 ++---
 scripts/oe-selftest |  4 ++--
 2 files changed, 12 insertions(+), 9 deletions(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index 2316841..df6ed91 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -10,9 +10,7 @@ from collections.abc import MutableMapping
 from xml.dom.minidom import parseString
 from xml.etree.ElementTree import Element, tostring
 
-from oeqa.utils.commands import runCmd, get_bb_var, get_bb_vars
-
-metadata_vars = ['MACHINE', 'DISTRO', 'DISTRO_VERSION']
+from oeqa.utils.commands import runCmd, get_bb_vars
 
 def get_os_release():
 """Get info from /etc/os-release as a dict"""
@@ -35,9 +33,14 @@ def metadata_from_bb():
 info_dict = OrderedDict()
 hostname = runCmd('hostname')
 info_dict['hostname'] = hostname.output
-data_dict = get_bb_vars(metadata_vars)
-for var in metadata_vars:
-info_dict[var.lower()] = data_dict[var]
+data_dict = get_bb_vars()
+
+info_dict['machine'] = data_dict['MACHINE']
+
+# Distro information
+info_dict['distro'] = {'id': data_dict['DISTRO'],
+   'version_id': data_dict['DISTRO_VERSION'],
+   'pretty_name': '%s %s' % (data_dict['DISTRO'], 
data_dict['DISTRO_VERSION'])}
 
 # Host distro information
 os_release = get_os_release()
@@ -47,7 +50,7 @@ def metadata_from_bb():
 if key in os_release:
 info_dict['host_distro'][key] = os_release[key]
 
-info_dict['layers'] = get_layers(get_bb_var('BBLAYERS'))
+info_dict['layers'] = get_layers(data_dict['BBLAYERS'])
 return info_dict
 
 def metadata_from_data_store(d):
diff --git a/scripts/oe-selftest b/scripts/oe-selftest
index adfa92f..5510410 100755
--- a/scripts/oe-selftest
+++ b/scripts/oe-selftest
@@ -632,8 +632,8 @@ def main():
 for layer, values in metadata['layers'].items():
 layer_info = '%s%-17s = %s:%s\n' % (layer_info, layer,
   values['branch'], values['revision'])
-msg = 'Selftest for build %s of %s %s for machine %s on %s\n\n%s' 
% (
-   log_prefix[12:], metadata['distro'], 
metadata['distro_version'],
+msg = 'Selftest for build %s of %s for machine %s on %s\n\n%s' % (
+   log_prefix[12:], metadata['distro']['pretty_name'],
metadata['machine'], metadata['hostname'], layer_info)
 
 log.debug('Commiting results to local repository')
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 05/10] oeqa.utils.metadata: rename 'revision' to 'commit'

[Markus Lehtonen]

Revision is a bit vague and could point to a tag, for example. Git
commit objects are unambiguous and persistent so be explicit that the
element should contain git commit hash.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 2 +-
 scripts/oe-selftest | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index b732d37..2f7e8f2 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -74,7 +74,7 @@ def get_layers(layers):
 repo = Repo(layer, search_parent_directories=True)
 except (InvalidGitRepositoryError, NoSuchPathError):
 continue
-layer_dict[layer_name]['revision'] = repo.head.commit.hexsha
+layer_dict[layer_name]['commit'] = repo.head.commit.hexsha
 try:
 layer_dict[layer_name]['branch'] = repo.active_branch.name
 except TypeError:
diff --git a/scripts/oe-selftest b/scripts/oe-selftest
index a2298a3..be63d5e 100755
--- a/scripts/oe-selftest
+++ b/scripts/oe-selftest
@@ -631,7 +631,7 @@ def main():
 layer_info = ''
 for layer, values in metadata['layers'].items():
 layer_info = '%s%-17s = %s:%s\n' % (layer_info, layer,
-  values.get('branch', '(nogit)'), 
values.get('revision', '0'*40))
+  values.get('branch', '(nogit)'), 
values.get('commit', '0'*40))
 msg = 'Selftest for build %s of %s for machine %s on %s\n\n%s' % (
log_prefix[12:], metadata['distro']['pretty_name'],
metadata['machine'], metadata['hostname'], layer_info)
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 04/10] oeqa.utils.metadata: fix retrieval of git branch and revision

[Markus Lehtonen]

Always return a valid branch name, or, '(nobranch)' if the current HEAD
is detached. Also, always return the hash of the commit object that HEAD
is pointing to. Previous code returned an incorrect branch name (or
crashed) e.g. in the case of detached HEAD.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 8 +---
 1 file changed, 5 insertions(+), 3 deletions(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index a389c6a..b732d37 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -72,11 +72,13 @@ def get_layers(layers):
 layer_dict[layer_name] = OrderedDict()
 try:
 repo = Repo(layer, search_parent_directories=True)
-revision, branch = repo.head.object.name_rev.split()
 except (InvalidGitRepositoryError, NoSuchPathError):
 continue
-layer_dict[layer_name]['branch'] = branch
-layer_dict[layer_name]['revision'] = revision
+layer_dict[layer_name]['revision'] = repo.head.commit.hexsha
+try:
+layer_dict[layer_name]['branch'] = repo.active_branch.name
+except TypeError:
+layer_dict[layer_name]['branch'] = '(nobranch)'
 return layer_dict
 
 def write_metadata_file(file_path, metadata):
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 03/10] oeqa.utils.metadata: drop 'unknown' git data elements

[Markus Lehtonen]

It's better just to not have the xml elements than to have elements with
faux data. One could have git branch named 'unknown', for example.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 7 +++
 scripts/oe-selftest | 4 ++--
 2 files changed, 5 insertions(+), 6 deletions(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index df6ed91..a389c6a 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -73,11 +73,10 @@ def get_layers(layers):
 try:
 repo = Repo(layer, search_parent_directories=True)
 revision, branch = repo.head.object.name_rev.split()
-layer_dict[layer_name]['branch'] = branch
-layer_dict[layer_name]['revision'] = revision
 except (InvalidGitRepositoryError, NoSuchPathError):
-layer_dict[layer_name]['branch'] = 'unknown'
-layer_dict[layer_name]['revision'] = 'unknown'
+continue
+layer_dict[layer_name]['branch'] = branch
+layer_dict[layer_name]['revision'] = revision
 return layer_dict
 
 def write_metadata_file(file_path, metadata):
diff --git a/scripts/oe-selftest b/scripts/oe-selftest
index 5510410..a2298a3 100755
--- a/scripts/oe-selftest
+++ b/scripts/oe-selftest
@@ -603,7 +603,7 @@ def main():
 r_branches = set(r_branches.replace('origin/', '').split())
 l_branches = {str(branch) for branch in repo.branches}
 branch = '%s/%s/%s' % (metadata['hostname'],
-   metadata['layers']['meta']['branch'],
+   metadata['layers']['meta'].get('branch', 
'(nogit)'),
metadata['machine'])
 
 if branch in l_branches:
@@ -631,7 +631,7 @@ def main():
 layer_info = ''
 for layer, values in metadata['layers'].items():
 layer_info = '%s%-17s = %s:%s\n' % (layer_info, layer,
-  values['branch'], values['revision'])
+  values.get('branch', '(nogit)'), 
values.get('revision', '0'*40))
 msg = 'Selftest for build %s of %s for machine %s on %s\n\n%s' % (
log_prefix[12:], metadata['distro']['pretty_name'],
metadata['machine'], metadata['hostname'], layer_info)
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 00/10] oeqa.utils.metadata: update xml schema

[Markus Lehtonen]

Changes since v1:
- import of git module moved back to function level
- two new patches regarding config variables


The following changes since commit acce512a0b85853b5acf2ef07e4163a3b4f33a98:

  selftest/devtool: update test to work with new mtd-utils (2017-01-09 13:34:32 
+)

are available in the git repository at:

  git://git.openembedded.org/openembedded-core-contrib marquiz/oeqa-metaxml
  
http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/oeqa-metaxml


Markus Lehtonen (10):
  oeqa.utils.metadata: re-organise host distro information
  oeqa.utils.metadata: re-organise distro information
  oeqa.utils.metadata: drop 'unknown' git data elements
  oeqa.utils.metadata: fix retrieval of git branch and revision
  oeqa.utils.metadata: rename 'revision' to 'commit'
  oeqa.utils.metadata: add commit count information
  oeqa.utils.metadata: have layer name as an attribute in xml
  oeqa.utils.metadata: add bitbake revision information
  oeqa.utils.metadata: allow storing any bitbake config variables
  oeqa.utils.metadata: include BB_NUMBER_THREADS and PARALLEL_MAKE

 meta/lib/oeqa/utils/metadata.py | 87 +
 scripts/oe-selftest | 12 +++---
 2 files changed, 67 insertions(+), 32 deletions(-)

-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH v2 01/10] oeqa.utils.metadata: re-organise host distro information

[Markus Lehtonen]

Put all host distro data under one  element. In addition
take the data directly from /etc/os-release instead of the "lsb API".
The /etc/os-release file is virtually ubiquitous, now, and using its
field names and values provides a more standardized and extensible
format.

[YOCTO #10590]

Signed-off-by: Markus Lehtonen 
---
 meta/lib/oeqa/utils/metadata.py | 26 +-
 1 file changed, 21 insertions(+), 5 deletions(-)

diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py
index 5d8bf84..2316841 100644
--- a/meta/lib/oeqa/utils/metadata.py
+++ b/meta/lib/oeqa/utils/metadata.py
@@ -10,11 +10,22 @@ from collections.abc import MutableMapping
 from xml.dom.minidom import parseString
 from xml.etree.ElementTree import Element, tostring
 
-from oe.lsb import distro_identifier
 from oeqa.utils.commands import runCmd, get_bb_var, get_bb_vars
 
 metadata_vars = ['MACHINE', 'DISTRO', 'DISTRO_VERSION']
 
+def get_os_release():
+"""Get info from /etc/os-release as a dict"""
+data = OrderedDict()
+os_release_file = '/etc/os-release'
+if not os.path.exists(os_release_file):
+return None
+with open(os_release_file) as fobj:
+for line in fobj:
+key, value = line.split('=', 1)
+data[key.strip().lower()] = value.strip().strip('"')
+return data
+
 def metadata_from_bb():
 """ Returns test's metadata as OrderedDict.
 
@@ -27,10 +38,15 @@ def metadata_from_bb():
 data_dict = get_bb_vars(metadata_vars)
 for var in metadata_vars:
 info_dict[var.lower()] = data_dict[var]
-host_distro= distro_identifier()
-host_distro, _, host_distro_release = host_distro.partition('-')
-info_dict['host_distro'] = host_distro
-info_dict['host_distro_release'] = host_distro_release
+
+# Host distro information
+os_release = get_os_release()
+if os_release:
+info_dict['host_distro'] = OrderedDict()
+for key in ('id', 'version_id', 'pretty_name'):
+if key in os_release:
+info_dict['host_distro'][key] = os_release[key]
+
 info_dict['layers'] = get_layers(get_bb_var('BBLAYERS'))
 return info_dict
 
-- 
2.6.6

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH] zlib: update SRC_URI to fix fetching

[Alexander Kanavin]

On 01/09/2017 02:56 PM, Alexander Kanavin wrote:

On 01/05/2017 06:34 PM, Joshua Lock wrote:

Upstream have removed the file from zlib.net as a new version has
been released, switch to fetching from the official sourceforge
mirror.

[YOCTO #10879]


If a new version has been released, you should also update to that
version. Also, does upstream version check (-c checkpkg) still work with
the new SRC_URI?


Actually it doesn't, accordingly we have no way of knowing if zlib has a 
new version upstream. Please do check these things when you update SRC_URI.


Alex

--
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 00/80] Consolidated pull

[Ross Burton]

Hi,

Another consolidated pull.  Last run on the AB was mostly green:
- byacc on beaglebone-lsb failed (upgrade removed)
- checkuri failed (transient, works now)
- selftest failed (fixed in branch, tests work locally now)

Ross

The following changes since commit 29423274b1ff04e779f00aa6aae7dbaa7ce89226:

  bitbake: gitsm.py: Add force flag to git checkout command in 
update_submodules (2017-01-12 17:48:12 +)

are available in the git repository at:

  ssh://g...@git.yoctoproject.org/poky-contrib ross/mut

for you to fetch changes up to b1f6b2b8c185b446be83b030e6f01b2c390f5716:

  mpc8315e-rdb: move wks file to wic/ directory (2017-01-13 12:56:42 +)


Alejandro Hernandez (3):
  gummiboot: Remove gummiboot tests
  gummiboot: Remove old gummiboot recipe, related class and wks file
  systemd-boot.bbclass: Fix SYSYTEMD_BOOT_CFG creation

Alejandro del Castillo (2):
  opkg: upgrade to v0.3.4
  opkg-utils: bump SRCREV to 0.3.4 tag

Alistair Francis (1):
  runqemu: Allow the user to specity no kernel or rootFS

Amarnath Valluri (2):
  kernel: Modify kernel modules installation path.
  linux-firmware: Modify firmware installation path

Andre McCurdy (1):
  wayland: minor recipe cleanup

Andreas Müller (1):
  python3-pygobject: add PACKAGECONFIG for cairo - enabled by default

André Draszik (2):
  lib/oe/rootfs: reliably handle alternative symlinks
  opkg-utils: use D instead of OPKG_OFFLINE_ROOT in postrm

Chen Qi (9):
  systemd-bootchart: upgrade to 231
  dbus/dbus-test: upgrade to 1.10.14
  sysstat: upgrade to 11.5.3
  grep: upgrade to 2.27
  coreutils: upgrade to 8.26
  selftest/eSDK.py: fix sstate dir not found error
  selftest/bbtests.py: fix path assumption for LICENSE_DIRECTORY
  selftest/buildoptions.py: fix path assumption for DEPLOY_DIR_SRC
  scripts/oe-selftest: fix typo

Christoph Settgast (1):
  libdrm: enable etnaviv experimental support

Derek Straka (1):
  python-3.5-manifest: Add http module to the netclient package

Ed Bartosh (11):
  image_types.bbclass: look for wks files in /wic
  beaglebone: add beaglebone.wks
  wic: fix parsing of 'bitbake -e' output
  canned-wks: remove mpc8315e-rdb.wks
  direct.py: fix getting image name
  wic: _exec_cmd: produce error if exit code is not 0
  mpc8315e-rdb.conf: produce wic images for MPC8315
  genericx86: add genericx86.wks
  edgerouter: add edgerouter.wks
  README.hardware: update MPC8315E-RDB section
  mpc8315e-rdb: move wks file to wic/ directory

Haiqing Bai (1):
  kexec: ARM: fix align issue of add_buffer_phys_virt() for LPAE kernel

Ioan-Adrian Ratiu (1):
  wic/isoimage-isohybrid: remove do_stage_partition()

Jose Perez Carranza (1):
  runtime: Add cleanup for logrotate tests

Juro Bystricky (1):
  build-appliance-image: support for Toaster

Khem Raj (2):
  musl: Upgrade to 1.1.16+ on master
  grub-git: Upgrade to tip of master and fix with glibc 2.25

Leonardo Sandoval (3):
  recipes-test: exclude recipes from world target
  selftest: devtool: use distro agnostic recipes for devtool checks
  selftest: runtime-test: skip image-install test for poky-tiny

Linus Wallgren (1):
  apt-package: Include maintenance scripts

Mark Asselstine (1):
  sysklogd: do more to properly work with systemd

Markus Lehtonen (10):
  oeqa.utils.metadata: re-organise host distro information
  oeqa.utils.metadata: re-organise distro information
  oeqa.utils.metadata: drop 'unknown' git data elements
  oeqa.utils.metadata: fix retrieval of git branch and revision
  oeqa.utils.metadata: rename 'revision' to 'commit'
  oeqa.utils.metadata: add commit count information
  oeqa.utils.metadata: have layer name as an attribute in xml
  oeqa.utils.metadata: add bitbake revision information
  oeqa.utils.metadata: allow storing any bitbake config variables
  oeqa.utils.metadata: include BB_NUMBER_THREADS and PARALLEL_MAKE

Maxin B. John (1):
  sqlite3: upgrade to 3.16.2

Ola x Nilsson (2):
  externalsrc.bbclass: Add task buildclean
  oe-selftest: devtool: Add test for externalsrc buildclean

Patrick Ohly (8):
  recipes: anonymous functions with priorities
  build.py: add preceedtask() API
  runqueue.py: alternative rm_work scheduler
  gcc-source.inc: cleanly disable do_rm_work
  rm_work_and_downloads.bbclass: more aggressively minimize disk usage
  rm_work.bbclass: clean up sooner
  rootfs-postcommands.bbclass: sort passwd entries
  insane.bbclass: print license text as part of QA message

Randy Witt (2):
  image_typedep.py: Add a test that ensures conversion type deps get added
  image_types.bbclass: IMAGE_TYPEDEP_ now adds deps for conversion types

Ross Burton (9):
  linux-firmware: remove alternatives for brcmfmac-stdio.bin
  

[OE-core] [PATCH 1/4] libproxy: update to version 0.4.14

[Maxin B. John]

0.4.13 -> 0.4.14

Signed-off-by: Maxin B. John 
---
 .../libproxy/{libproxy_0.4.13.bb => libproxy_0.4.14.bb}   | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
 rename meta/recipes-support/libproxy/{libproxy_0.4.13.bb => 
libproxy_0.4.14.bb} (88%)

diff --git a/meta/recipes-support/libproxy/libproxy_0.4.13.bb 
b/meta/recipes-support/libproxy/libproxy_0.4.14.bb
similarity index 88%
rename from meta/recipes-support/libproxy/libproxy_0.4.13.bb
rename to meta/recipes-support/libproxy/libproxy_0.4.14.bb
index 3940e22..8f56aaf 100644
--- a/meta/recipes-support/libproxy/libproxy_0.4.13.bb
+++ b/meta/recipes-support/libproxy/libproxy_0.4.14.bb
@@ -12,8 +12,8 @@ SRC_URI = 
"https://github.com/${BPN}/${BPN}/archive/${PV}.tar.gz;
 
 UPSTREAM_CHECK_URI = "https://github.com/libproxy/libproxy/releases;
 
-SRC_URI[md5sum] = "de293bb311f185a2ffa3492700a694c2"
-SRC_URI[sha256sum] = 
"d610bc0ef81a18ba418d759c5f4f87bf7102229a9153fb397d7d490987330ffd"
+SRC_URI[md5sum] = "272dc378efcc3335154cef30d171e84a"
+SRC_URI[sha256sum] = 
"6220a6cab837a8996116a0568324cadfd09a07ec16b930d2a330e16d5c2e1eb6"
 
 inherit cmake pkgconfig
 
-- 
2.4.0

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 3/4] netbase: upgrade to version 5.4

[Maxin B. John]

5.3 -> 5.4

Refreshed the following patch:
 a) netbase-add-rpcbind-as-an-alias-to-sunrpc.patch

Signed-off-by: Maxin B. John 
---
 ...netbase-add-rpcbind-as-an-alias-to-sunrpc.patch | 24 +-
 .../netbase/{netbase_5.3.bb => netbase_5.4.bb} |  6 +++---
 2 files changed, 17 insertions(+), 13 deletions(-)
 rename meta/recipes-core/netbase/{netbase_5.3.bb => netbase_5.4.bb} (76%)

diff --git 
a/meta/recipes-core/netbase/netbase/netbase-add-rpcbind-as-an-alias-to-sunrpc.patch
 
b/meta/recipes-core/netbase/netbase/netbase-add-rpcbind-as-an-alias-to-sunrpc.patch
index 35ce21e..56c8d5b 100644
--- 
a/meta/recipes-core/netbase/netbase/netbase-add-rpcbind-as-an-alias-to-sunrpc.patch
+++ 
b/meta/recipes-core/netbase/netbase/netbase-add-rpcbind-as-an-alias-to-sunrpc.patch
@@ -1,4 +1,7 @@
-netbase: add rpcbind as an alias to sunrpc
+From 76989205a1411f16d7ab09ff9d279539a73dc259 Mon Sep 17 00:00:00 2001
+From: "Maxin B. John" 
+Date: Thu, 12 Jan 2017 16:50:58 +0200
+Subject: [PATCH] netbase: add rpcbind as an alias to sunrpc
 
 the patch comes from:
 https://bugs.archlinux.org/task/20273
@@ -6,9 +9,10 @@ https://bugs.archlinux.org/task/20273
 Upstream-Status: Pending
 
 Signed-off-by: Li Wang 
+Signed-off-by: Maxin B. John 
 ---
- etc-rpc  |2 +-
- etc-services |4 ++--
+ etc-rpc  | 2 +-
+ etc-services | 4 ++--
  2 files changed, 3 insertions(+), 3 deletions(-)
 
 diff --git a/etc-rpc b/etc-rpc
@@ -25,20 +29,20 @@ index 1b30625..9a9a81a 100644
  rusersd   12  rusers
  nfs   13  nfsprog
 diff --git a/etc-services b/etc-services
-index 9d64a52..a19f7c8 100644
+index e3202ec..a039d7e 100644
 --- a/etc-services
 +++ b/etc-services
-@@ -72,8 +72,8 @@ pop2 109/tcp postoffice pop-2 # POP version 2
- pop2  109/udp pop-2
+@@ -64,8 +64,8 @@ csnet-ns 105/udp cso-ns
+ rtelnet   107/tcp # Remote Telnet
+ rtelnet   107/udp
  pop3  110/tcp pop-3   # POP version 3
- pop3  110/udp pop-3
 -sunrpc111/tcp portmapper  # RPC 4.0 portmapper
 -sunrpc111/udp portmapper
-+sunrpc111/tcp portmapper rpcbind  # RPC 4.0 
portmapper
++sunrpc111/tcp portmapper rpcbind # RPC 4.0 portmapper
 +sunrpc111/udp portmapper rpcbind
  auth  113/tcp authentication tap ident
  sftp  115/tcp
- uucp-path 117/tcp
+ nntp  119/tcp readnews untp   # USENET News Transfer Protocol
 -- 
-1.7.9.5
+2.4.0
 
diff --git a/meta/recipes-core/netbase/netbase_5.3.bb 
b/meta/recipes-core/netbase/netbase_5.4.bb
similarity index 76%
rename from meta/recipes-core/netbase/netbase_5.3.bb
rename to meta/recipes-core/netbase/netbase_5.4.bb
index 543596a..5ab0c58 100644
--- a/meta/recipes-core/netbase/netbase_5.3.bb
+++ b/meta/recipes-core/netbase/netbase_5.4.bb
@@ -6,12 +6,12 @@ LICENSE = "GPLv2"
 LIC_FILES_CHKSUM = 
"file://debian/copyright;md5=3dd6192d306f582dee7687da3d8748ab"
 PE = "1"
 
-SRC_URI = 
"http://snapshot.debian.org/archive/debian/20160728T043443Z/pool/main/n/${BPN}/${BPN}_${PV}.tar.xz
 \
+SRC_URI = 
"http://snapshot.debian.org/archive/debian/20170112T093812Z/pool/main/n/${BPN}/${BPN}_${PV}.tar.xz
 \
file://netbase-add-rpcbind-as-an-alias-to-sunrpc.patch \
file://hosts"
 
-SRC_URI[md5sum] = "2637a27fd3de02a278d2b5be7e6558c1"
-SRC_URI[sha256sum] = 
"81f6c69795044d62b8ad959cf9daf049d0545fd466c52860ad3f933b1e97b88b"
+SRC_URI[md5sum] = "117cb70c55ef3c1c002f127812b114c1"
+SRC_URI[sha256sum] = 
"66ff73d2d162e2d49db43988d8b8cd328cf7fffca042db73397f14c71825e80d"
 
 UPSTREAM_CHECK_URI = "${DEBIAN_MIRROR}/main/n/netbase/"
 do_install () {
-- 
2.4.0

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [PATCH 2/4] mdadm: upgrade to version 4.0

[Maxin B. John]

3.4 -> 4.0

Removed the following upstreamed or backported patches:

 a) 0001-Fix-some-type-comparison-problems.patch
 b) 0001-Fix-typo-in-comparision.patch
 c) 0001-mdadm.h-bswap-is-already-defined-in-uclibc.patch
 d) 0001-raid6check-Fix-if-else-indentation.patch
 e) 0001-util.c-include-poll.h-instead-of-sys-poll.h.patch
 f) mdadm-3.2.2_fix_for_x32.patch

Signed-off-by: Maxin B. John 
---
 .../0001-Fix-some-type-comparison-problems.patch   | 50 -
 .../mdadm/files/0001-Fix-typo-in-comparision.patch | 86 --
 ...dadm.h-bswap-is-already-defined-in-uclibc.patch | 55 --
 .../0001-raid6check-Fix-if-else-indentation.patch  | 37 --
 ...il.c-include-poll.h-instead-of-sys-poll.h.patch | 45 ---
 .../mdadm/files/mdadm-3.2.2_fix_for_x32.patch  | 23 --
 .../mdadm/{mdadm_3.4.bb => mdadm_4.0.bb}   | 10 +--
 7 files changed, 2 insertions(+), 304 deletions(-)
 delete mode 100644 
meta/recipes-extended/mdadm/files/0001-Fix-some-type-comparison-problems.patch
 delete mode 100644 
meta/recipes-extended/mdadm/files/0001-Fix-typo-in-comparision.patch
 delete mode 100644 
meta/recipes-extended/mdadm/files/0001-mdadm.h-bswap-is-already-defined-in-uclibc.patch
 delete mode 100644 
meta/recipes-extended/mdadm/files/0001-raid6check-Fix-if-else-indentation.patch
 delete mode 100644 
meta/recipes-extended/mdadm/files/0001-util.c-include-poll.h-instead-of-sys-poll.h.patch
 delete mode 100644 
meta/recipes-extended/mdadm/files/mdadm-3.2.2_fix_for_x32.patch
 rename meta/recipes-extended/mdadm/{mdadm_3.4.bb => mdadm_4.0.bb} (81%)

diff --git 
a/meta/recipes-extended/mdadm/files/0001-Fix-some-type-comparison-problems.patch
 
b/meta/recipes-extended/mdadm/files/0001-Fix-some-type-comparison-problems.patch
deleted file mode 100644
index f829467..000
--- 
a/meta/recipes-extended/mdadm/files/0001-Fix-some-type-comparison-problems.patch
+++ /dev/null
@@ -1,50 +0,0 @@
-From 835baf02fd42012bbc0603dffb1f80c6ecf0fb9e Mon Sep 17 00:00:00 2001
-From: Xiao Ni 
-Date: Mon, 8 Feb 2016 11:18:52 +0200
-Subject: [PATCH] Fix some type comparison problems
-
-As 26714713cd2bad9e0bf7f4669f6cc4659ceaab6c said, 32 bit signed
-timestamps will overflow in the year 2038. It already changed the
-utime and ctime in struct mdu_array_info_s from int to unsigned
-int. So we need to change the values that compared with them to
-unsigned int too.
-
-Upstream-Status: Backport
-
-Signed-off-by: : Xiao Ni 
-Signed-off-by: Maxin B. John 

-
- Monitor.c | 2 +-
- util.c| 2 +-
- 2 files changed, 2 insertions(+), 2 deletions(-)
-
-diff --git a/Monitor.c b/Monitor.c
-index f19c2e5..6df80f9 100644
 a/Monitor.c
-+++ b/Monitor.c
-@@ -33,7 +33,7 @@
- struct state {
-   char *devname;
-   char devnm[32]; /* to sync with mdstat info */
--  long utime;
-+  unsigned int utime;
-   int err;
-   char *spare_group;
-   int active, working, failed, spare, raid;
-diff --git a/util.c b/util.c
-index 3e6d293..96a806d 100644
 a/util.c
-+++ b/util.c
-@@ -1267,7 +1267,7 @@ struct supertype *guess_super_type(int fd, enum 
guess_types guess_type)
-*/
-   struct superswitch  *ss;
-   struct supertype *st;
--  time_t besttime = 0;
-+  unsigned int besttime = 0;
-   int bestsuper = -1;
-   int i;
- 
--- 
-2.4.0
-
diff --git 
a/meta/recipes-extended/mdadm/files/0001-Fix-typo-in-comparision.patch 
b/meta/recipes-extended/mdadm/files/0001-Fix-typo-in-comparision.patch
deleted file mode 100644
index df70b1c..000
--- a/meta/recipes-extended/mdadm/files/0001-Fix-typo-in-comparision.patch
+++ /dev/null
@@ -1,86 +0,0 @@
-From 18d360d74271a066a849bc1fba4f10dbb23ed251 Mon Sep 17 00:00:00 2001
-From: Khem Raj 
-Date: Tue, 8 Sep 2015 08:17:42 +
-Subject: [PATCH] Fix typo in comparision
-
-error: comparison of array 'devnm' equal to a null pointer is always false
-
-User bitwise '&' operator as it is a mask
-
-Fixes
-error: use of logical '&&' with constant operand
-
-Remove extraneous parens
-
-error: equality comparison with extraneous parentheses
-
-Remove dead code
-
-restripe.c:465:21: error: explicitly assigning value of variable of type 'int' 
to itself
-
-Signed-off-by: Khem Raj 

-Upstream-Status: Pending
-
- mdmon.h   | 2 +-
- mdopen.c  | 2 +-
- restripe.c| 3 ---
- super-intel.c | 2 +-
- 4 files changed, 3 insertions(+), 6 deletions(-)
-
-diff --git a/mdmon.h b/mdmon.h
-index aa750c6..0b08c3d 100644
 a/mdmon.h
-+++ b/mdmon.h
-@@ -101,7 +101,7 @@ static inline int is_resync_complete(struct mdinfo *array)
-   break;
-   case 10:
-   l = array->array.layout;
--  ncopies = (l & 0xff) * ((l >> 8) && 0xff);
-+  ncopies = (l & 0xff) * ((l >> 8) & 0xff);
-   sync_size = array->component_size * array->array.raid_disks;
-   sync_size /= ncopies;

[OE-core] [PATCH 4/4] harfbuzz: upgrade to 1.4.1

[Maxin B. John]

1.3.4 -> 1.4.1

Signed-off-by: Maxin B. John 
---
 .../harfbuzz/{harfbuzz_1.3.4.bb => harfbuzz_1.4.1.bb} | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
 rename meta/recipes-graphics/harfbuzz/{harfbuzz_1.3.4.bb => harfbuzz_1.4.1.bb} 
(88%)

diff --git a/meta/recipes-graphics/harfbuzz/harfbuzz_1.3.4.bb 
b/meta/recipes-graphics/harfbuzz/harfbuzz_1.4.1.bb
similarity index 88%
rename from meta/recipes-graphics/harfbuzz/harfbuzz_1.3.4.bb
rename to meta/recipes-graphics/harfbuzz/harfbuzz_1.4.1.bb
index 74d6c6a..fc4773e 100644
--- a/meta/recipes-graphics/harfbuzz/harfbuzz_1.3.4.bb
+++ b/meta/recipes-graphics/harfbuzz/harfbuzz_1.4.1.bb
@@ -12,8 +12,8 @@ DEPENDS = "glib-2.0 cairo fontconfig freetype"
 
 SRC_URI = "http://www.freedesktop.org/software/harfbuzz/release/${BP}.tar.bz2;
 
-SRC_URI[md5sum] = "065843caf247687b94126773285bc70f"
-SRC_URI[sha256sum] = 
"718aa6fcadef1a6548315b8cfe42cc27e926256302c337f42df3a443843f6a2b"
+SRC_URI[md5sum] = "7b3f445d0a58485a31c18c03ce9b4e3c"
+SRC_URI[sha256sum] = 
"85a27fab639a1d651737dcb6b69e4101e3fd09522fdfdcb793df810b5cb315bd"
 
 inherit autotools pkgconfig lib_package gtk-doc
 
-- 
2.4.0

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH v3] kernel-module-split: Append KERNEL_VERSION string to kernel module name

[Ola Redell]

On 01/12/2017 02:44 PM, Bruce Ashfield wrote:



Interesting. I think we've probably fallen off the radar of the casual 
reader that may have
more bitbake knowledge to explain why the virtual package 
(kernel-modules) provides
works with the same name and different versions, while a package with 
the version postfix

that rprovides the same name doesn't work with different versions.

I think I have a clue on this so let me try to straight it out as much 
as I can in a somewhat more structured manner than my earlier attempt, 
and hopefully with a readable formatting this time... I'll do a 
background and overview too to let new readers in. I am sorry about this 
being lengthy. I'll post a patch v4 based on the end conclusion.


Anyone with a better knowledge in package management than me (that means 
very many of you) might want to fill in or correct the below. And Bruce, 
I kept #1 and #3 separate since I see quite a difference between "meta 
packages" and "virtual packages".


In my current system I use deb packages and apt-get as package manager 
so the discussion below is apt-get centric. The *assumption* here is 
that package managers in general behave in a similar way to apt-get, 
when it comes to the details below.



Background

My use case is that I want a kernel module packaging that allows me to 
upgrade my kernel and kernel modules using a package manager such as 
apt-get without the kernel modules for the older kernel being removed. 
When I perform an upgrade today (either dist-upgrade or upgrade on the 
package "kernel-modules") the old modules are removed. My motivation is 
that I want to be able to fall back to the older kernel and its modules 
if necessary.


The "kernel-modules" package is called a "meta package" in the code. 
Even though it is an empty package (therefore "meta"), it is a package 
in its own right with a package version based on the kernel version used 
to build it. It has dependencies to all kernel module packages (e.g. 
kernel-module-foo) that are built by bitbake. Hence when the 
"kernel-modules" package is installed or upgraded it pulls in all those 
modules that it depends on.


Side note: If apt-get finds many "kernel-modules" packages available it 
simply picks the one with the latest version (unless given a specific 
version). So having many "meta packages" of different versions available 
at the same time is not a problem - apt-get can distinguish between them.


Today, the kernel module packages like kernel-module-foo are named the 
same regardless of what kernel they belong to. Hence kernel-module-foo 
for kernel-x is the same package as kernel-module-foo for kernel-y, just 
with another version. Therefore, when the "kernel-modules" package is 
upgraded, the new version of kernel-module-foo is installed while the 
older version is removed (you cannot have two versions of the same 
package installed at once). That is the problem.



Alternative solutions

My original suggestion (#0) was to just postfix the kernel module 
package names with a kernel version string (creating 
kernel-module-foo-) just like what is done with the kernel 
itself already today. Note that this  has very little to do 
with the actual version of the package.  is just 
KERNEL_VERSION, nothing else. This solves my use case but causes other 
problems as Bruce pointed out. Existing recipes with dependencies to 
kernel-module-foo will break, and even worse, will have to be updated 
for every new kernel version.


One alternative (#1) would be to add the postfix and also add empty 
"meta packages" for all kernel-module packages, such that the meta 
package "kernel-module-foo" would depend on 
"kernel-module-foo-". That would work great (presumably - 
untested), just like the "kernel-modules" meta package, but would add a 
lot of new packages to the already time consuming build. It would also 
make the kernel-module-split class even more complex.


Another alternative (#2) is to simply make the postfix configurable, on 
or off. This would work fine but it would also add to the complexity of 
the kernel-module-split code as well as adding another (rarely used) 
code path, with the effects that has on stability.


A third alternative (#3) is to add the postfix and let the kernel module 
packages RPROVIDE the shorter named package. Hence 
kernel-module-foo- would then provide kernel-module-foo such 
that recipes can still depend on the kernel-module-foo which is now a 
"virtual package". A "virtual package" is more like an alias for the 
real package and is not a package in its own right (unlike the meta 
package). With this solution one would also be able to install 
kernel-module-foo using "apt-get install kernel-module-foo" but only if 
there is only one provider available. Hence, it would not be possible to 
"apt-get upgrade kernel-module-foo" to get 
kernel-module-foo- since the original package 
(kernel-module-foo-) is always available in an OE system(?) 
(afaik). This would not be a 

Re: [OE-core] [PATCH] recipes-test: exclude recipes from world target

[Burton, Ross]

On 9 January 2017 at 17:49, 
wrote:

> These recipes should be excluded from target 'world' because these are
> just intended to be used internally by oe-selftest (devtool, recipetool,
> etc.)
>

You failed to update the reference files for after the upgrade, which means
the tests now fail.

I've fixed locally, but please remember to re-run oe-selftest after
touching the test suite.

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 6/7] byacc: upgrade to 20161202

[Burton, Ross]

On 13 January 2017 at 10:57, ChenQi  wrote:

> I've fixed the problem and updated the remote branch.
>
>
Thanks Chen!

Ross
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 6/7] byacc: upgrade to 20161202

[ChenQi]

On 01/13/2017 07:18 AM, Burton, Ross wrote:


On 26 December 2016 at 08:10, Chen Qi > wrote:


Signed-off-by: Chen Qi >


I haven't yet looked into why it could be happening, but it appears 
the upgraded byacc doesn't like building for beaglebone on poky-lsb:


https://autobuilder.yoctoproject.org/main/builders/nightly-arm-lsb/builds/1002/steps/BuildImages_1/logs/stdio

Ross



Hi Ross,

I've fixed the problem and updated the remote branch.

  git://git.pokylinux.org/poky-contrib ChenQi/PU-20161226
  http://git.pokylinux.org/cgit.cgi/poky-contrib/log/?h=ChenQi/PU-20161226

In particular, 0001-byacc-do-not-reorder-CC-and-CFLAGS.patch is added to 
fix the problem of byacc configure script dropping some $CC options.


Best Regards,

Chen Qi




-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

Re: [OE-core] [PATCH 1/3] piglit: Package tests in compressed form as well

[Nicolas Dechesne]

On Mon, Dec 12, 2016 at 2:35 PM, Jussi Kukkonen
 wrote:
> Modify packaging so that generated tests are available in two forms:
> * piglit-generated-tests contains the tests as they are now (1.5GB
>   when installed)
> * piglit-generated-tests-compressed contains a tar.gz with the same
>   files (45 MB when installed)
>
> Add wrapper script that decompresses the tests at runtime: this
> requires 1.5GB free space.
>
> Signed-off-by: Jussi Kukkonen 

What is the status of this patch? looks like a good thing to get
afaik. is there anything needed to get it merged?

thx!
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core

[OE-core] [morty] Please include the binutils-2.27 alignment frags for aarch64

[Mike Looijmans]

Could this oe-core master commit be included in the "morty" branch please:
f6f87019073d4f3caa7766aca89faa6781690fba "binutils-2.27.inc: Fix alignment 
frags for aarch64"


Without this patch, arm-trusted-firmware (apparently a requirement to get 
arm64 machines to boot these days) fails to build in the morty branch.



Kind regards,

Mike Looijmans
System Expert

TOPIC Products
Materiaalweg 4, NL-5681 RJ Best
Postbus 440, NL-5680 AK Best
Telefoon: +31 (0) 499 33 69 79
E-mail: mike.looijm...@topicproducts.com
Website: www.topicproducts.com

Please consider the environment before printing this e-mail





--
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core