[OE-core] [PATCH 2/2] staging.bbclass: Avoid looking at other multiconfigs on extend_recipe_sysroot

2019-01-05 Thread Alejandro Enedino Hernandez Samaniego
On extend_recipe_sysroot we only compare taskname and pn, but if we have
some dependency to a recipe from another multiconfig, these two will
still match if it is the same recipe, causing an error since the build
system believes it has already proccesed that dependency.

Check if this is a multiconfig build, if it is, make sure the current
dependency is coming from the same multiconfig as the one we are
building.

Signed-off-by: Alejandro Enedino Hernandez Samaniego 
---
 meta/classes/staging.bbclass | 4 
 1 file changed, 4 insertions(+)

diff --git a/meta/classes/staging.bbclass b/meta/classes/staging.bbclass
index 84e13ba..2dbe65a 100644
--- a/meta/classes/staging.bbclass
+++ b/meta/classes/staging.bbclass
@@ -277,6 +277,10 @@ python extend_recipe_sysroot() {
 for dep in taskdepdata:
 data = taskdepdata[dep]
 if data[1] == mytaskname and data[0] == pn:
+if mc != 'default':
+depmc = dep.split(':')[1]
+if depmc != mc:
+continue
 start = dep
 break
 if start is None:
-- 
2.7.4

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core


Re: [OE-core] [Openembedded-architecture] Dropping armv5 and armv5e tunes in 2.7

2019-01-05 Thread Trevor Woerner
Hello Khem,

Thanks for pointing this out.

On Thu, Jan 3, 2019 at 5:02 PM Khem Raj  wrote:

> Secondly, I would also like to drop armv4t, and keep armv5te as lowest
> supported tune
>

Fortunately I don't have any ARMv4 boards.

But, just for informational purposes, I wanted to point out that I do have
a couple ARM926EJ-S boards (i.MX233, LPC32xx) which are ARMv5TE which I am
actively working with and maintaining. Therefore, thank you for keeping
this one around.
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core


Re: [OE-core] [PATCH v5 3/8] bitbake: runqueue: Track task unique hash

2019-01-05 Thread Joshua Watt
On Sat, Jan 5, 2019 at 1:50 AM Alejandro Hernandez
 wrote:
>
> Hey Joshua,
>
> This is breaking multiconfig builds with the following error (trimmed),
> I believe it is not taking into account that the Key could contain
> "mc:..." if it is a multiconfig build.

Hmm, yes that seems likely. I'll take a look, would you mind opening a
bug in Bugzilla and assigning it to me? I'm not very familiar with
multiconfig, so some instructions to help reproduce would be very
helpful.

Does anyone know if mutliconfig is tested on the autobuilders?

>
>
> ERROR: Running idle function
>   File "poky/bitbake/lib/bb/runqueue.py", line 1170, in
> RunQueueData.prepare_task_hash(tid='multiconfig:x86:poky/meta/recipes-support/attr/acl_2.2.52.bb:do_fetch'):
>   self.runtaskentries[tid].hash =
> bb.parse.siggen.get_taskhash(taskfn, taskname, procdep, self.dataCaches[mc])
>  >self.runtaskentries[tid].unihash =
> bb.parse.siggen.get_unihash(fn + "." + taskname)
>
>File "poky/bitbake/lib/bb/siggen.py", line 45, in
> SignatureGeneratorOEBasicHash.get_unihash(task='poky/meta/recipes-support/attr/acl_2.2.52.bb.do_fetch'):
>   def get_unihash(self, task):
>  >return self.taskhash[task]
>
> KeyError: 'poky/meta/recipes-support/attr/acl_2.2.52.bb.do_fetch'
>
>
> Cheers,
>
> Alejandro
>
>
> On 12/18/2018 7:10 PM, Joshua Watt wrote:
> > Requests the task unique hash from siggen and tracks it
> >
> > [YOCTO #13030]
> >
> > Signed-off-by: Joshua Watt 
> > ---
> >   bitbake/lib/bb/runqueue.py | 25 +
> >   1 file changed, 17 insertions(+), 8 deletions(-)
> >
> > diff --git a/bitbake/lib/bb/runqueue.py b/bitbake/lib/bb/runqueue.py
> > index f2b95a9829b..27b188256dd 100644
> > --- a/bitbake/lib/bb/runqueue.py
> > +++ b/bitbake/lib/bb/runqueue.py
> > @@ -346,6 +346,7 @@ class RunTaskEntry(object):
> >   self.depends = set()
> >   self.revdeps = set()
> >   self.hash = None
> > +self.unihash = None
> >   self.task = None
> >   self.weight = 1
> >
> > @@ -385,6 +386,9 @@ class RunQueueData:
> >   def get_task_hash(self, tid):
> >   return self.runtaskentries[tid].hash
> >
> > +def get_task_unihash(self, tid):
> > +return self.runtaskentries[tid].unihash
> > +
> >   def get_user_idstring(self, tid, task_name_suffix = ""):
> >   return tid + task_name_suffix
> >
> > @@ -1150,18 +1154,21 @@ class RunQueueData:
> >   if len(self.runtaskentries[tid].depends - dealtwith) == 0:
> >   dealtwith.add(tid)
> >   todeal.remove(tid)
> > -procdep = []
> > -for dep in self.runtaskentries[tid].depends:
> > -procdep.append(fn_from_tid(dep) + "." + 
> > taskname_from_tid(dep))
> > -(mc, fn, taskname, taskfn) = split_tid_mcfn(tid)
> > -self.runtaskentries[tid].hash = 
> > bb.parse.siggen.get_taskhash(taskfn, taskname, procdep, self.dataCaches[mc])
> > -task = self.runtaskentries[tid].task
> > +self.prepare_task_hash(tid)
> >
> >   bb.parse.siggen.writeout_file_checksum_cache()
> >
> >   #self.dump_data()
> >   return len(self.runtaskentries)
> >
> > +def prepare_task_hash(self, tid):
> > +procdep = []
> > +for dep in self.runtaskentries[tid].depends:
> > +procdep.append(fn_from_tid(dep) + "." + taskname_from_tid(dep))
> > +(mc, fn, taskname, taskfn) = split_tid_mcfn(tid)
> > +self.runtaskentries[tid].hash = 
> > bb.parse.siggen.get_taskhash(taskfn, taskname, procdep, self.dataCaches[mc])
> > +self.runtaskentries[tid].unihash = bb.parse.siggen.get_unihash(fn 
> > + "." + taskname)
> > +
> >   def dump_data(self):
> >   """
> >   Dump some debug information on the internal data structures
> > @@ -2081,7 +2088,8 @@ class RunQueueExecuteTasks(RunQueueExecute):
> >   deps = self.rqdata.runtaskentries[revdep].depends
> >   provides = self.rqdata.dataCaches[mc].fn_provides[taskfn]
> >   taskhash = self.rqdata.runtaskentries[revdep].hash
> > -taskdepdata[revdep] = [pn, taskname, fn, deps, provides, 
> > taskhash]
> > +unihash = self.rqdata.runtaskentries[revdep].unihash
> > +taskdepdata[revdep] = [pn, taskname, fn, deps, provides, 
> > taskhash, unihash]
> >   for revdep2 in deps:
> >   if revdep2 not in taskdepdata:
> >   additional.append(revdep2)
> > @@ -2524,7 +2532,8 @@ class RunQueueExecuteScenequeue(RunQueueExecute):
> >   deps = getsetscenedeps(revdep)
> >   provides = self.rqdata.dataCaches[mc].fn_provides[taskfn]
> >   taskhash = self.rqdata.runtaskentries[revdep].hash
> > -taskdepdata[revdep] = [pn, 

[OE-core] [v2][PATCH] nettle: update to 3.4.1

2019-01-05 Thread Armin Kuster
Bug fix only release

Include:

  CVE-2018-16868 gnutls: Bleichenbacher-like side channel leakage in
  PKCS#1 1.5 verification and padding oracle verification

  CVE-2018-16869 nettle: Leaky data conversion exposing a manager oracle

For full details see:
http://lists.lysator.liu.se/pipermail/nettle-bugs/2018/007369.html

[V2]
Add -std=c99 to cflags

Signed-off-by: Armin Kuster 
---
 .../Add-target-to-only-build-tests-not-run-them.patch| 0
 .../check-header-files-of-openssl-only-if-enable_.patch  | 0
 .../nettle/{nettle-3.4 => nettle-3.4.1}/dlopen-test.patch| 0
 meta/recipes-support/nettle/{nettle-3.4 => nettle-3.4.1}/run-ptest   | 0
 meta/recipes-support/nettle/{nettle_3.4.bb => nettle_3.4.1.bb}   | 5 +++--
 5 files changed, 3 insertions(+), 2 deletions(-)
 rename meta/recipes-support/nettle/{nettle-3.4 => 
nettle-3.4.1}/Add-target-to-only-build-tests-not-run-them.patch (100%)
 rename meta/recipes-support/nettle/{nettle-3.4 => 
nettle-3.4.1}/check-header-files-of-openssl-only-if-enable_.patch (100%)
 rename meta/recipes-support/nettle/{nettle-3.4 => 
nettle-3.4.1}/dlopen-test.patch (100%)
 rename meta/recipes-support/nettle/{nettle-3.4 => nettle-3.4.1}/run-ptest 
(100%)
 rename meta/recipes-support/nettle/{nettle_3.4.bb => nettle_3.4.1.bb} (90%)

diff --git 
a/meta/recipes-support/nettle/nettle-3.4/Add-target-to-only-build-tests-not-run-them.patch
 
b/meta/recipes-support/nettle/nettle-3.4.1/Add-target-to-only-build-tests-not-run-them.patch
similarity index 100%
rename from 
meta/recipes-support/nettle/nettle-3.4/Add-target-to-only-build-tests-not-run-them.patch
rename to 
meta/recipes-support/nettle/nettle-3.4.1/Add-target-to-only-build-tests-not-run-them.patch
diff --git 
a/meta/recipes-support/nettle/nettle-3.4/check-header-files-of-openssl-only-if-enable_.patch
 
b/meta/recipes-support/nettle/nettle-3.4.1/check-header-files-of-openssl-only-if-enable_.patch
similarity index 100%
rename from 
meta/recipes-support/nettle/nettle-3.4/check-header-files-of-openssl-only-if-enable_.patch
rename to 
meta/recipes-support/nettle/nettle-3.4.1/check-header-files-of-openssl-only-if-enable_.patch
diff --git a/meta/recipes-support/nettle/nettle-3.4/dlopen-test.patch 
b/meta/recipes-support/nettle/nettle-3.4.1/dlopen-test.patch
similarity index 100%
rename from meta/recipes-support/nettle/nettle-3.4/dlopen-test.patch
rename to meta/recipes-support/nettle/nettle-3.4.1/dlopen-test.patch
diff --git a/meta/recipes-support/nettle/nettle-3.4/run-ptest 
b/meta/recipes-support/nettle/nettle-3.4.1/run-ptest
similarity index 100%
rename from meta/recipes-support/nettle/nettle-3.4/run-ptest
rename to meta/recipes-support/nettle/nettle-3.4.1/run-ptest
diff --git a/meta/recipes-support/nettle/nettle_3.4.bb 
b/meta/recipes-support/nettle/nettle_3.4.1.bb
similarity index 90%
rename from meta/recipes-support/nettle/nettle_3.4.bb
rename to meta/recipes-support/nettle/nettle_3.4.1.bb
index ca8450e..dd49c30 100644
--- a/meta/recipes-support/nettle/nettle_3.4.bb
+++ b/meta/recipes-support/nettle/nettle_3.4.1.bb
@@ -20,8 +20,8 @@ SRC_URI_append_class-target = "\
 file://dlopen-test.patch \
 "
 
-SRC_URI[md5sum] = "dc0f13028264992f58e67b4e8915f53d"
-SRC_URI[sha256sum] = 
"ae7a42df026550b85daca8389b6a60ba6313b0567f374392e54918588a411e94"
+SRC_URI[md5sum] = "9bdebb0e2f638d3b9d91f7fc264b70c1"
+SRC_URI[sha256sum] = 
"f941cf1535cd5d1819be5ccae5babef01f6db611f9b5a777bae9c7604b8a92ad"
 
 UPSTREAM_CHECK_REGEX = "nettle-(?P\d+(\.\d+)+)\.tar"
 
@@ -30,6 +30,7 @@ inherit autotools ptest multilib_header
 EXTRA_AUTORECONF += "--exclude=aclocal"
 
 EXTRA_OECONF = "--disable-openssl"
+CFLAGS_append = " -std=c99"
 
 do_compile_ptest() {
 oe_runmake buildtest
-- 
2.7.4

-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core


Re: [OE-core] [PATCH v5 3/8] bitbake: runqueue: Track task unique hash

2019-01-05 Thread Alejandro Hernandez

Hey Joshua,

This is breaking multiconfig builds with the following error (trimmed), 
I believe it is not taking into account that the Key could contain 
"mc:..." if it is a multiconfig build.



ERROR: Running idle function
 File "poky/bitbake/lib/bb/runqueue.py", line 1170, in 
RunQueueData.prepare_task_hash(tid='multiconfig:x86:poky/meta/recipes-support/attr/acl_2.2.52.bb:do_fetch'):
 self.runtaskentries[tid].hash = 
bb.parse.siggen.get_taskhash(taskfn, taskname, procdep, self.dataCaches[mc])
    >    self.runtaskentries[tid].unihash = 
bb.parse.siggen.get_unihash(fn + "." + taskname)


  File "poky/bitbake/lib/bb/siggen.py", line 45, in 
SignatureGeneratorOEBasicHash.get_unihash(task='poky/meta/recipes-support/attr/acl_2.2.52.bb.do_fetch'):

 def get_unihash(self, task):
    >    return self.taskhash[task]

KeyError: 'poky/meta/recipes-support/attr/acl_2.2.52.bb.do_fetch'


Cheers,

Alejandro


On 12/18/2018 7:10 PM, Joshua Watt wrote:

Requests the task unique hash from siggen and tracks it

[YOCTO #13030]

Signed-off-by: Joshua Watt 
---
  bitbake/lib/bb/runqueue.py | 25 +
  1 file changed, 17 insertions(+), 8 deletions(-)

diff --git a/bitbake/lib/bb/runqueue.py b/bitbake/lib/bb/runqueue.py
index f2b95a9829b..27b188256dd 100644
--- a/bitbake/lib/bb/runqueue.py
+++ b/bitbake/lib/bb/runqueue.py
@@ -346,6 +346,7 @@ class RunTaskEntry(object):
  self.depends = set()
  self.revdeps = set()
  self.hash = None
+self.unihash = None
  self.task = None
  self.weight = 1
  
@@ -385,6 +386,9 @@ class RunQueueData:

  def get_task_hash(self, tid):
  return self.runtaskentries[tid].hash
  
+def get_task_unihash(self, tid):

+return self.runtaskentries[tid].unihash
+
  def get_user_idstring(self, tid, task_name_suffix = ""):
  return tid + task_name_suffix
  
@@ -1150,18 +1154,21 @@ class RunQueueData:

  if len(self.runtaskentries[tid].depends - dealtwith) == 0:
  dealtwith.add(tid)
  todeal.remove(tid)
-procdep = []
-for dep in self.runtaskentries[tid].depends:
-procdep.append(fn_from_tid(dep) + "." + 
taskname_from_tid(dep))
-(mc, fn, taskname, taskfn) = split_tid_mcfn(tid)
-self.runtaskentries[tid].hash = 
bb.parse.siggen.get_taskhash(taskfn, taskname, procdep, self.dataCaches[mc])
-task = self.runtaskentries[tid].task
+self.prepare_task_hash(tid)
  
  bb.parse.siggen.writeout_file_checksum_cache()
  
  #self.dump_data()

  return len(self.runtaskentries)
  
+def prepare_task_hash(self, tid):

+procdep = []
+for dep in self.runtaskentries[tid].depends:
+procdep.append(fn_from_tid(dep) + "." + taskname_from_tid(dep))
+(mc, fn, taskname, taskfn) = split_tid_mcfn(tid)
+self.runtaskentries[tid].hash = bb.parse.siggen.get_taskhash(taskfn, 
taskname, procdep, self.dataCaches[mc])
+self.runtaskentries[tid].unihash = bb.parse.siggen.get_unihash(fn + 
"." + taskname)
+
  def dump_data(self):
  """
  Dump some debug information on the internal data structures
@@ -2081,7 +2088,8 @@ class RunQueueExecuteTasks(RunQueueExecute):
  deps = self.rqdata.runtaskentries[revdep].depends
  provides = self.rqdata.dataCaches[mc].fn_provides[taskfn]
  taskhash = self.rqdata.runtaskentries[revdep].hash
-taskdepdata[revdep] = [pn, taskname, fn, deps, provides, 
taskhash]
+unihash = self.rqdata.runtaskentries[revdep].unihash
+taskdepdata[revdep] = [pn, taskname, fn, deps, provides, 
taskhash, unihash]
  for revdep2 in deps:
  if revdep2 not in taskdepdata:
  additional.append(revdep2)
@@ -2524,7 +2532,8 @@ class RunQueueExecuteScenequeue(RunQueueExecute):
  deps = getsetscenedeps(revdep)
  provides = self.rqdata.dataCaches[mc].fn_provides[taskfn]
  taskhash = self.rqdata.runtaskentries[revdep].hash
-taskdepdata[revdep] = [pn, taskname, fn, deps, provides, 
taskhash]
+unihash = self.rqdata.runtaskentries[revdep].unihash
+taskdepdata[revdep] = [pn, taskname, fn, deps, provides, 
taskhash, unihash]
  for revdep2 in deps:
  if revdep2 not in taskdepdata:
  additional.append(revdep2)

--
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core


Re: [OE-core] Official sstate premirrors and builds

2019-01-05 Thread Andrea Galbusera
Hi,

On Sat, Jan 5, 2019 at 4:21 AM Jate Sujjavanich  wrote:
>
> I setup a machine on AWS and wanted to use the sstate cache mirror at 
> sstate.yoctoproject.org in my site.conf.
>
> Bitbake does not pull the artifacts from the mirror despite the uninative C 
> library. I have tried checking out several tags and then pointed to the 
> appropriate directory on sstate mirror. For example, yocto-2.2.2 and 
> http://sstate.yoctoproject.org/2.2.2.
>
> Bitbake populates several license setscene tasks, but no native packages.
>
> Does anyone have this working?

I remember I tried this some time ago and similarly had no luck with
"official" mirrors... I guess it was after sumo release on an Ubuntu
16.04 host. I remember I used default local.conf and tried both tagged
commits and release branch tips, but I always ended up with full
builds with no sstate object being fetched from the mirror.
-- 
___
Openembedded-core mailing list
Openembedded-core@lists.openembedded.org
http://lists.openembedded.org/mailman/listinfo/openembedded-core