On Tue, 2015-03-24 at 12:00 +0100, Steffen Sledz wrote:
> We hit the following problem in oe-classic. And we're not sure if this
> problem may occur in current oe too, or if it is fixed there.
>
> They are two or more recipes (may be in different layers) for packages with
> sources from the same (git) repository. If the fetching from the repo needs
> some time we see "file changed as we read it" errors in all likelihood.
>
> ------------------> snip <-------------------
> ERROR: Error evaluating '${PF}:${P}:${PN}:${BP}:${BPN}:files:.'
> Traceback (most recent call last):
> File "/CACHE/jenkins-workspace/foo/bitbake/lib/bb/data_smart.py", line 116,
> in expandWithRefs
> s = __expand_var_regexp__.sub(varparse.var_sub, s)
> File "/CACHE/jenkins-workspace/foo/bitbake/lib/bb/data_smart.py", line 60,
> in var_sub
> var = self.d.getVar(key, 1)
> File "/CACHE/jenkins-workspace/foo/bitbake/lib/bb/data_smart.py", line 260,
> in getVar
> return self.expand(value, var)
> File "/CACHE/jenkins-workspace/foo/bitbake/lib/bb/data_smart.py", line 132,
> in expand
> return self.expandWithRefs(s, varname).value
> File "/CACHE/jenkins-workspace/foo/bitbake/lib/bb/data_smart.py", line 116,
> in expandWithRefs
> s = __expand_var_regexp__.sub(varparse.var_sub, s)
> FetchError: Fetch command export HOME="/var/lib/jenkins"; export
> PATH="/CACHE/jenkins-workspace/foo/OE//bin:/CACHE/jenkins-workspace/foo/openembedded/bin:/CACHE/jenkins-workspace/foo/OE/tmp.7/sysroots/x86_64-linux/usr/armv5te/bin:/CACHE/jenkins-workspace/foo/OE/tmp.7/sysroots/x86_64-linux/usr/sbin:/CACHE/jenkins-workspace/foo/OE/tmp.7/sysroots/x86_64-linux/usr/bin:/CACHE/jenkins-workspace/foo/OE/tmp.7/sysroots/x86_64-linux/sbin:/CACHE/jenkins-workspace/foo/OE/tmp.7/sysroots/x86_64-linux//bin:/CACHE/jenkins-workspace/foo/OE/bin-HYP-6339:/CACHE/jenkins-workspace/foo/bitbake/bin:/sbin:/usr/sbin:/bin:/usr/bin";
> tar -czf
> /var/lib/jenkins/sources/git_bitbucket.org.dresearchfe.drconfig.git.tar.gz
> ./.git/* failed with signal 1, output:
> /bin/tar: ./.git/objects/pack/tmp_pack_BwThcc: File removed before we read it
> /bin/tar: ./.git/objects/pack/tmp_pack_Ans7xK: File removed before we read it
> /bin/tar: ./.git/objects/pack: file changed as we read it
> ------------------> snap <-------------------
>
> Is this a problem in oe-core too (or oe-classic only)?
>
> Any ideas how to avoid such errors?
In theory bitbake has locks on files in DL_DIR, even for git
repositories so it should only touch the repo with one fetch process at
a time even if multiple recipes reference the same thing.
There were some big fetcher reworks in more recent versions of bitbake.
For OE-Classic, I'm guessing you're using an older version. You could
try transplanting the modern fetcher core onto your older bitbake I
guess.
Cheers,
Richard
--
_______________________________________________
Openembedded-devel mailing list
[email protected]
http://lists.openembedded.org/mailman/listinfo/openembedded-devel
