On Mon, 2024-01-22 at 16:10 +0100, Alexander Kanavin wrote:
> You are not showing what kind of error you expect to see. What is
> being tested for non-reproducibility?
Right, I hacked u-boot to set current date:
--- a/meta/recipes-bsp/u-boot/u-boot.inc
+++ b/meta/recipes-bsp/u-boot/u-boot.inc
@@ -9,7 +9,7 @@ inherit uboot-config uboot-extlinux-config uboot-sign deploy
python3native kerne
DEPENDS += "swig-native"
-EXTRA_OEMAKE = 'CROSS_COMPILE=${TARGET_PREFIX} CC="${TARGET_PREFIX}gcc
${TOOLCHAIN_OPTIONS}" V=1'
+EXTRA_OEMAKE = 'CROSS_COMPILE=${TARGET_PREFIX} CC="${TARGET_PREFIX}gcc
${TOOLCHAIN_OPTIONS}" V=1 SOURCE_DATE_EPOCH="$(date +%s)"'
EXTRA_OEMAKE += 'HOSTCC="${BUILD_CC} ${BUILD_CFLAGS} ${BUILD_LDFLAGS}"'
EXTRA_OEMAKE += 'STAGING_INCDIR=${STAGING_INCDIR_NATIVE}
STAGING_LIBDIR=${STAGING_LIBDIR_NATIVE}'
and the I only build u-boot to keep test cycle short.
>
> Also the short completion time is suspicious: it might indicate that
> both runs indeed take the same package from sstate. The test expects
> that the second run uses a private empty sstate to trigger a full
> rebuild.
Maybe but what about the missing reproducibleA/tmp and reproducibleB/tmp ?
Would these be missing if sstate is used for both?
In the log there is this:
INFO - Building reproducibleB (sstate NOT allowed)...
Jocke
>
> Alex
>
> On Mon, 22 Jan 2024 at 16:01, Joakim Tjernlund via
> lists.openembedded.org
> <Joakim.Tjernlund=infinera....@lists.openembedded.org> wrote:
> >
> > Whatever I do, ReproducibleTests always succeeds and I think I got a clue.
> > Looking at the logs below and the files after build one can see thate there
> > are no ...reproducibleA/tmp or ...reproducibleB/tmp dirs in the FS.
> >
> > Furthermore, deploy_A and deploy_B are the same. This all ends up with the
> > two builds overwrites
> > each other then ReproducibleTests compares the package with itself and that
> > will always succeed.
> >
> > I can't see/find an error in our yocto(Kirkstone) system, so I wonder if
> > this is an upstream bug?
> >
> > Jocke
> >
> > oe-selftest -v -K -r reproducible.ReproducibleTests.test_reproducible_builds
> > 2024-01-15 18:03:45,563 - oe-selftest - INFO - Adding layer libraries:
> > 2024-01-15 18:03:45,563 - oe-selftest - INFO -
> > /home/jocke/yocto-xr/3pp/poky/meta/lib
> > 2024-01-15 18:03:45,563 - oe-selftest - INFO -
> > /home/jocke/yocto-xr/3pp/poky/meta-yocto-bsp/lib
> > 2024-01-15 18:03:45,563 - oe-selftest - INFO -
> > /home/jocke/yocto-xr/3pp/meta-openembedded/meta-oe/lib
> > 2024-01-15 18:03:45,563 - oe-selftest - INFO -
> > /home/jocke/yocto-xr/meta-xr/lib
> > 2024-01-15 18:03:45,563 - oe-selftest - INFO -
> > /home/jocke/yocto-xr/3pp/poky/meta-selftest/lib
> > 2024-01-15 18:03:45,565 - oe-selftest - INFO - Running bitbake -e to test
> > the configuration is valid/parsable
> > 2024-01-15 18:03:50,702 - oe-selftest - INFO - Adding: "include
> > selftest.inc" in /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/local.conf
> > 2024-01-15 18:03:50,702 - oe-selftest - INFO - Adding: "include
> > bblayers.inc" in bblayers.conf
> > 2024-01-15 18:03:50,702 - oe-selftest - INFO - test_reproducible_builds
> > (reproducible.ReproducibleTests)
> > 2024-01-15 18:03:53,375 - oe-selftest - DEBUG - Writing to:
> > /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc
> >
> >
> > 2024-01-15 18:06:44,995 - oe-selftest - INFO - Config: PACKAGE_CLASSES =
> > "package_ipk"
> > INHIBIT_PACKAGE_STRIP = "1"
> > TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleA/tmp"
> > LICENSE_FLAGS_ACCEPTED = "commercial"
> > DISTRO_FEATURES:append = ' systemd pam'
> > USERADDEXTENSION = "useradd-staticids"
> > USERADD_ERROR_DYNAMIC = "skip"
> > USERADD_UID_TABLES += "files/static-passwd"
> > USERADD_GID_TABLES += "files/static-group"
> >
> > 2024-01-15 18:06:44,996 - oe-selftest - INFO - Building reproducibleA
> > (sstate allowed)...
> > 2024-01-15 18:06:44,996 - oe-selftest - DEBUG - Writing to:
> > /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc
> > PACKAGE_CLASSES = "package_ipk"
> > INHIBIT_PACKAGE_STRIP = "1"
> > TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleA/tmp"
> > LICENSE_FLAGS_ACCEPTED = "commercial"
> > DISTRO_FEATURES:append = ' systemd pam'
> > USERADDEXTENSION = "useradd-staticids"
> > USERADD_ERROR_DYNAMIC = "skip"
> > USERADD_UID_TABLES += "files/static-passwd"
> > USERADD_GID_TABLES += "files/static-group"
> >
> >
> > 2024-01-15 18:07:02,142 - oe-selftest - INFO - Config: PACKAGE_CLASSES =
> > "package_ipk"
> > INHIBIT_PACKAGE_STRIP = "1"
> > TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleB/tmp"
> > LICENSE_FLAGS_ACCEPTED = "commercial"
> > DISTRO_FEATURES:append = ' systemd pam'
> > USERADDEXTENSION = "useradd-staticids"
> > USERADD_ERROR_DYNAMIC = "skip"
> > USERADD_UID_TABLES += "files/static-passwd"
> > USERADD_GID_TABLES += "files/static-group"
> >
> > 2024-01-15 18:07:02,143 - oe-selftest - INFO - Building reproducibleB
> > (sstate NOT allowed)...
> > 2024-01-15 18:07:02,143 - oe-selftest - DEBUG - Writing to:
> > /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc
> > PACKAGE_CLASSES = "package_ipk"
> > INHIBIT_PACKAGE_STRIP = "1"
> > TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleB/tmp"
> > LICENSE_FLAGS_ACCEPTED = "commercial"
> > DISTRO_FEATURES:append = ' systemd pam'
> > USERADDEXTENSION = "useradd-staticids"
> > USERADD_ERROR_DYNAMIC = "skip"
> > USERADD_UID_TABLES += "files/static-passwd"
> > USERADD_GID_TABLES += "files/static-group"
> > SSTATE_DIR = "${TMPDIR}/sstate"
> > SSTATE_MIRRORS = "file://.*/.*-native.*
> > http://sstate.yoctoproject.org/all/PATH;downloadfilename=PATH
> > file://.*/.*-cross.*
> > http://sstate.yoctoproject.org/all/PATH;downloadfilename=PATH";
> >
> >
> > 2024-01-15 18:07:16,424 - oe-selftest - INFO - vars_A:{'DEPLOY_DIR_IPK':
> > '/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk'}
> > 2024-01-15 18:07:16,424 - oe-selftest - INFO - vars_B:{'DEPLOY_DIR_IPK':
> > '/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk'}
> > 2024-01-15 18:07:16,424 - oe-selftest - INFO - c in package_classes:ipk
> > 2024-01-15 18:07:16,424 - oe-selftest - INFO -
> > deploy_A:/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk
> > 2024-01-15 18:07:16,425 - oe-selftest - INFO -
> > deplay_B:/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk
> > 2024-01-15 18:07:16,425 - oe-selftest - INFO - Checking ipk packages for
> > differences...
> > 2024-01-15 18:07:16,442 - oe-selftest - INFO - Reproducibility summary for
> > ipk: same=4 different=0 different_excluded=0 missing=0 total=4
> > unused_exclusions=[]
> > 2024-01-15 18:07:16,442 - oe-selftest - INFO - ... ok
> > 2024-01-15 18:07:16,443 - oe-selftest - INFO -
> > ----------------------------------------------------------------------
> > 2024-01-15 18:07:16,443 - oe-selftest - INFO - Ran 1 test in 208.397s
> > 2024-01-15 18:07:16,443 - oe-selftest - INFO - OK
> > 2024-01-15 18:07:22,150 - oe-selftest - INFO - RESULTS:
> > 2024-01-15 18:07:22,150 - oe-selftest - INFO - RESULTS -
> > reproducible.ReproducibleTests.test_reproducible_builds: PASSED (205.74s)
> > 2024-01-15 18:07:22,154 - oe-selftest - INFO - SUMMARY:
> > 2024-01-15 18:07:22,154 - oe-selftest - INFO - oe-selftest () - Ran 1 test
> > in 208.398s
> > 2024-01-15 18:07:22,154 - oe-selftest - INFO - oe-selftest - OK - All
> > required tests passed (successes=1, skipped=0, failures=0, errors=0)
> >
> >
> >
> >
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#194179):
https://lists.openembedded.org/g/openembedded-core/message/194179
Mute This Topic: https://lists.openembedded.org/mt/103887646/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
