You are not showing what kind of error you expect to see. What is being tested for non-reproducibility?
Also the short completion time is suspicious: it might indicate that both runs indeed take the same package from sstate. The test expects that the second run uses a private empty sstate to trigger a full rebuild. Alex On Mon, 22 Jan 2024 at 16:01, Joakim Tjernlund via lists.openembedded.org <Joakim.Tjernlund=infinera....@lists.openembedded.org> wrote: > > Whatever I do, ReproducibleTests always succeeds and I think I got a clue. > Looking at the logs below and the files after build one can see thate there > are no ...reproducibleA/tmp or ...reproducibleB/tmp dirs in the FS. > > Furthermore, deploy_A and deploy_B are the same. This all ends up with the > two builds overwrites > each other then ReproducibleTests compares the package with itself and that > will always succeed. > > I can't see/find an error in our yocto(Kirkstone) system, so I wonder if this > is an upstream bug? > > Jocke > > oe-selftest -v -K -r reproducible.ReproducibleTests.test_reproducible_builds > 2024-01-15 18:03:45,563 - oe-selftest - INFO - Adding layer libraries: > 2024-01-15 18:03:45,563 - oe-selftest - INFO - > /home/jocke/yocto-xr/3pp/poky/meta/lib > 2024-01-15 18:03:45,563 - oe-selftest - INFO - > /home/jocke/yocto-xr/3pp/poky/meta-yocto-bsp/lib > 2024-01-15 18:03:45,563 - oe-selftest - INFO - > /home/jocke/yocto-xr/3pp/meta-openembedded/meta-oe/lib > 2024-01-15 18:03:45,563 - oe-selftest - INFO - > /home/jocke/yocto-xr/meta-xr/lib > 2024-01-15 18:03:45,563 - oe-selftest - INFO - > /home/jocke/yocto-xr/3pp/poky/meta-selftest/lib > 2024-01-15 18:03:45,565 - oe-selftest - INFO - Running bitbake -e to test the > configuration is valid/parsable > 2024-01-15 18:03:50,702 - oe-selftest - INFO - Adding: "include selftest.inc" > in /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/local.conf > 2024-01-15 18:03:50,702 - oe-selftest - INFO - Adding: "include bblayers.inc" > in bblayers.conf > 2024-01-15 18:03:50,702 - oe-selftest - INFO - test_reproducible_builds > (reproducible.ReproducibleTests) > 2024-01-15 18:03:53,375 - oe-selftest - DEBUG - Writing to: > /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc > > > 2024-01-15 18:06:44,995 - oe-selftest - INFO - Config: PACKAGE_CLASSES = > "package_ipk" > INHIBIT_PACKAGE_STRIP = "1" > TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleA/tmp" > LICENSE_FLAGS_ACCEPTED = "commercial" > DISTRO_FEATURES:append = ' systemd pam' > USERADDEXTENSION = "useradd-staticids" > USERADD_ERROR_DYNAMIC = "skip" > USERADD_UID_TABLES += "files/static-passwd" > USERADD_GID_TABLES += "files/static-group" > > 2024-01-15 18:06:44,996 - oe-selftest - INFO - Building reproducibleA (sstate > allowed)... > 2024-01-15 18:06:44,996 - oe-selftest - DEBUG - Writing to: > /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc > PACKAGE_CLASSES = "package_ipk" > INHIBIT_PACKAGE_STRIP = "1" > TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleA/tmp" > LICENSE_FLAGS_ACCEPTED = "commercial" > DISTRO_FEATURES:append = ' systemd pam' > USERADDEXTENSION = "useradd-staticids" > USERADD_ERROR_DYNAMIC = "skip" > USERADD_UID_TABLES += "files/static-passwd" > USERADD_GID_TABLES += "files/static-group" > > > 2024-01-15 18:07:02,142 - oe-selftest - INFO - Config: PACKAGE_CLASSES = > "package_ipk" > INHIBIT_PACKAGE_STRIP = "1" > TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleB/tmp" > LICENSE_FLAGS_ACCEPTED = "commercial" > DISTRO_FEATURES:append = ' systemd pam' > USERADDEXTENSION = "useradd-staticids" > USERADD_ERROR_DYNAMIC = "skip" > USERADD_UID_TABLES += "files/static-passwd" > USERADD_GID_TABLES += "files/static-group" > > 2024-01-15 18:07:02,143 - oe-selftest - INFO - Building reproducibleB (sstate > NOT allowed)... > 2024-01-15 18:07:02,143 - oe-selftest - DEBUG - Writing to: > /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc > PACKAGE_CLASSES = "package_ipk" > INHIBIT_PACKAGE_STRIP = "1" > TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleB/tmp" > LICENSE_FLAGS_ACCEPTED = "commercial" > DISTRO_FEATURES:append = ' systemd pam' > USERADDEXTENSION = "useradd-staticids" > USERADD_ERROR_DYNAMIC = "skip" > USERADD_UID_TABLES += "files/static-passwd" > USERADD_GID_TABLES += "files/static-group" > SSTATE_DIR = "${TMPDIR}/sstate" > SSTATE_MIRRORS = "file://.*/.*-native.* > http://sstate.yoctoproject.org/all/PATH;downloadfilename=PATH > file://.*/.*-cross.* > http://sstate.yoctoproject.org/all/PATH;downloadfilename=PATH" > > > 2024-01-15 18:07:16,424 - oe-selftest - INFO - vars_A:{'DEPLOY_DIR_IPK': > '/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk'} > 2024-01-15 18:07:16,424 - oe-selftest - INFO - vars_B:{'DEPLOY_DIR_IPK': > '/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk'} > 2024-01-15 18:07:16,424 - oe-selftest - INFO - c in package_classes:ipk > 2024-01-15 18:07:16,424 - oe-selftest - INFO - > deploy_A:/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk > 2024-01-15 18:07:16,425 - oe-selftest - INFO - > deplay_B:/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk > 2024-01-15 18:07:16,425 - oe-selftest - INFO - Checking ipk packages for > differences... > 2024-01-15 18:07:16,442 - oe-selftest - INFO - Reproducibility summary for > ipk: same=4 different=0 different_excluded=0 missing=0 total=4 > unused_exclusions=[] > 2024-01-15 18:07:16,442 - oe-selftest - INFO - ... ok > 2024-01-15 18:07:16,443 - oe-selftest - INFO - > ---------------------------------------------------------------------- > 2024-01-15 18:07:16,443 - oe-selftest - INFO - Ran 1 test in 208.397s > 2024-01-15 18:07:16,443 - oe-selftest - INFO - OK > 2024-01-15 18:07:22,150 - oe-selftest - INFO - RESULTS: > 2024-01-15 18:07:22,150 - oe-selftest - INFO - RESULTS - > reproducible.ReproducibleTests.test_reproducible_builds: PASSED (205.74s) > 2024-01-15 18:07:22,154 - oe-selftest - INFO - SUMMARY: > 2024-01-15 18:07:22,154 - oe-selftest - INFO - oe-selftest () - Ran 1 test in > 208.398s > 2024-01-15 18:07:22,154 - oe-selftest - INFO - oe-selftest - OK - All > required tests passed (successes=1, skipped=0, failures=0, errors=0) > > > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#194175): https://lists.openembedded.org/g/openembedded-core/message/194175 Mute This Topic: https://lists.openembedded.org/mt/103887646/21656 Group Owner: openembedded-core+ow...@lists.openembedded.org Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-