You are not showing what kind of error you expect to see. What is
being tested for non-reproducibility?

Also the short completion time is suspicious: it might indicate that
both runs indeed take the same package from sstate. The test expects
that the second run uses a private empty sstate to trigger a full
rebuild.

Alex

On Mon, 22 Jan 2024 at 16:01, Joakim Tjernlund via
lists.openembedded.org
<Joakim.Tjernlund=infinera....@lists.openembedded.org> wrote:
>
> Whatever I do, ReproducibleTests always succeeds and I think I got a clue.
> Looking at the logs below and the files after build one can see thate there
> are no  ...reproducibleA/tmp or ...reproducibleB/tmp dirs in the FS.
>
> Furthermore, deploy_A and deploy_B are the same. This all ends up with the 
> two builds overwrites
> each other then ReproducibleTests compares the package with itself and that 
> will always succeed.
>
> I can't see/find an error in our yocto(Kirkstone) system, so I wonder if this 
> is an upstream bug?
>
>  Jocke
>
> oe-selftest -v -K -r reproducible.ReproducibleTests.test_reproducible_builds
> 2024-01-15 18:03:45,563 - oe-selftest - INFO - Adding layer libraries:
> 2024-01-15 18:03:45,563 - oe-selftest - INFO -  
> /home/jocke/yocto-xr/3pp/poky/meta/lib
> 2024-01-15 18:03:45,563 - oe-selftest - INFO -  
> /home/jocke/yocto-xr/3pp/poky/meta-yocto-bsp/lib
> 2024-01-15 18:03:45,563 - oe-selftest - INFO -  
> /home/jocke/yocto-xr/3pp/meta-openembedded/meta-oe/lib
> 2024-01-15 18:03:45,563 - oe-selftest - INFO -  
> /home/jocke/yocto-xr/meta-xr/lib
> 2024-01-15 18:03:45,563 - oe-selftest - INFO -  
> /home/jocke/yocto-xr/3pp/poky/meta-selftest/lib
> 2024-01-15 18:03:45,565 - oe-selftest - INFO - Running bitbake -e to test the 
> configuration is valid/parsable
> 2024-01-15 18:03:50,702 - oe-selftest - INFO - Adding: "include selftest.inc" 
> in /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/local.conf
> 2024-01-15 18:03:50,702 - oe-selftest - INFO - Adding: "include bblayers.inc" 
> in bblayers.conf
> 2024-01-15 18:03:50,702 - oe-selftest - INFO - test_reproducible_builds 
> (reproducible.ReproducibleTests)
> 2024-01-15 18:03:53,375 - oe-selftest - DEBUG - Writing to: 
> /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc
>
>
> 2024-01-15 18:06:44,995 - oe-selftest - INFO - Config: PACKAGE_CLASSES = 
> "package_ipk"
> INHIBIT_PACKAGE_STRIP = "1"
> TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleA/tmp"
> LICENSE_FLAGS_ACCEPTED = "commercial"
> DISTRO_FEATURES:append = ' systemd pam'
> USERADDEXTENSION = "useradd-staticids"
> USERADD_ERROR_DYNAMIC = "skip"
> USERADD_UID_TABLES += "files/static-passwd"
> USERADD_GID_TABLES += "files/static-group"
>
> 2024-01-15 18:06:44,996 - oe-selftest - INFO - Building reproducibleA (sstate 
> allowed)...
> 2024-01-15 18:06:44,996 - oe-selftest - DEBUG - Writing to: 
> /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc
> PACKAGE_CLASSES = "package_ipk"
> INHIBIT_PACKAGE_STRIP = "1"
> TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleA/tmp"
> LICENSE_FLAGS_ACCEPTED = "commercial"
> DISTRO_FEATURES:append = ' systemd pam'
> USERADDEXTENSION = "useradd-staticids"
> USERADD_ERROR_DYNAMIC = "skip"
> USERADD_UID_TABLES += "files/static-passwd"
> USERADD_GID_TABLES += "files/static-group"
>
>
> 2024-01-15 18:07:02,142 - oe-selftest - INFO - Config: PACKAGE_CLASSES = 
> "package_ipk"
> INHIBIT_PACKAGE_STRIP = "1"
> TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleB/tmp"
> LICENSE_FLAGS_ACCEPTED = "commercial"
> DISTRO_FEATURES:append = ' systemd pam'
> USERADDEXTENSION = "useradd-staticids"
> USERADD_ERROR_DYNAMIC = "skip"
> USERADD_UID_TABLES += "files/static-passwd"
> USERADD_GID_TABLES += "files/static-group"
>
> 2024-01-15 18:07:02,143 - oe-selftest - INFO - Building reproducibleB (sstate 
> NOT allowed)...
> 2024-01-15 18:07:02,143 - oe-selftest - DEBUG - Writing to: 
> /home/jocke/yocto-xr/build/infn-xr/gmcu-st/conf/selftest.inc
> PACKAGE_CLASSES = "package_ipk"
> INHIBIT_PACKAGE_STRIP = "1"
> TMPDIR = "/home/jocke/yocto-xr/build/infn-xr/gmcu-st/reproducibleB/tmp"
> LICENSE_FLAGS_ACCEPTED = "commercial"
> DISTRO_FEATURES:append = ' systemd pam'
> USERADDEXTENSION = "useradd-staticids"
> USERADD_ERROR_DYNAMIC = "skip"
> USERADD_UID_TABLES += "files/static-passwd"
> USERADD_GID_TABLES += "files/static-group"
> SSTATE_DIR = "${TMPDIR}/sstate"
> SSTATE_MIRRORS = "file://.*/.*-native.*  
> http://sstate.yoctoproject.org/all/PATH;downloadfilename=PATH 
> file://.*/.*-cross.*
> http://sstate.yoctoproject.org/all/PATH;downloadfilename=PATH";
>
>
> 2024-01-15 18:07:16,424 - oe-selftest - INFO - vars_A:{'DEPLOY_DIR_IPK': 
> '/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk'}
> 2024-01-15 18:07:16,424 - oe-selftest - INFO - vars_B:{'DEPLOY_DIR_IPK': 
> '/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk'}
> 2024-01-15 18:07:16,424 - oe-selftest - INFO - c in package_classes:ipk
> 2024-01-15 18:07:16,424 - oe-selftest - INFO - 
> deploy_A:/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk
> 2024-01-15 18:07:16,425 - oe-selftest - INFO - 
> deplay_B:/home/jocke/yocto-xr/build/infn-xr/gmcu-st/tmp/deploy/ipk
> 2024-01-15 18:07:16,425 - oe-selftest - INFO - Checking ipk packages for 
> differences...
> 2024-01-15 18:07:16,442 - oe-selftest - INFO - Reproducibility summary for 
> ipk: same=4 different=0 different_excluded=0 missing=0 total=4
> unused_exclusions=[]
> 2024-01-15 18:07:16,442 - oe-selftest - INFO -  ... ok
> 2024-01-15 18:07:16,443 - oe-selftest - INFO - 
> ----------------------------------------------------------------------
> 2024-01-15 18:07:16,443 - oe-selftest - INFO - Ran 1 test in 208.397s
> 2024-01-15 18:07:16,443 - oe-selftest - INFO - OK
> 2024-01-15 18:07:22,150 - oe-selftest - INFO - RESULTS:
> 2024-01-15 18:07:22,150 - oe-selftest - INFO - RESULTS - 
> reproducible.ReproducibleTests.test_reproducible_builds: PASSED (205.74s)
> 2024-01-15 18:07:22,154 - oe-selftest - INFO - SUMMARY:
> 2024-01-15 18:07:22,154 - oe-selftest - INFO - oe-selftest () - Ran 1 test in 
> 208.398s
> 2024-01-15 18:07:22,154 - oe-selftest - INFO - oe-selftest - OK - All 
> required tests passed (successes=1, skipped=0, failures=0, errors=0)
>
>
> 
>
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#194175): 
https://lists.openembedded.org/g/openembedded-core/message/194175
Mute This Topic: https://lists.openembedded.org/mt/103887646/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to