I’m sorry for splitting this message but it has happend by accident… Returning to the topic my assumption is that for some reason in reproducibleA, these miliseconds are cutted and in case of reproducibleB they are not.
This was obviously working for opkg-build in case of gnu format which is cutting it also but for posix format it stores and thus error occurs. My question is where can I find the code responsible for moving/coping data into these packages-split directories? BR Piotr ________________________________ Od: Piotr Łobacz <[email protected]> Wysłano: poniedziałek, lipca 31, 2023 9:03 PM Do: Alexandre Belloni <[email protected]> DW: [email protected] <[email protected]>; Alex Stewart <[email protected]> Temat: Re: [OE-Core][PATCH v11][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr OK, I have finally discovered the root cause. First of all there is another bug in yocto, for all these 19 packages. I have compared the full timestamps with 'ls —full-time’ command in both directories (meaning reproducibleA and reproducibleB) of packages-split/acpid-src and they differ even just before packages creation… Wysyłane z aplikacji Outlook dla systemu iOS<https://aka.ms/o0ukef> ________________________________ Od: [email protected] <[email protected]> w imieniu użytkownika Piotr Łobacz via lists.openembedded.org <[email protected]> Wysłane: Saturday, July 29, 2023 12:58:51 AM Do: Alexandre Belloni <[email protected]> DW: [email protected] <[email protected]>; Alex Stewart <[email protected]> Temat: ODP: ODP: [OE-Core][PATCH v11][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr Hello again, Funny thing, I have run the same revision as you in here https://autobuilder.yoctoproject.org/typhoon/#/builders/117/builds/3263 and I have different failures, but I have them: File "/media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/meta/lib/oeqa/selftest/cases/reproducible.py", line 327, in test_reproducible_builds self.fail('\n'.join(fails)) AssertionError: The following ipk packages are different and not in exclusion list: /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/acpid-src_2.0.34-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/avahi-src_0.8-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/bind-src_9.18.16-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/debugedit-src_5.0-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/flac-src_1.4.3-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/libjson-glib-1.0-dev_1.6.6-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/libjson-glib-1.0-ptest_1.6.6-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/libjson-glib-1.0-src_1.6.6-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/libmnl-src_1.0.5-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/libuuid-src_2.38.1-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/log4cplus-src_2.1.0-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/lttng-tools-src_2.13.9-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/python3-numpy-src_1.25.1-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/python3-pygobject-dev_3.44.1-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/python3-pygobject-src_3.44.1-r0_core2-64.ipk /media/plobacz/9582beb9-8774-4d4d-976f-63a6f1c87c13/poky-contrib/build-st/reproducibleB/tmp/deploy/ipk/./core2-64/python3-pygobject_3.44.1-r0_core2-64.ipk 2023-07-29 00:18:31,843 - oe-selftest - INFO - ---------------------------------------------------------------------- 2023-07-29 00:18:31,843 - oe-selftest - INFO - Ran 2 tests in 51978.070s 2023-07-29 00:18:31,843 - oe-selftest - INFO - FAILED 2023-07-29 00:18:31,843 - oe-selftest - INFO - (failures=1) 2023-07-29 00:18:35,545 - oe-selftest - INFO - RESULTS: 2023-07-29 00:18:35,546 - oe-selftest - INFO - RESULTS - reproducible.DiffoscopeTests.test_diffoscope: PASSED (35.32s) 2023-07-29 00:18:35,546 - oe-selftest - INFO - RESULTS - reproducible.ReproducibleTests.test_reproducible_builds: FAILED (51940.60s) 2023-07-29 00:18:35,948 - oe-selftest - INFO - SUMMARY: 2023-07-29 00:18:35,949 - oe-selftest - INFO - oe-selftest () - Ran 2 tests in 51978.070s 2023-07-29 00:18:35,949 - oe-selftest - INFO - oe-selftest - FAIL - Required tests failed (successes=1, skipped=0, failures=1, errors=0) due to this tests result difference, my suspicion at the moment is only the possibility of changing the format between gnu and posix depending on DISTRO_FEATURES having acl and/or xattr. I will force now tar format to have only posix format and run another test. We will be in touch. BR Piotr ________________________________ Od: Alexandre Belloni <[email protected]> Wysłane: czwartek, 27 lipca 2023 16:18 Do: Piotr Łobacz <[email protected]> DW: [email protected] <[email protected]>; Alex Stewart <[email protected]> Temat: Re: ODP: [OE-Core][PATCH v11][master-next 1/5] package_ipk.bbclass: add support for ACLs and xattr Hello, I sent this to the autobuilders and I got the same reproducibility failure as earlier: https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fautobuilder.yoctoproject.org%2Ftyphoon%2F%23%2Fbuilders%2F117%2Fbuilds%2F3263%2Fsteps%2F13%2Flogs%2Fstdio&data=05%7C01%7Cp.lobacz%40welotec.com%7C8fb759c0e1ab49b0c69408db8eac5547%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638260643038719160%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=C6mYlLwOmYosyl1ZIS8vKQf2ailFqMqBXeamF%2FnSE7E%3D&reserved=0<https://autobuilder.yoctoproject.org/typhoon/#/builders/117/builds/3263/steps/13/logs/stdio> I'm not sure why you wouldn't see those. On 26/07/2023 09:27:53+0000, Piotr Łobacz wrote: > > Hi Alexandre, Alex, > Thx for supporting me, I have finally discovered the issue regarding this > packages differences. > It occurred that I was badly comparing two strings for tarformat comparison. > Now it is fixed and should finally work. > > This has been additionally tested with oe-selftest -r reproducible. > > BR > Piotr > > Od: Piotr Łobacz <[email protected]> > Wysłane: środa, 26 lipca 2023 11:22 > Do: [email protected] > <[email protected]> > DW: Piotr Łobacz <[email protected]> > Temat: [OE-Core][PATCH v11][master-next 1/5] package_ipk.bbclass: add support > for ACLs and xattr > > Extend OPKGBUILDCMD variable, with additional parameters, depending > on target distro features, in order to support ACLs and xattr. > > With fix pushed to the opkg-devel: > https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fg%2Fopkg-devel%2Fc%2FdYNHrLjDwg8&data=05%7C01%7Cp.lobacz%40welotec.com%7C8fb759c0e1ab49b0c69408db8eac5547%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638260643038719160%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=aZziODWaDuhvajNYsPmX47BT2z2CLK8NpgFeF80X1Jg%3D&reserved=0<https://groups.google.com/g/opkg-devel/c/dYNHrLjDwg8> > opkg-build is able to create tar archives with ACLs and xattr. > > Signed-off-by: Piotr Łobacz <[email protected]> > --- > meta/classes-global/package_ipk.bbclass | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/meta/classes-global/package_ipk.bbclass > b/meta/classes-global/package_ipk.bbclass > index b4b7bc9ac2..a0f106e4ad 100644 > --- a/meta/classes-global/package_ipk.bbclass > +++ b/meta/classes-global/package_ipk.bbclass > @@ -15,7 +15,7 @@ IPKGCONF_SDK_TARGET = "${WORKDIR}/opkg-sdk-target.conf" > PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks" > > # Program to be used to build opkg packages > -OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"' > +OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}" > ${@bb.utils.contains('DISTRO_FEATURES', 'acl', '-A', '', d)} > ${@bb.utils.contains('DISTRO_FEATURES', 'xattr', '-X', '', d)}' > > OPKG_ARGS += "--force_postinstall --prefer-arch-to-version" > OPKG_ARGS += "${@['', > '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}" > -- > 2.34.1 > > > -- Alexandre Belloni, co-owner and COO, Bootlin Embedded Linux and Kernel engineering https://eur04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbootlin.com%2F&data=05%7C01%7Cp.lobacz%40welotec.com%7C8fb759c0e1ab49b0c69408db8eac5547%7C25111a7f1d5a4c51a4ca7f8e44011b39%7C0%7C0%7C638260643038719160%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=QdR%2FSw2mI6zSaDoLdARAe4Q9CTcPPR5Jazo1mllODi4%3D&reserved=0<https://bootlin.com/>
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#185163): https://lists.openembedded.org/g/openembedded-core/message/185163 Mute This Topic: https://lists.openembedded.org/mt/100468421/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
