On Thu, Jan 22, 2026 at 9:33 AM Khem Raj via lists.openembedded.org <[email protected]> wrote:
> here are few recipes in meta-openembedded which are failing with python > 3.14, help in fixing this is appreciated > > https://autobuilder.yoctoproject.org/valkyrie/#/builders/81/builds/1260 > I have an upgrade for python3-orjson staged (including a fix for riscv64). I would like to add ptest and do some more testing on other architectures. Upstream seems resistant to embedded and cross-compilation, so I am trying to decide what to do with submitting. (My testing also was on top of the python3-maturin upgrade in oe-core). https://git.openembedded.org/meta-openembedded-contrib/log/?h=timo/python3-orjson-3.11.5 If we want to take this as is and address ptest and Upstream-Status later, I am fine with that. > On Tue, Jan 13, 2026 at 9:58 AM Trevor Gamblin via lists.openembedded.org > <[email protected]> wrote: > >> I know that there's a large backlog and bigger issues than taking an >> upgrade >> patch series right now, but I wanted to make sure I had tested this >> properly and >> submitted it with all of the necessary components before moving on. >> >> Compared to v3 >> (https://lists.openembedded.org/g/openembedded-core/topic/117176199): >> >> - Added compression module changes to python3-compression split in a new >> patch >> >> One final set of tests: >> >> ptests: >> >> |== Tests result: SUCCESS == >> | >> |28 tests skipped: >> | test.test_asyncio.test_windows_events >> | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace >> | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full >> | test.test_gdb.test_misc test.test_gdb.test_pretty_print >> | test_android test_apple test_asdl_parser test_clinic test_devpoll >> | test_free_threading test_generated_cases test_idle test_kqueue >> | test_launcher test_msvcrt test_startfile test_tcl test_tkinter >> | test_ttk test_ttk_textonly test_turtle test_winapi >> | test_winconsoleio test_winreg test_wmi >> | >> |8 tests skipped (resource denied): >> | test_curses test_peg_generator test_smtpnet test_socketserver >> | test_urllib2net test_urllibnet test_winsound test_zipfile64 >> | >> |455 tests OK. >> | >> |Total duration: 3 min 43 sec >> |Total tests: run=46,462 skipped=2,384 >> |Total test files: run=483/491 skipped=28 resource_denied=8 >> |Result: SUCCESS >> |DURATION: 224 >> |END: /usr/lib/python3/ptest >> |2026-01-13T17:51 >> |STOP: ptest-runner >> |TOTAL: 1 FAIL: 0 >> |root@qemux86-64:~# >> >> Reproducibility (gcc-doc failed, python3 did not): >> >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - >> ====================================================================== >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAIL: >> test_reproducible_builds >> (reproducible.ReproducibleTests.test_reproducible_builds) >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - >> ---------------------------------------------------------------------- >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - Traceback (most recent >> call last): >> | File >> "/home/tgamblin/workspace/yocto/openembedded-core/meta/lib/oeqa/selftest/cases/reproducible.py", >> line 406, in test_reproducible_builds >> | self.fail('\n'.join(fails)) >> | ~~~~~~~~~^^^^^^^^^^^^^^^^^^ >> |AssertionError: The following deb packages are different and not in >> exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb >> |The following ipk packages are different and not in exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk >> |The following rpm packages are different and not in exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm >> | >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - >> ---------------------------------------------------------------------- >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - Ran 1 test in 1549.611s >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAILED >> |2026-01-13 12:42:25,446 - oe-selftest - INFO - (failures=1) >> |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS: >> |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS - >> reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1549.36s) >> |2026-01-13 12:42:31,461 - oe-selftest - INFO - SUMMARY: >> |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest () - Ran 1 >> test in 1549.611s >> |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest - FAIL - >> Required tests failed (successes=0, skipped=0, failures=1, errors=0) >> >> buildall-qemu: >> >> |BUILDALL-QEMU LOG FOR python3 >> |START TIME: 2026-01-13_11:25:54 >> |HOSTNAME: megalith >> |HOST OS: Fedora Linux 43 (Server Edition) >> |HOST KERNEL: 6.17.12-300.fc43.x86_64 >> |=============== >> |BUILD RESULTS: >> |[glibc] >> |PASS: qemuarm >> |PASS: qemuarm64 >> |PASS: qemuarmv5 >> |PASS: qemuloongarch64 >> |PASS: qemumips >> |PASS: qemumips64 >> |PASS: qemuppc >> |PASS: qemuppc64 >> |PASS: qemuriscv32 >> |PASS: qemuriscv64 >> |PASS: qemux86-64 >> |PASS: qemux86 >> |[musl] >> |PASS: qemuarm >> |PASS: qemuarm64 >> |PASS: qemuarmv5 >> |FAIL: qemuloongarch64 >> |PASS: qemumips >> |PASS: qemumips64 >> |PASS: qemuppc >> |PASS: qemuppc64 >> |PASS: qemuriscv32 >> |PASS: qemuriscv64 >> |PASS: qemux86-64 >> |PASS: qemux86 >> |=============== >> |PASSED: 23 >> |FAILED: 1 >> >> v3 details below. >> >> Compared to v2 >> (https://lists.openembedded.org/g/openembedded-core/message/228232): >> >> - rebase on top of the 3.13.11 python3 recipe in master; >> - add a patch to include the _ast_unparse module in the core split, >> fixing some >> import issues for annotationlib >> >> I've kept the original ptest, reproducibility, and buildall checks in the >> respective patches, but here is another set of runs for completeness: >> >> ptests: >> >> |== Tests result: SUCCESS == >> | >> |28 tests skipped: >> | test.test_asyncio.test_windows_events >> | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace >> | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full >> | test.test_gdb.test_misc test.test_gdb.test_pretty_print >> | test_android test_apple test_asdl_parser test_clinic test_devpoll >> | test_free_threading test_generated_cases test_idle test_kqueue >> | test_launcher test_msvcrt test_startfile test_tcl test_tkinter >> | test_ttk test_ttk_textonly test_turtle test_winapi >> | test_winconsoleio test_winreg test_wmi >> | >> |8 tests skipped (resource denied): >> | test_curses test_peg_generator test_smtpnet test_socketserver >> | test_urllib2net test_urllibnet test_winsound test_zipfile64 >> | >> |455 tests OK. >> | >> |Total duration: 3 min 44 sec >> |Total tests: run=46,462 skipped=2,384 >> |Total test files: run=483/491 skipped=28 resource_denied=8 >> |Result: SUCCESS >> |DURATION: 224 >> |END: /usr/lib/python3/ptest >> |2026-01-08T14:58 >> |STOP: ptest-runner >> |TOTAL: 1 FAIL: 0 >> >> Reproducibility OK (saw issue with gcc-doc, but not python3): >> >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb >> |The following ipk packages are different and not in exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk >> |The following rpm packages are different and not in exclusion list: >> >> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm >> | >> |2026-01-08 13:18:28,640 - oe-selftest - INFO - >> ---------------------------------------------------------------------- >> |2026-01-08 13:18:28,640 - oe-selftest - INFO - Ran 1 test in 1285.587s >> |2026-01-08 13:18:28,640 - oe-selftest - INFO - FAILED >> |2026-01-08 13:18:28,640 - oe-selftest - INFO - (failures=1) >> |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS: >> |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS - >> reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1285.41s) >> |2026-01-08 13:18:31,660 - oe-selftest - INFO - SUMMARY: >> |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest () - Ran 1 >> test in 1285.588s >> |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest - FAIL - >> Required tests failed (successes=0, skipped=0, failures=1, errors=0) >> >> buildall-qemu: >> >> |BUILDALL-QEMU LOG FOR python3 >> |START TIME: 2026-01-08_13:27:10 >> |HOSTNAME: megalith >> |HOST OS: Fedora Linux 43 (Server Edition) >> |HOST KERNEL: 6.17.12-300.fc43.x86_64 >> |=============== >> |BUILD RESULTS: >> |[glibc] >> |PASS: qemuarm >> |PASS: qemuarm64 >> |PASS: qemuarmv5 >> |PASS: qemuloongarch64 >> |PASS: qemumips >> |PASS: qemumips64 >> |PASS: qemuppc >> |PASS: qemuppc64 >> |PASS: qemuriscv32 >> |PASS: qemuriscv64 >> |PASS: qemux86-64 >> |PASS: qemux86 >> |[musl] >> |PASS: qemuarm >> |PASS: qemuarm64 >> |PASS: qemuarmv5 >> |FAIL: qemuloongarch64 >> |PASS: qemumips >> |PASS: qemumips64 >> |PASS: qemuppc >> |PASS: qemuppc64 >> |PASS: qemuriscv32 >> |PASS: qemuriscv64 >> |PASS: qemux86-64 >> |PASS: qemux86 >> |=============== >> |PASSED: 23 >> |FAILED: 1 >> >> v2 details below. >> >> Compared to v1 >> (https://lists.openembedded.org/g/openembedded-core/message/227955): >> >> - Drop python3-bcrypt upgrade, as someone else has submitted that; >> - Drop rpm patch to manually override Python3_SITEARCH with a patch, as >> that was >> masking the real issue (see below); >> - Add a new patch to fix python3targetconfig by exporting >> _PYTHON_PROJECT_BASE, >> which Python's sysconfig looks for (as of 3.14.0) when doing >> cross-compilation. The absence of this was resulting in packages like >> rpm >> finding paths for the native interpreter when making use of sysconfig, >> when >> they needed the host values. >> >> Note that I've dropped my own version of the python3-bcrypt upgrade, but I >> tested this patch series on top of the other one that was submitted, as >> otherwise the ptest images would break during build (version mismatch >> errors >> around PyO3, which is fixed with the bcrypt upgrade). >> >> v1 details below. >> >> This supersedes a previous series sent, which only did the 3.14.0 upgrade. >> >> Compared to the first series >> (https://lists.openembedded.org/g/openembedded-core/message/227310), I've >> done the following: >> >> - Added a commit for including the '_py_warnings' and 'annotationlib' >> modules in >> python3-core; >> - Adds the python 3.14.2 upgrade; >> - Removed commits for adding python3-misc to RDEPENDS for python3-pytest >> and >> python3-jsonpointer, as these are now solved by a new patch to add new >> modules >> to python3-core in the manifest. Doing it this way was fragile in the >> sense >> that there were many other recipes needing this same fix that testing >> didn't >> easily catch, and it doesn't make sense to add python3-misc to recipe >> RDEPENDS >> just because (for example) python3-logging (another package split) is >> trying >> to make use of warnings, but can't find the right module; >> - Modified the rpm commit to apply a patch (submitted upstream) to fix >> CMakeLists.txt, rather than a do_configure prepend; >> - Fixed the Python 3.14.0 upgrade commit so that one of the patches we >> carry to >> skip tests doesn't include duplicate calls to the relevant skip >> functions. >> >> I've kept the upgrades from 3.13.11 to 3.14.0 and 3.14.0 to 3.14.2 >> separate to >> reflect separate testing and let people review those changelogs >> individually if >> desired. >> >> Trevor Gamblin (7): >> python3: upgrade 3.13.11 -> 3.14.0 >> python3targetconfig: export _PYTHON_PROJECT_BASE >> python_pep517: add --prefix to nativepython3 call >> python3: upgrade 3.14.0 -> 3.14.2 >> python3: add _py_warnings, annotationlib to core >> python3: add _ast_unparse to core >> python3: add new files to compression >> >> meta/classes-recipe/python3-dir.bbclass | 2 +- >> .../python3targetconfig.bbclass | 1 + >> meta/classes-recipe/python_pep517.bbclass | 2 +- >> ...r-OpenSSL-3.4-and-add-it-to-multissl.patch | 1452 ----------------- >> ...-use-prefix-value-from-build-configu.patch | 35 +- >> ...sts-due-to-load-variability-on-YP-AB.patch | 31 +- >> ...ctive_children-skip-problematic-test.patch | 17 +- >> ...1-test_cmd-skip-bang-completion-test.patch | 31 + >> ...-test_unix_console.test_cursor_back_.patch | 46 + >> ...kip-test_sysconfig.test_sysconfigdat.patch | 32 + >> .../python/python3/python3-manifest.json | 14 +- >> .../{python3_3.13.11.bb => python3_3.14.2.bb} | 20 +- >> 12 files changed, 195 insertions(+), 1488 deletions(-) >> delete mode 100644 >> meta/recipes-devtools/python/python3/0001-Generate-data-for-OpenSSL-3.4-and-add-it-to-multissl.patch >> create mode 100644 >> meta/recipes-devtools/python/python3/0001-test_cmd-skip-bang-completion-test.patch >> create mode 100644 >> meta/recipes-devtools/python/python3/0001-test_pyrepl-skip-test_unix_console.test_cursor_back_.patch >> create mode 100644 >> meta/recipes-devtools/python/python3/0001-test_sysconfig-skip-test_sysconfig.test_sysconfigdat.patch >> rename meta/recipes-devtools/python/{python3_3.13.11.bb => >> python3_3.14.2.bb} (95%) >> >> -- >> 2.52.0 >> >> >> >> >> > > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#229859): https://lists.openembedded.org/g/openembedded-core/message/229859 Mute This Topic: https://lists.openembedded.org/mt/117247400/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
