I know that there's a large backlog and bigger issues than taking an upgrade patch series right now, but I wanted to make sure I had tested this properly and submitted it with all of the necessary components before moving on.
Compared to v3 (https://lists.openembedded.org/g/openembedded-core/topic/117176199): - Added compression module changes to python3-compression split in a new patch One final set of tests: ptests: |== Tests result: SUCCESS == | |28 tests skipped: | test.test_asyncio.test_windows_events | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full | test.test_gdb.test_misc test.test_gdb.test_pretty_print | test_android test_apple test_asdl_parser test_clinic test_devpoll | test_free_threading test_generated_cases test_idle test_kqueue | test_launcher test_msvcrt test_startfile test_tcl test_tkinter | test_ttk test_ttk_textonly test_turtle test_winapi | test_winconsoleio test_winreg test_wmi | |8 tests skipped (resource denied): | test_curses test_peg_generator test_smtpnet test_socketserver | test_urllib2net test_urllibnet test_winsound test_zipfile64 | |455 tests OK. | |Total duration: 3 min 43 sec |Total tests: run=46,462 skipped=2,384 |Total test files: run=483/491 skipped=28 resource_denied=8 |Result: SUCCESS |DURATION: 224 |END: /usr/lib/python3/ptest |2026-01-13T17:51 |STOP: ptest-runner |TOTAL: 1 FAIL: 0 |root@qemux86-64:~# Reproducibility (gcc-doc failed, python3 did not): |2026-01-13 12:42:25,446 - oe-selftest - INFO - ====================================================================== |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAIL: test_reproducible_builds (reproducible.ReproducibleTests.test_reproducible_builds) |2026-01-13 12:42:25,446 - oe-selftest - INFO - ---------------------------------------------------------------------- |2026-01-13 12:42:25,446 - oe-selftest - INFO - Traceback (most recent call last): | File "/home/tgamblin/workspace/yocto/openembedded-core/meta/lib/oeqa/selftest/cases/reproducible.py", line 406, in test_reproducible_builds | self.fail('\n'.join(fails)) | ~~~~~~~~~^^^^^^^^^^^^^^^^^^ |AssertionError: The following deb packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb |The following ipk packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk |The following rpm packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm | |2026-01-13 12:42:25,446 - oe-selftest - INFO - ---------------------------------------------------------------------- |2026-01-13 12:42:25,446 - oe-selftest - INFO - Ran 1 test in 1549.611s |2026-01-13 12:42:25,446 - oe-selftest - INFO - FAILED |2026-01-13 12:42:25,446 - oe-selftest - INFO - (failures=1) |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS: |2026-01-13 12:42:28,656 - oe-selftest - INFO - RESULTS - reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1549.36s) |2026-01-13 12:42:31,461 - oe-selftest - INFO - SUMMARY: |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest () - Ran 1 test in 1549.611s |2026-01-13 12:42:31,461 - oe-selftest - INFO - oe-selftest - FAIL - Required tests failed (successes=0, skipped=0, failures=1, errors=0) buildall-qemu: |BUILDALL-QEMU LOG FOR python3 |START TIME: 2026-01-13_11:25:54 |HOSTNAME: megalith |HOST OS: Fedora Linux 43 (Server Edition) |HOST KERNEL: 6.17.12-300.fc43.x86_64 |=============== |BUILD RESULTS: |[glibc] |PASS: qemuarm |PASS: qemuarm64 |PASS: qemuarmv5 |PASS: qemuloongarch64 |PASS: qemumips |PASS: qemumips64 |PASS: qemuppc |PASS: qemuppc64 |PASS: qemuriscv32 |PASS: qemuriscv64 |PASS: qemux86-64 |PASS: qemux86 |[musl] |PASS: qemuarm |PASS: qemuarm64 |PASS: qemuarmv5 |FAIL: qemuloongarch64 |PASS: qemumips |PASS: qemumips64 |PASS: qemuppc |PASS: qemuppc64 |PASS: qemuriscv32 |PASS: qemuriscv64 |PASS: qemux86-64 |PASS: qemux86 |=============== |PASSED: 23 |FAILED: 1 v3 details below. Compared to v2 (https://lists.openembedded.org/g/openembedded-core/message/228232): - rebase on top of the 3.13.11 python3 recipe in master; - add a patch to include the _ast_unparse module in the core split, fixing some import issues for annotationlib I've kept the original ptest, reproducibility, and buildall checks in the respective patches, but here is another set of runs for completeness: ptests: |== Tests result: SUCCESS == | |28 tests skipped: | test.test_asyncio.test_windows_events | test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace | test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full | test.test_gdb.test_misc test.test_gdb.test_pretty_print | test_android test_apple test_asdl_parser test_clinic test_devpoll | test_free_threading test_generated_cases test_idle test_kqueue | test_launcher test_msvcrt test_startfile test_tcl test_tkinter | test_ttk test_ttk_textonly test_turtle test_winapi | test_winconsoleio test_winreg test_wmi | |8 tests skipped (resource denied): | test_curses test_peg_generator test_smtpnet test_socketserver | test_urllib2net test_urllibnet test_winsound test_zipfile64 | |455 tests OK. | |Total duration: 3 min 44 sec |Total tests: run=46,462 skipped=2,384 |Total test files: run=483/491 skipped=28 resource_denied=8 |Result: SUCCESS |DURATION: 224 |END: /usr/lib/python3/ptest |2026-01-08T14:58 |STOP: ptest-runner |TOTAL: 1 FAIL: 0 Reproducibility OK (saw issue with gcc-doc, but not python3): |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb |The following ipk packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk |The following rpm packages are different and not in exclusion list: |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm | |2026-01-08 13:18:28,640 - oe-selftest - INFO - ---------------------------------------------------------------------- |2026-01-08 13:18:28,640 - oe-selftest - INFO - Ran 1 test in 1285.587s |2026-01-08 13:18:28,640 - oe-selftest - INFO - FAILED |2026-01-08 13:18:28,640 - oe-selftest - INFO - (failures=1) |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS: |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS - reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1285.41s) |2026-01-08 13:18:31,660 - oe-selftest - INFO - SUMMARY: |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest () - Ran 1 test in 1285.588s |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest - FAIL - Required tests failed (successes=0, skipped=0, failures=1, errors=0) buildall-qemu: |BUILDALL-QEMU LOG FOR python3 |START TIME: 2026-01-08_13:27:10 |HOSTNAME: megalith |HOST OS: Fedora Linux 43 (Server Edition) |HOST KERNEL: 6.17.12-300.fc43.x86_64 |=============== |BUILD RESULTS: |[glibc] |PASS: qemuarm |PASS: qemuarm64 |PASS: qemuarmv5 |PASS: qemuloongarch64 |PASS: qemumips |PASS: qemumips64 |PASS: qemuppc |PASS: qemuppc64 |PASS: qemuriscv32 |PASS: qemuriscv64 |PASS: qemux86-64 |PASS: qemux86 |[musl] |PASS: qemuarm |PASS: qemuarm64 |PASS: qemuarmv5 |FAIL: qemuloongarch64 |PASS: qemumips |PASS: qemumips64 |PASS: qemuppc |PASS: qemuppc64 |PASS: qemuriscv32 |PASS: qemuriscv64 |PASS: qemux86-64 |PASS: qemux86 |=============== |PASSED: 23 |FAILED: 1 v2 details below. Compared to v1 (https://lists.openembedded.org/g/openembedded-core/message/227955): - Drop python3-bcrypt upgrade, as someone else has submitted that; - Drop rpm patch to manually override Python3_SITEARCH with a patch, as that was masking the real issue (see below); - Add a new patch to fix python3targetconfig by exporting _PYTHON_PROJECT_BASE, which Python's sysconfig looks for (as of 3.14.0) when doing cross-compilation. The absence of this was resulting in packages like rpm finding paths for the native interpreter when making use of sysconfig, when they needed the host values. Note that I've dropped my own version of the python3-bcrypt upgrade, but I tested this patch series on top of the other one that was submitted, as otherwise the ptest images would break during build (version mismatch errors around PyO3, which is fixed with the bcrypt upgrade). v1 details below. This supersedes a previous series sent, which only did the 3.14.0 upgrade. Compared to the first series (https://lists.openembedded.org/g/openembedded-core/message/227310), I've done the following: - Added a commit for including the '_py_warnings' and 'annotationlib' modules in python3-core; - Adds the python 3.14.2 upgrade; - Removed commits for adding python3-misc to RDEPENDS for python3-pytest and python3-jsonpointer, as these are now solved by a new patch to add new modules to python3-core in the manifest. Doing it this way was fragile in the sense that there were many other recipes needing this same fix that testing didn't easily catch, and it doesn't make sense to add python3-misc to recipe RDEPENDS just because (for example) python3-logging (another package split) is trying to make use of warnings, but can't find the right module; - Modified the rpm commit to apply a patch (submitted upstream) to fix CMakeLists.txt, rather than a do_configure prepend; - Fixed the Python 3.14.0 upgrade commit so that one of the patches we carry to skip tests doesn't include duplicate calls to the relevant skip functions. I've kept the upgrades from 3.13.11 to 3.14.0 and 3.14.0 to 3.14.2 separate to reflect separate testing and let people review those changelogs individually if desired. Trevor Gamblin (7): python3: upgrade 3.13.11 -> 3.14.0 python3targetconfig: export _PYTHON_PROJECT_BASE python_pep517: add --prefix to nativepython3 call python3: upgrade 3.14.0 -> 3.14.2 python3: add _py_warnings, annotationlib to core python3: add _ast_unparse to core python3: add new files to compression meta/classes-recipe/python3-dir.bbclass | 2 +- .../python3targetconfig.bbclass | 1 + meta/classes-recipe/python_pep517.bbclass | 2 +- ...r-OpenSSL-3.4-and-add-it-to-multissl.patch | 1452 ----------------- ...-use-prefix-value-from-build-configu.patch | 35 +- ...sts-due-to-load-variability-on-YP-AB.patch | 31 +- ...ctive_children-skip-problematic-test.patch | 17 +- ...1-test_cmd-skip-bang-completion-test.patch | 31 + ...-test_unix_console.test_cursor_back_.patch | 46 + ...kip-test_sysconfig.test_sysconfigdat.patch | 32 + .../python/python3/python3-manifest.json | 14 +- .../{python3_3.13.11.bb => python3_3.14.2.bb} | 20 +- 12 files changed, 195 insertions(+), 1488 deletions(-) delete mode 100644 meta/recipes-devtools/python/python3/0001-Generate-data-for-OpenSSL-3.4-and-add-it-to-multissl.patch create mode 100644 meta/recipes-devtools/python/python3/0001-test_cmd-skip-bang-completion-test.patch create mode 100644 meta/recipes-devtools/python/python3/0001-test_pyrepl-skip-test_unix_console.test_cursor_back_.patch create mode 100644 meta/recipes-devtools/python/python3/0001-test_sysconfig-skip-test_sysconfig.test_sysconfigdat.patch rename meta/recipes-devtools/python/{python3_3.13.11.bb => python3_3.14.2.bb} (95%) -- 2.52.0
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#229280): https://lists.openembedded.org/g/openembedded-core/message/229280 Mute This Topic: https://lists.openembedded.org/mt/117247400/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
