[issue46263] FreeBSD buildbots cannot compile Python

Change by Kubilay Kocak : -- nosy: +koobs ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: Both FreeBSD bots are green again. Thank you Christian and Eric! -- priority: release blocker -> resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

miss-islington added the comment: New changeset b98730c5165467c6053e7274ae094d733aea804d by Miss Islington (bot) in branch '3.9': bpo-46263: Fix second location that needs MALLOC_CONF on FreeBSD (GH-30440) https://github.com/python/cpython/commit/b98730c5165467c6053e7274ae094d733aea804d

[issue46263] FreeBSD buildbots cannot compile Python

miss-islington added the comment: New changeset 3cb64ede57bba260228864150123014fc682167e by Miss Islington (bot) in branch '3.10': bpo-46263: Fix second location that needs MALLOC_CONF on FreeBSD (GH-30440) https://github.com/python/cpython/commit/3cb64ede57bba260228864150123014fc682167e

[issue46263] FreeBSD buildbots cannot compile Python

Change by miss-islington : -- pull_requests: +28649 pull_request: https://github.com/python/cpython/pull/30443 ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

Change by miss-islington : -- pull_requests: +28648 pull_request: https://github.com/python/cpython/pull/30442 ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

miss-islington added the comment: New changeset c9137d4b638c0699b904011cafe68895d28dd80b by Christian Heimes in branch 'main': bpo-46263: Fix second location that needs MALLOC_CONF on FreeBSD (GH-30440) https://github.com/python/cpython/commit/c9137d4b638c0699b904011cafe68895d28dd80b

[issue46263] FreeBSD buildbots cannot compile Python

Change by Christian Heimes : -- pull_requests: +28647 stage: -> patch review pull_request: https://github.com/python/cpython/pull/30440 ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

Eric Snow added the comment: test_pyobject_freed_is_freed is still failing on AMD64 FreeBSD Shared 3.x. -- stage: patch review -> status: pending -> open ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Change by Erlend E. Aasland : -- status: open -> pending ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: Great. I tried the same trick on my VM earlier today, but I was unsure if it was the correct fix :) Thanks! -- status: pending -> open ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Change by Eric Snow : -- status: open -> pending ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue46263] FreeBSD buildbots cannot compile Python

Eric Snow added the comment: New changeset 68c76d9766cccb5fd992b0ac4b39645d9665dbe2 by Eric Snow in branch 'main': bpo-46263: Do not ever expect "use_frozen_modules" to be -1. (gh-30438) https://github.com/python/cpython/commit/68c76d9766cccb5fd992b0ac4b39645d9665dbe2 --

[issue46263] FreeBSD buildbots cannot compile Python

Eric Snow added the comment: I just put up a PR that should fix the failure. -- ___ Python tracker ___ ___ Python-bugs-list

[issue46263] FreeBSD buildbots cannot compile Python

Change by Eric Snow : -- pull_requests: +28645 pull_request: https://github.com/python/cpython/pull/30438 ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: Also, AMD64 FreeBSD Shared 3.x is configured --with-pydebug and --enable-shared. I'd be surprised if those were the root cause of this though. Both buildbots are in-tree builds. FWIW, my FreeBSD 14.0-CURRENT main-n250453-7ac82c96fe7 VM also fails, as

[issue46263] FreeBSD buildbots cannot compile Python

Eric Snow added the comment: A FreeBSD builder where it's working: AMD64 FreeBSD Shared 3.x (koobs-freebsd-564d) OS: FreeBSD 14.0-CURRENT main-n244626-cb7cc72c546: GENERIC-NODEBUG (amd64) System: 2-core, 8Gb, VirtualBox (6.x) Guest Features: - Compiler: FreeBSD clang version 11.0.1

[issue46263] FreeBSD buildbots cannot compile Python

Guido van Rossum added the comment: IIUC Steve is still on vacation, so we shouldn't wait for him to fix this. -- ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

Eric Snow added the comment: Just to be clear, the test_embed failure is on AMD64 FreeBSD Non-Debug 3.x (https://buildbot.python.org/all/#/builders/172). I agree that 99fcf15052 (bpo-45582: Port getpath[p].c to Python (GH-29041)) is likely to be the cause. -- nosy: +steve.dower

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: > the test_embed failure first appeared after GH-29041 (bpo-45582) was merged. Make that "first appeared on FreeBSD". Also, numerous was perhaps an exaggeration. Make that a few :) -- ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: AFAICS, the test_embed failure first appeared after GH-29041 (bpo-45582) was merged. After GH-29041, there has been numerous fixes for test_embed: $ git log --oneline | grep bpo-45582 3f398a77d3 bpo-45582: Fix test_embed failure during a PGO build

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: > Note that in-tree builds are working find on other platforms, AFAICS. Yes, almost all of the buildbots are using in-tree builds. IIRC, buildbots for out-of-tree builds were added just recently. -- ___ Python

[issue46263] FreeBSD buildbots cannot compile Python

Pablo Galindo Salgado added the comment: > Is this under control, or do you still need help with some part? As Christian mentions, we still have the test_embed issue -- ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Eric Snow added the comment: In summary, regarding the test_embed failure: > FWIW: from test_embed.test_init_setpythonhome: > > if not config['executable']: > config['use_frozen_modules'] = -1 > > From the buildbot test stdout (but not pythoninfo) I see that >

[issue46263] FreeBSD buildbots cannot compile Python

Christian Heimes added the comment: test_capi is fixed now. test_embed is still an issue. -- ___ Python tracker ___ ___

[issue46263] FreeBSD buildbots cannot compile Python

Guido van Rossum added the comment: Is this under control, or do you still need help with some part? (Are there two separate issues or not?)-- --Guido (mobile) -- ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Christian Heimes added the comment: New changeset b259015c1079744dbe3d58bd4c27757a6df9d1c6 by Miss Islington (bot) in branch '3.9': [3.9] bpo-46263: FreeBSD 14.0 jemalloc workaround for junk bytes of freed memory (GH-30434) (GH-30437)

[issue46263] FreeBSD buildbots cannot compile Python

miss-islington added the comment: New changeset b951dec4418326c06d493020dadedf85a3b29a82 by Miss Islington (bot) in branch '3.10': bpo-46263: FreeBSD 14.0 jemalloc workaround for junk bytes of freed memory (GH-30434)

[issue46263] FreeBSD buildbots cannot compile Python

miss-islington added the comment: New changeset a4aa52dc2801d25b6343fe2ef8de7f40ea3bc883 by Christian Heimes in branch 'main': bpo-46263: FreeBSD 14.0 jemalloc workaround for junk bytes of freed memory (GH-30434)

[issue46263] FreeBSD buildbots cannot compile Python

Change by miss-islington : -- pull_requests: +28644 pull_request: https://github.com/python/cpython/pull/30437 ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

Change by miss-islington : -- pull_requests: +28643 pull_request: https://github.com/python/cpython/pull/30436 ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

Change by Christian Heimes : -- pull_requests: +28641 stage: resolved -> patch review pull_request: https://github.com/python/cpython/pull/30434 ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

Christian Heimes added the comment: $ PYTHONMALLOC=malloc_debug ./python t.py Traceback (most recent call last): File "/usr/home/heimes/dev/python/cpython/t.py", line 4, in _testcapi.check_pyobject_freed_is_freed() ^ _testcapi.error:

[issue46263] FreeBSD buildbots cannot compile Python

Christian Heimes added the comment: The test_capi check for check_pyobject_freed_is_freed() is failing because FreeBSD 14.0 uses jemalloc, which performs its own dead memory cleaning. jemalloc's free() fills freed memory with byte 0x5a, which overrides Python's 0xdd marker. $

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: FTR: - in-tree build with system Python 3.8 => fails -- ___ Python tracker ___ ___

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: Wait a minute. It is not tied to the Python version installed; it seems to be an issue with in-tree vs. out-of-tree builds. The failed build was in-tree. The build that succeeded was out-of-tree. I did a new build with Python 3.9 installed, which

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: FYI, the buildbot has Python 3.9.9 installed, as seen from the configure step. (nit: it's pkg install python39, not pkg install python3.9) -- ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: Here's a strange observation from my FreeBSD 14.0 VM: With system supplied python3.8 (dependency of the git package), test_embed succeeds. If I explicitly install python3.9 (pkg install python3.9 installs Python 3.9.9), rebuild and test, test_embed

[issue46263] FreeBSD buildbots cannot compile Python

Pablo Galindo Salgado added the comment: Unfortunately the buildbots are still red: https://buildbot.python.org/all/#/builders/483/builds/1416/steps/5/logs/stdio https://buildbot.python.org/all/#/builders/172/builds/1102 One is the test_embed problem with frozen modules:

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: Marked as a release blocker. See python-committers post: https://mail.python.org/archives/list/python-committ...@python.org/thread/7OWGAL4UL5HNKKQFUGH6N6L4JDVPEN7R/ -- priority: normal -> release blocker ___

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: FWIW: from test_embed.test_init_setpythonhome: if not config['executable']: config['use_frozen_modules'] = -1 >From the buildbot test stdout (but not pythoninfo) I see that >config["executable"] is set to "". --

[issue46263] FreeBSD buildbots cannot compile Python

Change by Erlend E. Aasland : -- Removed message: https://bugs.python.org/msg409774 ___ Python tracker ___ ___ Python-bugs-list

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: FWIW: from test_embed.test_init_setpythonhome: if not config['executable']: config['use_frozen_modules'] = -1 >From the buildbot test stdout (and pythoninfo) I see that config["executable"] >is set to "". --

[issue46263] FreeBSD buildbots cannot compile Python

Erlend E. Aasland added the comment: I closed the bug without intention to do so. Sorry for the noise. -- nosy: +erlendaasland resolution: fixed -> status: closed -> open ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Christian Heimes added the comment: I have backported the patch to all versions that receive regular fixes. -- resolution: -> fixed stage: patch review -> resolved status: open -> closed type: -> compile error ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

miss-islington added the comment: New changeset 64199e9235275a795097ee0c53b2c560e21c70d0 by Miss Islington (bot) in branch '3.9': bpo-46263: Don't use MULTIARCH on FreeBSD (GH-30410) https://github.com/python/cpython/commit/64199e9235275a795097ee0c53b2c560e21c70d0 --

[issue46263] FreeBSD buildbots cannot compile Python

miss-islington added the comment: New changeset 7e951f356ec76a5a5fdb851d71df5d120014bf3f by Miss Islington (bot) in branch '3.10': bpo-46263: Don't use MULTIARCH on FreeBSD (GH-30410) https://github.com/python/cpython/commit/7e951f356ec76a5a5fdb851d71df5d120014bf3f --

[issue46263] FreeBSD buildbots cannot compile Python

Change by Christian Heimes : -- priority: release blocker -> normal ___ Python tracker ___ ___ Python-bugs-list mailing list

[issue46263] FreeBSD buildbots cannot compile Python

Change by miss-islington : -- pull_requests: +28620 pull_request: https://github.com/python/cpython/pull/30414 ___ Python tracker ___

[issue46263] FreeBSD buildbots cannot compile Python

Change by miss-islington : -- nosy: +miss-islington nosy_count: 6.0 -> 7.0 pull_requests: +28619 pull_request: https://github.com/python/cpython/pull/30413 ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Christian Heimes added the comment: New changeset cae55542d23e606dde9819d5dadd7430085fcc77 by Christian Heimes in branch 'main': bpo-46263: Don't use MULTIARCH on FreeBSD (#30410) https://github.com/python/cpython/commit/cae55542d23e606dde9819d5dadd7430085fcc77 --

[issue46263] FreeBSD buildbots cannot compile Python

Christian Heimes added the comment: I have tested my PR on a FreeBSD VM. Python fails to compile on main and builds correctly with my patch. -- components: +Build versions: +Python 3.10, Python 3.9 ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Change by Christian Heimes : -- keywords: +patch pull_requests: +28616 stage: -> patch review pull_request: https://github.com/python/cpython/pull/30410 ___ Python tracker

[issue46263] FreeBSD buildbots cannot compile Python

Christian Heimes added the comment: On my FreeBSD 13 VM the sysconfig data module is build/lib.freebsd-13.0-RELEASE-amd64-3.11-pydebug/_sysconfigdata_d_freebsd13_.py It does not have any multiarch suffix. The multiarch suffix is detected by configure.ac. Did FreeBSD 14.0's CC get

[issue46263] FreeBSD buildbots cannot compile Python

Change by Guido van Rossum : -- title: FreeBSL buiildbots cannot compile Python -> FreeBSD buildbots cannot compile Python ___ Python tracker ___