[issue33174] error building the _sha3 module with Intel 2018 compilers
William Scullin <wscul...@gmail.com> added the comment: Hi Kenneth: I can recreate this issue on Haswell, Skylake-X, and KNL running SLES 12, Clear Linux, and Centos 7.5. I've tried 18.1 and 18.2. It's still present across the board with Intel C/C++ 18.0.2.199. On the Centos 7.5.1804 image, the build will seemingly complete, but since _sha3 didn't actually compile, the regression tests will fail with errors of the form: $ /dev/shm/testinstall/icc/python/3.6.5/bin/python3 -m test ERROR:root:code for hash sha3_224 was not found. Traceback (most recent call last): File "/dev/shm/testinstall/icc/python/3.6.5/lib/python3.6/hashlib.py", line 121, in __get_openssl_constructor f = getattr(_hashlib, 'openssl_' + name) AttributeError: module '_hashlib' has no attribute 'openssl_sha3_224' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/dev/shm/testinstall/icc/python/3.6.5/lib/python3.6/hashlib.py", line 243, in globals()[__func_name] = __get_hash(__func_name) File "/dev/shm/testinstall/icc/python/3.6.5/lib/python3.6/hashlib.py", line 128, in __get_openssl_constructor return __get_builtin_constructor(name) File "/dev/shm/testinstall/icc/python/3.6.5/lib/python3.6/hashlib.py", line 113, in __get_builtin_constructor raise ValueError('unsupported hash type ' + name) ValueError: unsupported hash type sha3_224 ERROR:root:code for hash sha3_256 was not found. Traceback (most recent call last): File "/dev/shm/testinstall/icc/python/3.6.5/lib/python3.6/hashlib.py", line 121, in __get_openssl_constructor f = getattr(_hashlib, 'openssl_' + name) AttributeError: module '_hashlib' has no attribute 'openssl_sha3_256' ... Searching about, it looks like you may have seen something similar in EasyBuild: https://github.com/easybuilders/easybuild-easyconfigs/pull/5086 but it doesn't look like the root cause was sussed out. - William -- ___ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue33174> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue33174] error building the _sha3 module with Intel 2018 compilers
New submission from William Scullin <wscul...@gmail.com>: When building Python 3.6.X and later with icc (18.0.0.128 or 18.0.1.163), there's an error building the _sha3 module with any optimization level other than -O0: building '_sha3' extension icc -pthread -fPIC -Wsign-compare -Wunreachable-code -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -std=c99 -Wextra -Wno-unused-parameter -Wno-missing-field-initializers -fp-model strict -I./Include -I. -I/usr/local/include -I/derp/Python-3.6.4/Include -I/derp/Python-3.6.4 -c /derp/Python-3.6.4/Modules/_sha3/ sha3module.c -o build/temp.linux-x86_64-3.6/derp/Python-3.6.4/Modules/_sha3/sha3module.o ": internal error: ** The compiler has encountered an unexpected problem. ** Segmentation violation signal raised. ** Access violation or stack overflow. Please contact Intel Support for assistance. compilation aborted for /derp/Python-3.6.4/Modules/_sha3/sha3module.c (code 4) ... [ jlselogin2: Python-3.6.4 ]$ if I drop to -O0, compilation works every time. I haven't found disabling any particular set of optimizations to be useful in obtaining a successful build. ... [ jlselogin2: Python-3.6.4 ]$ dropping to -O0, compilation works every time. I haven't found disabling any particular set of optimizations to be useful in obtaining a successful build with icc. Intel has been notified and a bug filed as this is really a compiler bug. On the Python side, it does not appear possible to use Modules/Setup to drop the optimization level for just _sha3 and I'm hunting for a workaround. -- components: Installation messages: 314619 nosy: wscullin priority: normal severity: normal status: open title: error building the _sha3 module with Intel 2018 compilers type: compile error versions: Python 3.6 ___ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue33174> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue22699] cross-compilation of Python3.4
Changes by William Scullin <wscul...@gmail.com>: -- type: resource usage -> compile error ___ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue22699> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23968] rename the platform directory from plat-$(MACHDEP) to plat-$(PLATFORM_TRIPLET)
William Scullin added the comment: This would likely improve life for folks with cross-compile toolchains. -- nosy: +wscullin ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23968 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue22699] cross-compilation of Python3.4
William Scullin added the comment: I thought this was originally a help request and was going to re-direct this. Cross-compile with 3.4.3 and later seems broken. Procedure followed: wget https://www.python.org/ftp/python/3.5.0/Python-3.5.0rc1.tgz tar -xf Python-3.5.0rc1.tgz mkdir buildpowerpc64-linux-gnu cd buildpowerpc64-linux-gnu ../Python-3.5.0rc1/configure \ --disable-shared \ --prefix=/local/soft/python/3.5.0rc1/powerpc64-linux-gnu/gcc-4.4.7 make make install # now for the actual cross-compile build cd .. mkdir buildpowerpc64-bgq-linux export PYTHON_FOR_BUILD=/local/soft/python/3.5.0rc1/powerpc64-linux-gnu/gcc-4.4.7/bin/python3.5 ../Python-3.5.0rc1/configure \ --host=powerpc64-bgq-linux \ --build=powerpc64-linux-gnu \ --disable-ipv6 \ --disable-shared \ ac_cv_pthread_system_supported=yes \ ac_cv_file__dev_ptmx=no \ ac_cv_file__dev_ptc=no \ ac_cv_big_endian_double=yes make which succeeds in building a cross-compiled interpreter, then fails to build modules as setup.py gets the srcdir wrong: [wscullin@vestalac1 buildpowerpc64-bgq-linux]$ make running build running build_ext building '_struct' extension powerpc64-bgq-linux-gcc -fPIC -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -Werror=declaration-after-statement -I../Python-3.5.0rc1/Include -I/local/soft/python/3.5.0rc1/powerpc64-linux-gnu /gcc-4.4.7/include -I. -IInclude -I/usr/local/include -I/local/soft/python/3.5.0rc1/powerpc64-linux-gnu/gcc-4.4.7/include/python3.5m -c _struct.c -o build/temp.linux-ppc64-3.5/_struct.o powerpc64-bgq-linux-gcc: _struct.c: No such file or directory powerpc64-bgq-linux-gcc: no input files -- components: +Build, Cross-Build versions: +Python 3.5 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue22699 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue22699] cross-compilation of Python3.4
Changes by William Scullin wscul...@gmail.com: -- nosy: +wscullin ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue22699 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue18835] Add aligned memory variants to the suite of PyMem functions/macros
Changes by William Scullin wscul...@gmail.com: -- nosy: +wscullin ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18835 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com