Raúl Cumplido created ARROW-18158:
-------------------------------------
Summary: [CI][Python] Building GCS with conda fails due to python
3.11
Key: ARROW-18158
URL: https://issues.apache.org/jira/browse/ARROW-18158
Project: Apache Arrow
Issue Type: Bug
Components: Continuous Integration, Python
Reporter: Raúl Cumplido
Assignee: Raúl Cumplido
Fix For: 11.0.0
Some of our jobs are failing with the following error:
{code:java}
#9 436.0 /opt/conda/envs/arrow/bin/x86_64-conda-linux-gnu-cc -DNDEBUG
-fwrapv -O2 -Wall -fPIC -O2 -isystem /opt/conda/envs/arrow/include -fPIC -O2
-isystem /opt/conda/envs/arrow/include -march=nocona -mtune=haswell
-ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2
-ffunction-sections -pipe -isystem /opt/conda/envs/arrow/include -DNDEBUG
-D_FORTIFY_SOURCE=2 -O2 -isystem /opt/conda/envs/arrow/include -fPIC
-D_WIN32_WINNT=1536 -DGRPC_XDS_USER_AGENT_NAME_SUFFIX=\"Python\"
-DGRPC_XDS_USER_AGENT_VERSION_SUFFIX=\"1.46.1\"
-DGPR_BACKWARDS_COMPATIBILITY_MODE=1 -DHAVE_CONFIG_H=1
-DGRPC_ENABLE_FORK_SUPPORT=1 "-DPyMODINIT_FUNC=extern \"C\"
__attribute__((visibility (\"default\"))) PyObject*"
-DGRPC_POSIX_FORK_ALLOW_PTHREAD_ATFORK=1 -Isrc/python/grpcio -Iinclude -I.
-Ithird_party/abseil-cpp -Ithird_party/address_sorting/include
-Ithird_party/cares/cares/include -Ithird_party/cares -Ithird_party/cares/cares
-Ithird_party/cares/config_linux -Ithird_party/re2
-Ithird_party/boringssl-with-bazel/src/include -Ithird_party/upb
-Isrc/core/ext/upb-generated -Isrc/core/ext/upbdefs-generated
-Ithird_party/xxhash -Ithird_party/zlib
-I/opt/conda/envs/arrow/include/python3.11 -c
third_party/abseil-cpp/absl/synchronization/mutex.cc -o
python_build/temp.linux-x86_64-cpython-311/third_party/abseil-cpp/absl/synchronization/mutex.o
-std=c++11 -std=gnu99 -fvisibility=hidden -fno-wrapv -fno-exceptions -pthread
#9 436.0 cc1plus: warning: command-line option '-std=gnu99' is valid for
C/ObjC but not for C++
#9 436.0 /opt/conda/envs/arrow/bin/x86_64-conda-linux-gnu-cc -DNDEBUG
-fwrapv -O2 -Wall -fPIC -O2 -isystem /opt/conda/envs/arrow/include -fPIC -O2
-isystem /opt/conda/envs/arrow/include -march=nocona -mtune=haswell
-ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2
-ffunction-sections -pipe -isystem /opt/conda/envs/arrow/include -DNDEBUG
-D_FORTIFY_SOURCE=2 -O2 -isystem /o
#9 436.0 [output clipped, log limit 1MiB reached]
#9 436.0 Running setup.py clean for grpcio
#9 436.5 Building wheel for MarkupSafe (setup.py): started
#9 437.1 Building wheel for MarkupSafe (setup.py): finished with status 'done'
#9 437.1 Created wheel for MarkupSafe:
filename=MarkupSafe-2.1.1-cp311-cp311-linux_x86_64.whl size=14671
sha256=67c65c45044f53d1023ff7487966de358f31f3366464fb49b49526cfc1afee21
#9 437.1 Stored in directory:
/root/.cache/pip/wheels/96/ee/62/407c247ad088bcb67b530ba3ac1479058c58a651bd6bf09a1f
#9 437.1 Successfully built googleapis-storage-testbench crc32c MarkupSafe
#9 437.1 Failed to build grpcio
#9 437.2 Installing collected packages: crc32c, urllib3, six, scalpl, protobuf,
MarkupSafe, itsdangerous, idna, gunicorn, click, charset-normalizer, certifi,
Werkzeug, requests, Jinja2, grpcio, googleapis-common-protos,
requests-toolbelt, flask, googleapis-storage-testbench
#9 438.0 Running setup.py install for grpcio: started
#9 498.2 Running setup.py install for grpcio: still running...
#9 558.2 Running setup.py install for grpcio: still running...
#9 618.4 Running setup.py install for grpcio: still running...
#9 679.0 Running setup.py install for grpcio: still running...
#9 739.3 Running setup.py install for grpcio: still running...
#9 799.6 Running setup.py install for grpcio: still running...
#9 859.6 Running setup.py install for grpcio: still running...
#9 901.6 Running setup.py install for grpcio: finished with status 'error'
#9 ERROR: executor failed running [/bin/bash -c -l
/arrow/ci/scripts/install_gcs_testbench.sh default]: exit code: 1{code}
this seems to be due to the command:
{code:java}
RUN mamba install -q -y --file arrow/ci/conda_env_cpp.txt --file
arrow/ci/conda_env_gandiva.txt compilers doxygen valgrind && mamba clean --all
{code}
installing the latest Python 3.11:
{code:java}
17.78 + python 3.11.0 h582c2e5_0_cpython conda-forge/linux-64 38MB {code}
{color:#1d1c1d}Example of job failure:
{color}[https://github.com/apache/arrow/actions/runs/3319519611/jobs/5484773342]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)