Jorge Leitão created ARROW-12954:
------------------------------------
Summary: [Developer Tools] Build of ubuntu-docs is failing on
c-aresAlt
Key: ARROW-12954
URL: https://issues.apache.org/jira/browse/ARROW-12954
Project: Apache Arrow
Issue Type: Bug
Components: Developer Tools
Reporter: Jorge Leitão
Sorry for yet another one, but I am still unable to build the docs, so need to
push this here :(
{code:java}
~/projects/arrow ~/projects/arrow
M ci/docker/linux-apt-docs.dockerfile
M ci/docker/ubuntu-20.04-cpp.dockerfile
M dev/release/post-09-docs.sh
HEAD is now at 81ff679c4 [Release] Update versions for 4.0.1
Pulling ubuntu-cpp ... done
Pulling ubuntu-python ... done
WARNING: Some service image(s) must be built from source by running:
docker-compose build ubuntu-python
Pulling ubuntu-docs ... done
WARNING: Some service image(s) must be built from source by running:
docker-compose build ubuntu-docs
Building ubuntu-cpp
[+] Building 2.3s (14/14) FINISHED
=> [internal] load build definition from ubuntu-20.04-cpp.dockerfile
0.1s
=> => transferring dockerfile: 4.42kB
0.0s
=> [internal] load .dockerignore
0.1s
=> => transferring context: 35B
0.0s
=> [internal] load metadata for docker.io/amd64/ubuntu:20.04
1.8s
=> [auth] amd64/ubuntu:pull token for registry-1.docker.io
0.0s
=> importing cache manifest from apache/arrow-dev:amd64-ubuntu-20.04-cpp
0.0s
=> [1/6] FROM
docker.io/amd64/ubuntu:20.04@sha256:86ac87f73641c920fb42cc9612d4fb57b5626b56ea2a19b894d0673fd5b4f2e9
0.0s
=> [internal] load build context
0.0s
=> => transferring context: 1.67kB
0.0s
=> CACHED [2/6] RUN echo "debconf debconf/frontend select Noninteractive" |
debconf-set-selections 0.0s
=> CACHED [3/6] RUN if [ "12" -gt "10" ]; then apt-get update -y -q &&
apt-get install -y -q --no-inst 0.0s
=> CACHED [4/6] RUN apt-get update -y -q && apt-get install -y -q
--no-install-recommends autoconf 0.0s
=> CACHED [5/6] COPY ci/scripts/install_minio.sh /arrow/ci/scripts/
0.0s
=> CACHED [6/6] RUN /arrow/ci/scripts/install_minio.sh amd64 linux latest
/usr/local 0.0s
=> exporting to image
0.1s
=> => exporting layers
0.0s
=> => writing image
sha256:beebbc9b471f2f1f582e279536ed49dabf0e8d92be4b16586ff42f0e43ce2b1f
0.0s
=> => naming to docker.io/apache/arrow-dev:amd64-ubuntu-20.04-cpp
0.0s
=> exporting cache
0.0s
=> => preparing build cache for export
0.0s
Use 'docker scan' to run Snyk tests against images to find vulnerabilities and
learn how to fix them
Successfully built
beebbc9b471f2f1f582e279536ed49dabf0e8d92be4b16586ff42f0e43ce2b1f
Use 'docker scan' to run Snyk tests against images to find vulnerabilities and
learn how to fix them
Building ubuntu-python
[+] Building 0.4s (13/13) FINISHED
=> [internal] load build definition from linux-apt-python-3.dockerfile
0.1s
=> => transferring dockerfile: 1.52kB
0.0s
=> [internal] load .dockerignore
0.0s
=> => transferring context: 35B
0.0s
=> [internal] load metadata for
docker.io/apache/arrow-dev:amd64-ubuntu-20.04-cpp
0.0s
=> importing cache manifest from apache/arrow-dev:amd64-ubuntu-20.04-python-3
0.0s
=> [1/6] FROM docker.io/apache/arrow-dev:amd64-ubuntu-20.04-cpp
0.0s
=> [internal] load build context
0.0s
=> => transferring context: 319B
0.0s
=> CACHED [2/6] RUN apt-get update -y -q && apt-get install -y -q
python3 python3-pip 0.0s
=> CACHED [3/6] RUN ln -s /usr/bin/python3 /usr/local/bin/python && ln -s
/usr/bin/pip3 /usr/local/bin/pip 0.0s
=> CACHED [4/6] RUN pip install -U pip setuptools
0.0s
=> CACHED [5/6] COPY python/requirements-build.txt
python/requirements-test.txt /arrow/python/ 0.0s
=> CACHED [6/6] RUN pip install -r arrow/python/requirements-build.txt
-r arrow/python/requirements-test.t 0.0s
=> exporting to image
0.1s
=> => exporting layers
0.0s
=> => writing image
sha256:32416e25a8ee905a0b800ee544a81001cebc7718ac0d49e472ef20522a20aa2d
0.0s
=> => naming to docker.io/apache/arrow-dev:amd64-ubuntu-20.04-python-3
0.0s
=> exporting cache
0.0s
=> => preparing build cache for export
0.0s
Use 'docker scan' to run Snyk tests against images to find vulnerabilities and
learn how to fix them
Successfully built
32416e25a8ee905a0b800ee544a81001cebc7718ac0d49e472ef20522a20aa2d
Use 'docker scan' to run Snyk tests against images to find vulnerabilities and
learn how to fix them
Building ubuntu-docs
[+] Building 980.2s (22/22) FINISHED
=> [internal] load build definition from linux-apt-docs.dockerfile
0.0s
=> => transferring dockerfile: 3.50kB
0.0s
=> [internal] load .dockerignore
0.0s
=> => transferring context: 35B
0.0s
=> [internal] load metadata for
docker.io/apache/arrow-dev:amd64-ubuntu-20.04-python-3
0.0s
=> importing cache manifest from apache/arrow-dev:amd64-ubuntu-20.04-docs
0.0s
=> CACHED [ 1/15] FROM docker.io/apache/arrow-dev:amd64-ubuntu-20.04-python-3
0.0s
=> [internal] load build context
0.1s
=> => transferring context: 8.63kB
0.0s
=> [ 2/15] RUN apt-get update -y && apt-get install -y dirmngr
apt-transport-https s 416.9s
=> [ 3/15] COPY ci/scripts/util_download_apache.sh /arrow/ci/scripts/
0.1s
=> [ 4/15] RUN /arrow/ci/scripts/util_download_apache.sh
"maven/maven-3/3.5.4/binaries/apache-maven-3.5.4-bin. 4.0s
=> [ 5/15] RUN mvn -version
1.6s
=> [ 6/15] RUN wget -q -O - https://deb.nodesource.com/setup_14.x | bash - &&
apt-get install -y nodejs && 54.1s
=> [ 7/15] RUN pip install meson breathe ipython
sphinx pydata-sphinx-the 49.2s
=> [ 8/15] COPY c_glib/Gemfile /arrow/c_glib/
0.2s
=> [ 9/15] RUN gem install --no-document bundler && bundle install
--gemfile /arrow/c_glib/Gemfile 128.4s
=> [10/15] COPY ci/etc/rprofile /arrow/ci/etc/
0.1s
=> [11/15] RUN cat /arrow/ci/etc/rprofile >> $(R RHOME)/etc/Rprofile.site
0.7s
=> [12/15] RUN echo "MAKEFLAGS=-j$(R -s -e 'cat(parallel::detectCores())')" >>
$(R RHOME)/etc/Makeconf 1.3s
=> [13/15] COPY ci/scripts/r_deps.sh /arrow/ci/scripts/
0.1s
=> [14/15] COPY r/DESCRIPTION /arrow/r/
0.1s
=> [15/15] RUN /arrow/ci/scripts/r_deps.sh /arrow && R -e
"install.packages('pkgdown')" 250.4s
=> exporting to image
0.1s
=> => exporting layers
0.0s
=> => writing image
sha256:0a7105c9b54bfb188d5c37fa208baab013788a94b713fa923580cad18538908b
0.0s
=> => naming to docker.io/apache/arrow-dev:amd64-ubuntu-20.04-docs
0.0s
=> exporting cache
0.0s
=> => preparing build cache for export
0.0s
Use 'docker scan' to run Snyk tests against images to find vulnerabilities and
learn how to fix them
Successfully built
0a7105c9b54bfb188d5c37fa208baab013788a94b713fa923580cad18538908b
Use 'docker scan' to run Snyk tests against images to find vulnerabilities and
learn how to fix them
Creating arrow_ubuntu-docs_run ... done
+ source_dir=/arrow/cpp
+ build_dir=/build/cpp
+ with_docs=true
+ : ON
+ '[' '!' -z '' ']'
++ command -v xcrun
+ '[' -x '' ']'
+ '[' ON == ON ']'
+ echo -e '===\n=== ccache statistics before build\n==='
===
=== ccache statistics before build
===
+ ccache -s
cache directory /ccache
primary config /ccache/ccache.conf
secondary config (readonly) /etc/ccache.conf
cache hit (direct) 0
cache hit (preprocessed) 0
cache miss 0
cache hit rate 0.00 %
cleanups performed 0
files in cache 0
cache size 0.0 kB
max cache size 500.0 MB
+ mkdir -p /build/cpp
+ pushd /build/cpp
/build/cpp /
+ cmake -G Ninja -DARROW_BOOST_USE_SHARED=ON -DARROW_BUILD_BENCHMARKS=OFF
-DARROW_BUILD_BENCHMARKS_REFERENCE=OFF -DARROW_BUILD_EXAMPLES=OFF
-DARROW_BUILD_INTEGRATION=OFF -DARROW_BUILD_SHARED=ON -DARROW_BUILD_STATIC=OFF
-DARROW_BUILD_TESTS=OFF -DARROW_BUILD_UTILITIES=OFF -DARROW_COMPUTE=ON
-DARROW_CSV=ON -DARROW_CUDA=ON -DARROW_CXXFLAGS= -DARROW_DATASET=ON
-DARROW_DEPENDENCY_SOURCE=SYSTEM -DARROW_EXTRA_ERROR_CONTEXT=OFF
-DARROW_ENABLE_TIMING_TESTS=ON -DARROW_FILESYSTEM=ON -DARROW_FLIGHT=ON
-DARROW_FUZZING=OFF -DARROW_GANDIVA_JAVA=OFF -DARROW_GANDIVA_PC_CXX_FLAGS=
-DARROW_GANDIVA=ON -DARROW_HDFS=ON -DARROW_HIVESERVER2=OFF
-DARROW_INSTALL_NAME_RPATH=OFF -DARROW_JEMALLOC=ON -DARROW_JNI=OFF
-DARROW_JSON=ON -DARROW_LARGE_MEMORY_TESTS=OFF -DARROW_MIMALLOC=OFF
-DARROW_NO_DEPRECATED_API=ON -DARROW_ORC=ON -DARROW_PARQUET=ON
-DARROW_PLASMA_JAVA_CLIENT=OFF -DARROW_PLASMA=ON -DARROW_PYTHON=ON
-DARROW_RUNTIME_SIMD_LEVEL=MAX -DARROW_S3=ON -DARROW_TEST_LINKAGE=shared
-DARROW_TEST_MEMCHECK=OFF -DARROW_USE_ASAN=OFF -DARROW_USE_CCACHE=ON
-DARROW_USE_GLOG=OFF -DARROW_USE_LD_GOLD=OFF
-DARROW_USE_PRECOMPILED_HEADERS=OFF -DARROW_USE_STATIC_CRT=OFF
-DARROW_USE_TSAN=OFF -DARROW_USE_UBSAN=OFF -DARROW_VERBOSE_THIRDPARTY_BUILD=OFF
-DARROW_WITH_BROTLI=ON -DARROW_WITH_BZ2=ON -DARROW_WITH_LZ4=ON
-DARROW_WITH_SNAPPY=ON -DARROW_WITH_UTF8PROC=ON -DARROW_WITH_ZLIB=ON
-DARROW_WITH_ZSTD=ON -DAWSSDK_SOURCE=BUNDLED -Dbenchmark_SOURCE=
-DBOOST_SOURCE= -DBrotli_SOURCE= -DBUILD_WARNING_LEVEL=CHECKIN -Dc-ares_SOURCE=
-DCMAKE_BUILD_TYPE=debug -DCMAKE_C_FLAGS= -DCMAKE_CXX_FLAGS=
-DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_INSTALL_PREFIX=/usr/local
-DCMAKE_UNITY_BUILD=ON -Dgflags_SOURCE= -DgRPC_SOURCE=BUNDLED
-DGTest_SOURCE=BUNDLED -DLz4_SOURCE= -DORC_SOURCE=BUNDLED
-DPARQUET_BUILD_EXECUTABLES=ON -DPARQUET_BUILD_EXAMPLES=ON
-DPARQUET_REQUIRE_ENCRYPTION=ON -DProtobuf_SOURCE=BUNDLED -DRapidJSON_SOURCE=
-Dre2_SOURCE= -DSnappy_SOURCE= -DThrift_SOURCE= -Dutf8proc_SOURCE=
-Dzstd_SOURCE= /arrow/cpp
-- Building using CMake version: 3.16.3
-- The C compiler identification is GNU 9.3.0
-- The CXX compiler identification is GNU 9.3.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Arrow version: 4.0.1 (full: '4.0.1')
-- Arrow SO version: 400 (full: 400.1.0)
-- clang-tidy found at /usr/bin/clang-tidy-8
-- clang-format found at /usr/bin/clang-format-8
-- Found ClangTools: /usr/bin/clang-format-8
-- infer not found
-- Found Python3: /usr/local/bin/python (found version "3.8.5") found
components: Interpreter
-- Using ccache: /usr/bin/ccache
-- Found cpplint executable at /arrow/cpp/build-support/cpplint.py
-- System processor: x86_64
-- Performing Test CXX_SUPPORTS_SSE4_2
-- Performing Test CXX_SUPPORTS_SSE4_2 - Success
-- Performing Test CXX_SUPPORTS_AVX2
-- Performing Test CXX_SUPPORTS_AVX2 - Success
-- Performing Test CXX_SUPPORTS_AVX512
-- Performing Test CXX_SUPPORTS_AVX512 - Success
-- Arrow build warning level: CHECKIN
Using ld linker
Configured for DEBUG build (set with cmake
-DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: DEBUG
-- Using SYSTEM approach to find dependencies
-- ARROW_ABSL_BUILD_VERSION: 0f3bb466b868b523cf1dc9b2aaaed65c77b28862
-- ARROW_AWSSDK_BUILD_VERSION: 1.8.133
-- ARROW_AWS_CHECKSUMS_BUILD_VERSION: v0.1.10
-- ARROW_AWS_C_COMMON_BUILD_VERSION: v0.4.59
-- ARROW_AWS_C_EVENT_STREAM_BUILD_VERSION: v0.1.5
-- ARROW_BOOST_BUILD_VERSION: 1.75.0
-- ARROW_BROTLI_BUILD_VERSION: v1.0.9
-- ARROW_BZIP2_BUILD_VERSION: 1.0.8
-- ARROW_CARES_BUILD_VERSION: 1.17.1
-- ARROW_GBENCHMARK_BUILD_VERSION: v1.5.2
-- ARROW_GFLAGS_BUILD_VERSION: v2.2.2
-- ARROW_GLOG_BUILD_VERSION: v0.4.0
-- ARROW_GRPC_BUILD_VERSION: v1.35.0
-- ARROW_GTEST_BUILD_VERSION: 1.10.0
-- ARROW_JEMALLOC_BUILD_VERSION: 5.2.1
-- ARROW_LZ4_BUILD_VERSION: v1.9.3
-- ARROW_MIMALLOC_BUILD_VERSION: v1.6.4
-- ARROW_ORC_BUILD_VERSION: 1.6.6
-- ARROW_PROTOBUF_BUILD_VERSION: v3.14.0
-- ARROW_RAPIDJSON_BUILD_VERSION: 1a803826f1197b5e30703afe4b9c0e7dd48074f5
-- ARROW_RE2_BUILD_VERSION: 2021-02-02
-- ARROW_SNAPPY_BUILD_VERSION: 1.1.8
-- ARROW_THRIFT_BUILD_VERSION: 0.13.0
-- ARROW_THRIFT_BUILD_MD5_CHECKSUM: 38a27d391a2b03214b444cb13d5664f1
-- ARROW_UTF8PROC_BUILD_VERSION: v2.6.1
-- ARROW_XSIMD_BUILD_VERSION: e9234cd6e6f4428fc260073b2c34ffe86fda1f34
-- ARROW_ZLIB_BUILD_VERSION: 1.2.11
-- ARROW_ZSTD_BUILD_VERSION: v1.4.8
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- Found Threads: TRUE
-- Looking for __SIZEOF_INT128__
-- Looking for __SIZEOF_INT128__ - found
-- Found Boost: /usr/lib/x86_64-linux-gnu/cmake/Boost-1.71.0/BoostConfig.cmake
(found suitable version "1.71.0", minimum required is "1.58") found components:
system filesystem
-- Boost include dir: /usr/include
-- Boost libraries: Boost::system;Boost::filesystem
-- Found Snappy: /usr/lib/x86_64-linux-gnu/libsnappy.so
-- Providing CMake module for Snappy
-- Checking for modules 'libbrotlicommon;libbrotlienc;libbrotlidec'
-- Found libbrotlicommon, version 1.0.7
-- Found libbrotlienc, version 1.0.7
-- Found libbrotlidec, version 1.0.7
-- Found Brotli: /usr/lib/x86_64-linux-gnu/libbrotlicommon.so
-- Providing CMake module for Brotli
-- Found OpenSSL: /usr/lib/x86_64-linux-gnu/libcrypto.so (found suitable
version "1.1.1f", minimum required is "1.0.2")
-- Found OpenSSL Crypto Library: /usr/lib/x86_64-linux-gnu/libcrypto.so
-- Building with OpenSSL (Version: 1.1.1f) support
-- Checking for module 'thrift'
-- Found thrift, version 0.13.0
-- Found Thrift: /usr/lib/x86_64-linux-gnu/libthrift.so (found suitable version
"0.13.0", minimum required is "0.11.0")
-- Providing CMake module for Thrift
Building Protocol Buffers from source
-- Found protoc: /build/cpp/protobuf_ep-install/bin/protoc
-- Found libprotoc: /build/cpp/protobuf_ep-install/lib/libprotoc.a
-- Found libprotobuf: /build/cpp/protobuf_ep-install/lib/libprotobuf.a
-- Found protobuf headers: /build/cpp/protobuf_ep-install/include
-- Building (vendored) jemalloc from source
-- RapidJSON found. Headers: /usr/include
-- Building xsimd from source
-- Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version "1.2.11")
-- Checking for module 'liblz4'
-- Found liblz4, version 1.9.2
-- Found Lz4: /usr/lib/x86_64-linux-gnu/liblz4.so
-- Providing CMake module for Lz4
-- Checking for module 'libzstd'
-- Found libzstd, version 1.4.4
-- Found zstd: /usr/lib/x86_64-linux-gnu/libzstd.so
-- Providing CMake module for zstd
CMake Warning at cmake_modules/Findre2Alt.cmake:25 (find_package):
By not providing "Findre2.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "re2", but
CMake did not find one.
Could not find a package configuration file provided by "re2" with any of
the following names:
re2Config.cmake
re2-config.cmake
Add the installation prefix of "re2" to CMAKE_PREFIX_PATH or set "re2_DIR"
to a directory containing one of the above files. If "re2" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
cmake_modules/ThirdpartyToolchain.cmake:234 (find_package)
cmake_modules/ThirdpartyToolchain.cmake:2174 (resolve_dependency)
CMakeLists.txt:506 (include)
-- Checking for module 're2'
-- Found re2, version 0.0.0
-- Found re2Alt: /usr/lib/x86_64-linux-gnu/libre2.so
-- Providing CMake module for re2Alt
-- Found BZip2: /usr/lib/x86_64-linux-gnu/libbz2.so (found version "1.0.8")
-- Looking for BZ2_bzCompressInit
-- Looking for BZ2_bzCompressInit - found
-- Found utf8proc: /usr/lib/x86_64-linux-gnu/libutf8proc.so
-- Providing CMake module for utf8proc
CMake Error at cmake_modules/ThirdpartyToolchain.cmake:234 (find_package):
By not providing "Findc-aresAlt.cmake" in CMAKE_MODULE_PATH this project
has asked CMake to find a package configuration file provided by
"c-aresAlt", but CMake did not find one.
Could not find a package configuration file provided by "c-aresAlt" with
any of the following names:
c-aresAltConfig.cmake
c-aresalt-config.cmake
Add the installation prefix of "c-aresAlt" to CMAKE_PREFIX_PATH or set
"c-aresAlt_DIR" to a directory containing one of the above files. If
"c-aresAlt" provides a separate development package or SDK, be sure it has
been installed.
Call Stack (most recent call first):
cmake_modules/ThirdpartyToolchain.cmake:2345 (resolve_dependency)
cmake_modules/ThirdpartyToolchain.cmake:155 (build_grpc)
cmake_modules/ThirdpartyToolchain.cmake:232 (build_dependency)
cmake_modules/ThirdpartyToolchain.cmake:2616 (resolve_dependency)
CMakeLists.txt:506 (include)
-- Configuring incomplete, errors occurred!
See also "/build/cpp/CMakeFiles/CMakeOutput.log".
See also "/build/cpp/CMakeFiles/CMakeError.log".
ERROR: 1
Error: `docker-compose --file
/Users/jorgecarleitao/projects/arrow/docker-compose.yml run --rm -e
ARROW_DOCS_VERSION=4.0.1 -e UBUNTU=20.10 --volume
/Users/jorgecarleitao/projects/arrow/dev/release/../../../arrow-site/docs:/build/docs
ubuntu-docs` exited with a non-zero exit code 1, see the process log above.
The docker-compose command was invoked with the following parameters:
Defaults defined in .env:
ARCH: amd64
ARCH_ALIAS: x86_64
ARCH_SHORT_ALIAS: x64
ARROW_R_DEV: TRUE
BUILDKIT_INLINE_CACHE: 1
CLANG_TOOLS: 8
COMPOSE_DOCKER_CLI_BUILD: 1
CUDA: 9.1
DASK: latest
DEBIAN: 10
DEVTOOLSET_VERSION: -1
DOCKER_BUILDKIT: 1
DOCKER_VOLUME_PREFIX:
DOTNET: 3.1
FEDORA: 33
GO: 1.15
HDFS: 3.2.1
JDK: 8
KARTOTHEK: latest
LLVM: 12
MAVEN: 3.5.4
NODE: 14
NUMPY: latest
PANDAS: latest
PYTHON: 3.6
R: 4.0
REPO: apache/arrow-dev
RUST: nightly-2021-03-24
R_IMAGE: ubuntu-gcc-release
R_ORG: rhub
R_TAG: latest
SPARK: master
TURBODBC: latest
UBUNTU: 20.04
ULIMIT_CORE: -1
VCPKG: fced4bef1606260f110d74de1ae1975c2b9ac549
{code}
from {{dev/release/post-09-docs.sh 4.0.1}}, from branch `release-4.0.1-rc1`
with patches https://issues.apache.org/jira/browse/ARROW-12909 and
https://issues.apache.org/jira/browse/ARROW-12915
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
