See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3167/display/redirect?page=changes>
Changes: [noreply] fix output_handler (#26923) ------------------------------------------ [...truncated 88.11 KB...] Collecting attrs>=19.2.0 (from hypothesis<=7.0.0,>5.0.0->apache-beam==2.49.0.dev0) Using cached attrs-23.1.0-py3-none-any.whl (61 kB) Collecting sortedcontainers<3.0.0,>=2.1.0 (from hypothesis<=7.0.0,>5.0.0->apache-beam==2.49.0.dev0) Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting exceptiongroup>=1.0.0 (from hypothesis<=7.0.0,>5.0.0->apache-beam==2.49.0.dev0) Using cached exceptiongroup-1.1.1-py3-none-any.whl (14 kB) Collecting dnspython<3.0.0,>=1.16.0 (from pymongo<5.0.0,>=3.8.0->apache-beam==2.49.0.dev0) Using cached dnspython-2.3.0-py3-none-any.whl (283 kB) Collecting iniconfig (from pytest<8.0,>=7.1.2->apache-beam==2.49.0.dev0) Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB) Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.49.0.dev0) (1.0.0) Collecting tomli>=1.0.0 (from pytest<8.0,>=7.1.2->apache-beam==2.49.0.dev0) Using cached tomli-2.0.1-py3-none-any.whl (12 kB) Requirement already satisfied: importlib-metadata>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.49.0.dev0) (2.1.3) Collecting execnet>=1.1 (from pytest-xdist<4,>=2.5.0->apache-beam==2.49.0.dev0) Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0.0,>=2.24.0->apache-beam==2.49.0.dev0) Using cached charset_normalizer-3.1.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (171 kB) Collecting idna<4,>=2.5 (from requests<3.0.0,>=2.24.0->apache-beam==2.49.0.dev0) Using cached idna-3.4-py3-none-any.whl (61 kB) Collecting certifi>=2017.4.17 (from requests<3.0.0,>=2.24.0->apache-beam==2.49.0.dev0) Using cached certifi-2023.5.7-py3-none-any.whl (156 kB) Collecting scipy>=1.1.0 (from scikit-learn>=0.20.0->apache-beam==2.49.0.dev0) Using cached scipy-1.7.3-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (38.1 MB) Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0->apache-beam==2.49.0.dev0) Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB) > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py37:copyGolangLicenses > Task :sdks:python:container:py37:dockerPrepare > Task :sdks:python:container:py37:docker #1 [internal] load .dockerignore #1 transferring context: #1 transferring context: 2B done #1 DONE 1.7s #2 [internal] load build definition from Dockerfile #2 transferring dockerfile: 4.73kB done #2 DONE 1.6s #3 [internal] load metadata for docker.io/library/python:3.7-bullseye #3 DONE 2.8s #4 [internal] load build context #4 DONE 0.0s #5 [beam 1/16] FROM docker.io/library/python:3.7-bullseye@sha256:d98fd1fa8fd1756bfe883b5004a60cfc428a1ce6e575652b771b66c8db222478 #5 resolve docker.io/library/python:3.7-bullseye@sha256:d98fd1fa8fd1756bfe883b5004a60cfc428a1ce6e575652b771b66c8db222478 #5 resolve docker.io/library/python:3.7-bullseye@sha256:d98fd1fa8fd1756bfe883b5004a60cfc428a1ce6e575652b771b66c8db222478 0.2s done #5 CACHED #4 [internal] load build context #4 transferring context: 2.33MB 0.0s done #4 DONE 0.8s #6 [beam 2/16] RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* #6 ... #7 [beam 7/16] RUN ln -s /usr/bin/ccache /usr/local/bin/gcc #7 CACHED #8 [beam 15/16] COPY target/NOTICE /opt/apache/beam/ #8 CACHED #9 [beam 9/16] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/ #9 CACHED #10 [beam 14/16] COPY target/LICENSE.python /opt/apache/beam/ #10 CACHED #11 [beam 5/16] RUN pip install --upgrade pip setuptools #11 CACHED #12 [beam 8/16] RUN ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false #12 CACHED #13 [beam 6/16] RUN mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm google-cloud-sdk.tar.gz #13 CACHED #14 [beam 3/16] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt #14 CACHED #15 [beam 4/16] RUN pip install --no-deps -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._implementation_type == 'upb'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt #15 CACHED #16 [beam 10/16] RUN pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] #16 CACHED #17 [beam 12/16] RUN pip freeze --all #17 CACHED #18 [beam 13/16] COPY target/LICENSE /opt/apache/beam/ #18 CACHED #19 [beam 11/16] RUN pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1) #19 CACHED #20 [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/ #20 ERROR: "/target/launcher/linux_amd64/boot" not found: not found #6 [beam 2/16] RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* #6 CANCELED ------ > [beam 16/16] COPY target/launcher/linux_amd64/boot /opt/apache/beam/: ------ ERROR: failed to solve: failed to compute cache key: "/target/launcher/linux_amd64/boot" not found: not found > Task :sdks:python:container:py37:docker FAILED > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:go:container:docker #1 [internal] load build definition from Dockerfile #1 transferring dockerfile: 1.70kB done #1 DONE 0.0s #2 [internal] load .dockerignore #2 transferring context: #2 transferring context: 2B done #2 DONE 0.0s #3 [internal] load metadata for docker.io/library/debian:bullseye #3 DONE 0.4s #4 [1/7] FROM docker.io/library/debian:bullseye@sha256:432f545c6ba13b79e2681f4cc4858788b0ab099fc1cca799cc0fae4687c69070 #4 CACHED #5 [internal] load build context #5 transferring context: 23.89MB 0.9s done #5 DONE 1.0s #6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/* #6 1.150 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB] #6 1.223 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB] #6 1.267 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB] #6 1.707 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8183 kB] #6 2.164 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [245 kB] #6 2.583 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [14.8 kB] #6 3.888 Fetched 8651 kB in 3s (3035 kB/s) #6 3.888 Reading package lists... #6 4.900 Reading package lists... #6 5.928 Building dependency tree... #6 6.211 Reading state information... #6 6.661 The following additional packages will be installed: #6 6.662 openssl #6 6.749 The following NEW packages will be installed: #6 6.752 ca-certificates openssl #6 6.856 0 upgraded, 2 newly installed, 0 to remove and 1 not upgraded. #6 6.856 Need to get 1012 kB of archives. #6 6.856 After this operation, 1892 kB of additional disk space will be used. #6 6.856 Get:1 http://deb.debian.org/debian-security bullseye-security/main amd64 openssl amd64 1.1.1n-0+deb11u5 [854 kB] #6 6.994 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB] #6 7.342 debconf: delaying package configuration, since apt-utils is not installed #6 7.406 Fetched 1012 kB in 0s (4537 kB/s) #6 7.458 Selecting previously unselected package openssl. #6 7.458 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.) #6 7.472 Preparing to unpack .../openssl_1.1.1n-0+deb11u5_amd64.deb ... #6 7.479 Unpacking openssl (1.1.1n-0+deb11u5) ... #6 7.702 Selecting previously unselected package ca-certificates. #6 7.702 Preparing to unpack .../ca-certificates_20210119_all.deb ... #6 7.709 Unpacking ca-certificates (20210119) ... #6 7.861 Setting up openssl (1.1.1n-0+deb11u5) ... #6 7.900 Setting up ca-certificates (20210119) ... #6 11.05 Updating certificates in /etc/ssl/certs... #6 14.50 129 added, 0 removed; done. #6 14.61 Processing triggers for ca-certificates (20210119) ... #6 14.64 Updating certificates in /etc/ssl/certs... #6 17.10 0 added, 0 removed; done. #6 17.10 Running hooks in /etc/ca-certificates/update.d... #6 17.12 done. #6 DONE 18.2s #7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/ #7 DONE 0.4s #8 [4/7] COPY target/LICENSE /opt/apache/beam/ #8 DONE 0.2s #9 [5/7] COPY target/NOTICE /opt/apache/beam/ #9 DONE 0.1s #10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #10 DONE 0.1s #11 [7/7] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #11 DONE 1.8s #12 exporting to image #12 exporting layers #12 exporting layers 0.5s done #12 writing image sha256:6511f864fe9dc2d5a70b584d1e2b4427d07c4d9187b45bf73c52654fa0c7689f done #12 naming to docker.io/apache/beam_go_sdk:latest done #12 DONE 0.5s > Task :sdks:python:installGcpTest Successfully installed PyJWT-2.7.0 apache-beam-2.49.0.dev0 attrs-23.1.0 azure-core-1.27.0 azure-identity-1.13.0 azure-storage-blob-12.16.0 boto3-1.26.146 botocore-1.29.146 cachetools-5.3.1 certifi-2023.5.7 cffi-1.15.1 charset-normalizer-3.1.0 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.1 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.3.0 docker-6.1.3 docopt-0.6.2 exceptiongroup-1.1.1 execnet-1.9.0 fastavro-1.7.4 fasteners-0.18 freezegun-1.2.2 google-api-core-2.11.0 google-apitools-0.5.31 google-auth-2.19.1 google-auth-httplib2-0.1.0 google-cloud-bigquery-3.11.0 google-cloud-bigquery-storage-2.20.0 google-cloud-bigtable-2.17.0 google-cloud-core-2.3.2 google-cloud-datastore-2.15.2 google-cloud-dlp-3.12.1 google-cloud-language-2.10.0 google-cloud-pubsub-2.17.1 google-cloud-pubsublite-1.7.0 google-cloud-recommendations-ai-0.10.3 google-cloud-spanner-3.35.1 google-cloud-videointelligence-2.11.2 google-cloud-vision-3.4.2 google-crc32c-1.5.0 google-resumable-media-2.5.0 googleapis-common-protos-1.59.0 greenlet-2.0.2 grpc-google-iam-v1-0.12.6 grpcio-status-1.54.2 hdfs-2.7.0 httplib2-0.22.0 hypothesis-6.75.9 idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.2.0 mock-5.0.2 msal-1.22.0 msal-extensions-1.0.0 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.0 overrides-6.5.0 pandas-1.3.5 parameterized-0.9.0 portalocker-2.7.0 proto-plus-1.22.2 psycopg2-binary-2.9.6 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.0.4 pymongo-4.3.3 pymysql-1.0.3 pyparsing-3.0.9 pytest-7.3.1 pytest-timeout-2.1.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3 pyyaml-6.0 regex-2023.5.5 requests-2.31.0 requests_mock-1.10.0 rsa-4.9 s3transfer-0.6.1 scikit-learn-1.0.2 scipy-1.7.3 sortedcontainers-2.4.0 sqlalchemy-1.4.48 sqlparse-0.4.4 tenacity-8.2.2 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 urllib3-1.26.16 websocket-client-1.5.2 wrapt-1.15.0 zstandard-0.21.0 FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:core:generateGrammarSource'. > Failed to load cache entry 0d7440665cff7f9bec6a90f532c5c0bf for task > ':sdks:java:core:generateGrammarSource': Could not load from local cache: > Timeout waiting to lock Build cache > (/home/jenkins/.gradle/caches/build-cache-1). It is currently in use by > another Gradle instance. Owner PID: 3901349 Our PID: 3970020 Owner Operation: Our operation: Lock file: /home/jenkins/.gradle/caches/build-cache-1/build-cache-1.lock * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 4m 31s 145 actionable tasks: 111 executed, 22 from cache, 12 up-to-date Publishing build scan... https://ge.apache.org/s/sokixwja2w5pi Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
