See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/2064/display/redirect>
Changes: ------------------------------------------ [...truncated 711.79 KB...] #3 [internal] load metadata for docker.io/library/eclipse-temurin:8 #3 DONE 0.3s #4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:41f0a77c444bc69fae2316178e596114e0e0d96b772d88f277b2a3d1c1619a34 #4 resolve docker.io/library/eclipse-temurin:8@sha256:41f0a77c444bc69fae2316178e596114e0e0d96b772d88f277b2a3d1c1619a34 0.0s done #4 CACHED #5 [internal] load build context #5 transferring context: 47.00MB 0.4s done #5 DONE 0.4s #6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/ #6 DONE 2.2s #7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ #7 DONE 0.1s #8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/ #8 DONE 0.1s #9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/ #9 DONE 0.2s #10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/ #10 DONE 0.1s #11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ #11 DONE 0.1s #12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/ #12 DONE 0.2s #13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/ #13 DONE 0.2s #14 [10/16] COPY target/LICENSE /opt/apache/beam/ #14 DONE 0.1s #15 [11/16] COPY target/NOTICE /opt/apache/beam/ #15 DONE 0.1s #16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ #16 DONE 0.3s #17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/ #17 DONE 0.1s #18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #18 DONE 0.1s #19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #19 DONE 0.8s #20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/ #20 DONE 0.2s #21 exporting to image #21 exporting layers #21 exporting layers 0.2s done #21 writing image sha256:10c3ccd62e7659a4cab8fd881bc30402c55888fd6d3435fc1cad79c7dd3141d7 done #21 naming to docker.io/apache/beam_java8_sdk:2.50.0.dev done #21 DONE 0.2s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] bcc80f6a93ea: Preparing 5f70bf18a086: Preparing 6e19dd8abe86: Preparing 061db2344c24: Preparing b82dc0715f01: Preparing 3b43d73d1153: Preparing 6e56c85f6c1e: Preparing 003cec87f4f3: Preparing 72c3165cca90: Preparing 2ef7b49b0142: Preparing a0aaf8685d03: Preparing 41a022c3b8a7: Preparing 03717ce88585: Preparing c58282f48c4b: Preparing b79b456462ac: Preparing 21a7bd952dcc: Preparing 01229e3f0334: Preparing 8d8fafa18e50: Preparing cdd7c7392317: Preparing 003cec87f4f3: Waiting a0aaf8685d03: Waiting 72c3165cca90: Waiting 2ef7b49b0142: Waiting 41a022c3b8a7: Waiting c58282f48c4b: Waiting b79b456462ac: Waiting 03717ce88585: Waiting 21a7bd952dcc: Waiting 01229e3f0334: Waiting cdd7c7392317: Waiting 6e56c85f6c1e: Waiting 8d8fafa18e50: Waiting 5f70bf18a086: Layer already exists 061db2344c24: Pushed 6e19dd8abe86: Pushed 3b43d73d1153: Pushed b82dc0715f01: Pushed 6e56c85f6c1e: Pushed bcc80f6a93ea: Pushed 72c3165cca90: Pushed 2ef7b49b0142: Pushed 003cec87f4f3: Pushed a0aaf8685d03: Pushed 21a7bd952dcc: Layer already exists 01229e3f0334: Layer already exists 8d8fafa18e50: Layer already exists cdd7c7392317: Layer already exists 03717ce88585: Pushed c58282f48c4b: Pushed b79b456462ac: Pushed 41a022c3b8a7: Pushed > Task :sdks:python:setupVirtualenv Successfully installed cachetools-5.3.1 chardet-5.1.0 colorama-0.4.6 distlib-0.3.6 filelock-3.12.2 grpcio-1.56.0 grpcio-tools-1.53.0 mypy-protobuf-3.4.0 numpy-1.25.0 packaging-23.1 platformdirs-3.8.0 pluggy-1.2.0 protobuf-4.23.3 pyproject-api-1.5.2 setuptools-68.0.0 tox-4.6.3 types-protobuf-4.23.0.1 virtualenv-20.23.1 wheel-0.40.0 > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer 20230629052752: digest: sha256:a973ac298e22c1bf817d7128b0b06025589ab9545d79c863c8a99e91ab0151f0 size: 4296 > Task :sdks:python:sdist <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/setup.py>:28: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html from pkg_resources import DistributionNotFound <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/setuptools/dist.py>:509: InformationOnly: Normalizing '2.50.0.dev' to '2.50.0.dev0' self.metadata.version = self._normalize_version( warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py311:copyDockerfileDependencies > Task :sdks:python:container:py311:dockerPrepare > Task :sdks:python:container:py311:docker #1 [internal] load build definition from Dockerfile #1 transferring dockerfile: 4.91kB done #1 DONE 0.0s #2 [internal] load .dockerignore #2 transferring context: 2B done #2 DONE 0.0s #3 [internal] load metadata for docker.io/library/python:3.11-bullseye #3 DONE 0.4s #4 [beam 1/5] FROM docker.io/library/python:3.11-bullseye@sha256:5b401676aff858495a5c9c726c60b8b73fe52833e9e16eccdb59e93d52741727 #4 CACHED #5 [internal] load build context #5 transferring context: 17.67MB 0.1s done #5 DONE 0.2s #6 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt #6 DONE 0.9s #7 [beam 3/5] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/ #7 DONE 0.1s #8 [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/ #8 DONE 0.3s #9 [beam 5/5] RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools && pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._implementation_type == 'upb'; print ('Verified fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc && ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false && pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip freeze --all && rm -rf /root/.cache/pip > Task :sdks:python:installGcpTest > Task :sdks:python:container:py311:docker #9 30.68 Err:1 http://deb.debian.org/debian bullseye InRelease #9 30.68 Could not connect to debian.map.fastlydns.net:80 (199.232.30.132), connection timed out Unable to connect to deb.debian.org:http: #9 30.68 Err:2 http://deb.debian.org/debian-security bullseye-security InRelease #9 30.68 Unable to connect to deb.debian.org:http: #9 30.68 Err:3 http://deb.debian.org/debian bullseye-updates InRelease #9 30.68 Unable to connect to deb.debian.org:http: #9 30.68 Reading package lists... #9 30.70 W: Failed to fetch http://deb.debian.org/debian/dists/bullseye/InRelease Could not connect to debian.map.fastlydns.net:80 (199.232.30.132), connection timed out Unable to connect to deb.debian.org:http: #9 30.70 W: Failed to fetch http://deb.debian.org/debian-security/dists/bullseye-security/InRelease Unable to connect to deb.debian.org:http: #9 30.70 W: Failed to fetch http://deb.debian.org/debian/dists/bullseye-updates/InRelease Unable to connect to deb.debian.org:http: #9 30.70 W: Some index files failed to download. They have been ignored, or old ones used instead. #9 30.71 Reading package lists... #9 30.72 Building dependency tree... #9 30.72 Reading state information... #9 30.73 E: Unable to locate package libsnappy-dev #9 30.73 E: Unable to locate package ccache #9 30.73 Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate #9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools && pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._implementation_type == 'upb'; print ('Verified fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc && ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false && pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip freeze --all && rm -rf /root/.cache/pip]: exit code: 1 ------ > [beam 5/5] RUN apt-get update && apt-get install -y > libsnappy-dev libyaml-dev ccache && rm -rf > /var/lib/apt/lists/* && pip install --upgrade setuptools && pip > install --no-deps -r /tmp/base_image_requirements.txt && rm -rf > /tmp/base_image_requirements.txt && python -c "import nltk; > nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip > && python -c "from google.protobuf.internal import api_implementation; > assert api_implementation._implementation_type == 'upb'; print ('Verified > fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd > /usr/local/gcloud && curl -s -O > https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar > -xf google-cloud-sdk.tar.gz && > /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf > /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm > google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc && > ccache --set-config=sloppiness=file_macro && ccache > --set-config=hash_dir=false && pip install --no-deps -v > /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo > "Container does not include required Beam dependencies or has conflicting > dependencies. If Beam dependencies have changed, you need to regenerate > base_image_requirements.txt files. See: > https://s.apache.org/beam-python-requirements-generate"; && exit 1) && > pip freeze --all && rm -rf /root/.cache/pip: #9 30.70 W: Failed to fetch http://deb.debian.org/debian/dists/bullseye/InRelease Could not connect to debian.map.fastlydns.net:80 (199.232.30.132), connection timed out Unable to connect to deb.debian.org:http: #9 30.70 W: Failed to fetch http://deb.debian.org/debian-security/dists/bullseye-security/InRelease Unable to connect to deb.debian.org:http: #9 30.70 W: Failed to fetch http://deb.debian.org/debian/dists/bullseye-updates/InRelease Unable to connect to deb.debian.org:http: #9 30.70 W: Some index files failed to download. They have been ignored, or old ones used instead. #9 30.71 Reading package lists... #9 30.72 Building dependency tree... #9 30.72 Reading state information... #9 30.73 E: Unable to locate package libsnappy-dev #9 30.73 E: Unable to locate package ccache #9 30.73 Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate ------ ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools && pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._implementation_type == 'upb'; print ('Verified fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc && ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false && pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip freeze --all && rm -rf /root/.cache/pip]: exit code: 1 > Task :sdks:python:container:py311:docker FAILED > Task :sdks:python:installGcpTest Successfully installed PyJWT-2.7.0 apache-beam-2.50.0.dev0 attrs-23.1.0 azure-core-1.27.1 azure-identity-1.14.0b1 azure-storage-blob-12.17.0b1 boto3-1.26.163 botocore-1.29.163 certifi-2023.5.7 cffi-1.15.1 charset-normalizer-3.1.0 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.1 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.3.0 docker-6.1.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.7.4 fasteners-0.18 freezegun-1.2.2 google-api-core-2.12.0.dev0 google-apitools-0.5.31 google-auth-2.22.0rc1 google-auth-httplib2-0.1.0 google-cloud-aiplatform-1.26.1 google-cloud-bigquery-3.11.3 google-cloud-bigquery-storage-2.20.0 google-cloud-bigtable-2.19.0 google-cloud-core-2.3.2 google-cloud-datastore-2.16.0 google-cloud-dlp-3.12.1 google-cloud-language-2.10.0 google-cloud-pubsub-2.17.1 google-cloud-pubsublite-1.8.2 google-cloud-recommendations-ai-0.10.3 google-cloud-resource-manager-1.10.1 google-cloud-spanner-3.36.0 google-cloud-storage-2.10.0 google-cloud-videointelligence-2.11.2 google-cloud-vision-3.4.3 google-crc32c-1.5.0 google-resumable-media-2.5.0 googleapis-common-protos-1.59.1 greenlet-3.0.0a1 grpc-google-iam-v1-0.12.6 grpcio-status-1.56.0 hdfs-2.7.0 httplib2-0.22.0 hypothesis-6.80.0 idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.0 mock-5.0.2 msal-1.22.0 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.1 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 portalocker-2.7.0 proto-plus-1.22.3 psycopg2-binary-2.9.6 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.0.4 pymongo-4.4.0 pymysql-1.1.0 pyparsing-3.1.0 pytest-7.4.0 pytest-timeout-2.1.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3 pyyaml-6.0 regex-2023.6.3 requests-2.31.0 requests_mock-1.11.0 rsa-4.9 s3transfer-0.6.1 scikit-learn-1.3.0rc1 scipy-1.11.1 shapely-1.8.5.post1 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.48 sqlparse-0.4.4 tenacity-8.2.2 testcontainers-3.7.1 threadpoolctl-3.1.0 typing-extensions-4.7.0 urllib3-1.26.16 websocket-client-1.6.1 wrapt-1.15.0 zstandard-0.21.0 FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py311:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1m 48s 140 actionable tasks: 19 executed, 121 up-to-date Publishing build scan... https://ge.apache.org/s/bb7ienixgogs6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
