See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/2063/display/redirect>
Changes: ------------------------------------------ [...truncated 1.25 MB...] #9 414.3 Markdown==3.4.3 #9 414.3 MarkupSafe==2.1.3 #9 414.3 ml-dtypes==0.2.0 #9 414.3 mmh3==4.0.0 #9 414.3 mock==5.0.2 #9 414.3 nltk==3.8.1 #9 414.3 nose==1.3.7 #9 414.3 numpy==1.23.5 #9 414.3 oauth2client==4.1.3 #9 414.3 oauthlib==3.2.2 #9 414.3 objsize==0.6.1 #9 414.3 opt-einsum==3.3.0 #9 414.3 orjson==3.9.1 #9 414.3 overrides==6.5.0 #9 414.3 packaging==23.1 #9 414.3 pandas==1.5.3 #9 414.3 parameterized==0.9.0 #9 414.3 pip==23.1.2 #9 414.3 pluggy==1.2.0 #9 414.3 proto-plus==1.22.3 #9 414.3 protobuf==4.23.3 #9 414.3 psycopg2-binary==2.9.6 #9 414.3 pyarrow==11.0.0 #9 414.3 pyasn1==0.5.0 #9 414.3 pyasn1-modules==0.3.0 #9 414.3 pycparser==2.21 #9 414.3 pydot==1.4.2 #9 414.3 PyHamcrest==2.0.4 #9 414.3 pymongo==4.4.0 #9 414.3 PyMySQL==1.1.0 #9 414.3 pyparsing==3.1.0 #9 414.3 pytest==7.4.0 #9 414.3 pytest-timeout==2.1.0 #9 414.3 pytest-xdist==3.3.1 #9 414.3 python-dateutil==2.8.2 #9 414.3 pytz==2023.3 #9 414.3 PyYAML==6.0 #9 414.3 regex==2023.6.3 #9 414.3 requests==2.31.0 #9 414.3 requests-mock==1.11.0 #9 414.3 requests-oauthlib==1.3.1 #9 414.3 rsa==4.9 #9 414.3 scikit-learn==1.2.2 #9 414.3 scipy==1.11.0 #9 414.3 setuptools==68.0.0 #9 414.3 Shapely==1.8.5.post1 #9 414.3 six==1.16.0 #9 414.3 sortedcontainers==2.4.0 #9 414.3 soupsieve==2.4.1 #9 414.3 SQLAlchemy==1.4.48 #9 414.3 sqlparse==0.4.4 #9 414.3 tenacity==8.2.2 #9 414.3 tensorboard==2.12.3 #9 414.3 tensorboard-data-server==0.7.1 #9 414.3 tensorflow==2.12.0 #9 414.3 tensorflow-estimator==2.12.0 #9 414.3 tensorflow-io-gcs-filesystem==0.32.0 #9 414.3 termcolor==2.3.0 #9 414.3 testcontainers==3.7.1 #9 414.3 threadpoolctl==3.1.0 #9 414.3 tqdm==4.65.0 #9 414.3 typing_extensions==4.6.3 #9 414.3 urllib3==1.26.16 #9 414.3 websocket-client==1.6.1 #9 414.3 Werkzeug==2.3.6 #9 414.3 wheel==0.40.0 #9 414.3 wrapt==1.14.1 #9 414.3 zstandard==0.21.0 #9 DONE 415.5s #10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #10 DONE 0.1s #11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #11 DONE 0.1s #12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #12 DONE 0.1s #13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #13 1.088 Collecting pip-licenses<5 #13 1.149 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB) #13 1.160 Requirement already satisfied: pyyaml in /usr/local/lib/python3.11/site-packages (6.0) #13 1.161 Requirement already satisfied: tenacity in /usr/local/lib/python3.11/site-packages (8.2.2) #13 1.223 Collecting prettytable>=2.3.0 (from pip-licenses<5) #13 1.238 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB) #13 1.295 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5) #13 1.309 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #13 2.489 Installing collected packages: wcwidth, prettytable, pip-licenses #13 2.644 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6 #13 2.645 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #13 18.10 Skip pulling license for bs4 #13 18.10 INFO:root:Successfully pulled licenses for 131 dependencies #13 DONE 18.2s #14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #14 DONE 0.1s #15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #15 DONE 1.0s #16 exporting to image #16 exporting layers #16 exporting layers 22.4s done #16 writing image sha256:02311e8f4b3a14163388ce8d35c0108e91ca5fa90dfd86f814dc6b7122d418de done #16 naming to docker.io/apache/beam_python3.11_sdk:2.49.0.dev done #16 DONE 22.4s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 2c62259456f5: Preparing 33db4f1fd007: Preparing 840b7b68c621: Preparing e8266853ee55: Preparing 4dc552a80f23: Preparing 341a339e43ee: Preparing f43029ba91a8: Preparing dbeff9f1ecd7: Preparing 35667d02507b: Preparing d2fbe63b0fb6: Preparing 47c2a9e31593: Preparing 3dcaf6977252: Preparing 4a8f5adb8cae: Preparing c28dd92cbb26: Preparing d2fbe63b0fb6: Waiting 47c2a9e31593: Waiting 3dcaf6977252: Waiting 341a339e43ee: Waiting 4a8f5adb8cae: Waiting f43029ba91a8: Waiting c28dd92cbb26: Waiting dbeff9f1ecd7: Waiting 35667d02507b: Waiting 33db4f1fd007: Pushed 4dc552a80f23: Pushed 2c62259456f5: Pushed f43029ba91a8: Layer already exists dbeff9f1ecd7: Layer already exists d2fbe63b0fb6: Layer already exists 35667d02507b: Layer already exists 47c2a9e31593: Layer already exists 4a8f5adb8cae: Layer already exists 3dcaf6977252: Layer already exists c28dd92cbb26: Layer already exists e8266853ee55: Pushed 341a339e43ee: Pushed 840b7b68c621: Pushed 20230628094221: digest: sha256:665f53d2f90c8c238d36a1e5a57df35685c2e6d909d92bb7d7f62bb64793f75e size: 3268 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 45119 Launching Python expansion service @ 45853 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.48.0 INFO:root:No image given, using default Python SDK image INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.48.0 INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.48.0" for Docker environment INFO:__main__:Listening for expansion requests at 40753 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.48.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpirs5_acu/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64'] INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.48.0 INFO:root:No image given, using default Python SDK image INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.48.0 INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.48.0" for Docker environment INFO:__main__:Listening for expansion requests at 39551 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230628094221 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:665f53d2f90c8c238d36a1e5a57df35685c2e6d909d92bb7d7f62bb64793f75e WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230628094221] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:665f53d2f90c8c238d36a1e5a57df35685c2e6d909d92bb7d7f62bb64793f75e] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230628094221] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:665f53d2f90c8c238d36a1e5a57df35685c2e6d909d92bb7d7f62bb64793f75e])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:665f53d2f90c8c238d36a1e5a57df35685c2e6d909d92bb7d7f62bb64793f75e Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:665f53d2f90c8c238d36a1e5a57df35685c2e6d909d92bb7d7f62bb64793f75e Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:665f53d2f90c8c238d36a1e5a57df35685c2e6d909d92bb7d7f62bb64793f75e]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230628094221 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef962c5f5b30f057d93822dcdaef29d954dca1b111c79ba6c1addda56d1132e4 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230628094221] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef962c5f5b30f057d93822dcdaef29d954dca1b111c79ba6c1addda56d1132e4] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230628094221] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ef962c5f5b30f057d93822dcdaef29d954dca1b111c79ba6c1addda56d1132e4])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5db309a6a54a4cceb2a5f6bd0767f1b83f57a96e1bb2501206150af6af0210df Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5db309a6a54a4cceb2a5f6bd0767f1b83f57a96e1bb2501206150af6af0210df ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'content-encoding': 'gzip', 'date': 'Wed, 28 Jun 2023 10:15:27 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 404} Failed to compute blob liveness for manifest: 'sha256:5db309a6a54a4cceb2a5f6bd0767f1b83f57a96e1bb2501206150af6af0210df': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 19421. Stopping expansion service pid: 19422. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 305 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 33m 20s 185 actionable tasks: 25 executed, 160 up-to-date Publishing build scan... https://ge.apache.org/s/5x4brsyyguraa Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
