See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/911/display/redirect?page=changes>
Changes: [noreply] Bump dataflow java fnapi container version to beam-master-20220830 [noreply] [Issue#23071] Fix AfterProcessingTime for Python to behave like Java ------------------------------------------ [...truncated 509.13 KB...] requests-mock==1.9.3 requests-oauthlib==1.3.1 rsa==4.9 scikit-learn==1.0.2 scipy==1.7.3 setuptools==65.3.0 six==1.16.0 soupsieve==2.3.2.post1 SQLAlchemy==1.4.39 tenacity==5.1.5 tensorboard==2.9.1 tensorboard-data-server==0.6.1 tensorboard-plugin-wit==1.8.1 tensorflow==2.9.1 tensorflow-estimator==2.9.0 tensorflow-io-gcs-filesystem==0.26.0 termcolor==1.1.0 testcontainers==3.6.0 threadpoolctl==3.1.0 tomli==2.0.1 tqdm==4.64.0 typing-utils==0.1.0 typing_extensions==4.3.0 uritemplate==4.1.1 urllib3==1.26.11 websocket-client==1.3.3 Werkzeug==2.2.1 wheel==0.37.1 wrapt==1.14.1 zipp==3.8.1 zstandard==0.18.0 Removing intermediate container 711e44a97fc2 ---> a7bdd6247099 Step 17/32 : COPY target/LICENSE /opt/apache/beam/ ---> 64748cc96c8d Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/ ---> 6c6b222c7a00 Step 19/32 : COPY target/NOTICE /opt/apache/beam/ ---> 1386ecbdc313 Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 1469c1d20488 Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 459030270e83 Removing intermediate container 459030270e83 ---> 349b1959ce1a Step 22/32 : FROM beam as third_party_licenses ---> 349b1959ce1a Step 23/32 : ARG pull_licenses ---> Running in f5a81a3c5def Removing intermediate container f5a81a3c5def ---> cf99a5d84812 Step 24/32 : COPY target/license_scripts /tmp/license_scripts/ ---> 2e6845d3498b Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> f3c1af1a2ccc Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 76bda6a14981 Removing intermediate container 76bda6a14981 ---> 65e9e685d462 Step 27/32 : COPY target/license_scripts /tmp/license_scripts/ ---> dd1453723f54 Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in 5e5d1bf8a960 Collecting pip-licenses<4.0.0 Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=b3e9483012818740c413cf2fa797734465bf557cdea8acef2255b1f177e66ae5 Stored in directory: /root/.cache/pip/wheels/33/df/2f/674985b3f8a2de3f96357d1eadef5110f74fa91b3785e52a54 Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-3.5.4 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0mSkip pulling license for bs4 [91mINFO:root:Successfully pulled licenses for 136 dependencies [0mRemoving intermediate container 5e5d1bf8a960 ---> 73d74dc26be7 Step 29/32 : FROM beam ---> 349b1959ce1a Step 30/32 : ARG pull_licenses ---> Running in 9e8e0aa8c811 Removing intermediate container 9e8e0aa8c811 ---> b3216ffa1f63 Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> a4e0953611a6 Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 0aba7fc03673 Removing intermediate container 0aba7fc03673 ---> 94322b774e64 Successfully built 94322b774e64 Successfully tagged apache/beam_python3.7_sdk:2.43.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] c11fbae70393: Preparing 98b737d03dc9: Preparing 497f8e4530f4: Preparing ac97ebc483bf: Preparing bf99ee365b59: Preparing fb9a0a0cd430: Preparing d05f34aa0d18: Preparing cfd6ee491512: Preparing f5e19aa3e858: Preparing 997f8047b180: Preparing 52c7621420b7: Preparing 738463d3080a: Preparing 2aa6360f48a7: Preparing 73618a923301: Preparing 61a06978004d: Preparing 14cc7c223091: Preparing 083cc17f34b9: Preparing 100796cdf3b1: Preparing 54acb5a6fa0b: Preparing 8d51c618126f: Preparing 9ff6e4d46744: Preparing a89d1d47b5a1: Preparing 655ed1b7a428: Preparing 61a06978004d: Waiting fb9a0a0cd430: Waiting 14cc7c223091: Waiting d05f34aa0d18: Waiting cfd6ee491512: Waiting 9ff6e4d46744: Waiting a89d1d47b5a1: Waiting 083cc17f34b9: Waiting 8d51c618126f: Waiting 54acb5a6fa0b: Waiting 100796cdf3b1: Waiting f5e19aa3e858: Waiting 738463d3080a: Waiting 997f8047b180: Waiting 73618a923301: Waiting 52c7621420b7: Waiting 2aa6360f48a7: Waiting c11fbae70393: Pushed 497f8e4530f4: Pushed bf99ee365b59: Pushed ac97ebc483bf: Pushed 98b737d03dc9: Pushed cfd6ee491512: Pushed f5e19aa3e858: Pushed d05f34aa0d18: Pushed 2aa6360f48a7: Pushed 73618a923301: Pushed 61a06978004d: Layer already exists 14cc7c223091: Layer already exists 52c7621420b7: Pushed 083cc17f34b9: Layer already exists 100796cdf3b1: Layer already exists 54acb5a6fa0b: Layer already exists 8d51c618126f: Layer already exists 9ff6e4d46744: Layer already exists a89d1d47b5a1: Layer already exists 655ed1b7a428: Layer already exists fb9a0a0cd430: Pushed 997f8047b180: Pushed 738463d3080a: Pushed 20220912210938: digest: sha256:5db2ea984d42f6f91b7c51d49771fcf8a3d77f9606beef9bba662255c64cd3b9 size: 5156 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 38617 Launching Python expansion service @ 38919 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220912210938 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5db2ea984d42f6f91b7c51d49771fcf8a3d77f9606beef9bba662255c64cd3b9 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220912210938] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5db2ea984d42f6f91b7c51d49771fcf8a3d77f9606beef9bba662255c64cd3b9] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220912210938] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5db2ea984d42f6f91b7c51d49771fcf8a3d77f9606beef9bba662255c64cd3b9])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5db2ea984d42f6f91b7c51d49771fcf8a3d77f9606beef9bba662255c64cd3b9 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5db2ea984d42f6f91b7c51d49771fcf8a3d77f9606beef9bba662255c64cd3b9 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5db2ea984d42f6f91b7c51d49771fcf8a3d77f9606beef9bba662255c64cd3b9]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220912210938 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6503cc6a52709b5e6445e17a4090842a46555c5161ba4f30938b45092c6d43fd Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220912210938] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6503cc6a52709b5e6445e17a4090842a46555c5161ba4f30938b45092c6d43fd] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220912210938] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6503cc6a52709b5e6445e17a4090842a46555c5161ba4f30938b45092c6d43fd])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:389fc41ed76a0e6576c6056c812428860b6b3296e2fb8e1ac9301c7d628b5c48 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:389fc41ed76a0e6576c6056c812428860b6b3296e2fb8e1ac9301c7d628b5c48 ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Mon, 12 Sep 2022 21:42:33 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'} Failed to compute blob liveness for manifest: 'sha256:389fc41ed76a0e6576c6056c812428860b6b3296e2fb8e1ac9301c7d628b5c48': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 1306421. Stopping expansion service pid: 1306422. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 302 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 33m 8s 184 actionable tasks: 122 executed, 56 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/3tzwjk3l2aqc6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
