See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1482/display/redirect?page=changes>
Changes: [noreply] [Spark Dataset runner] Fix collection encoder bug that may lead to ------------------------------------------ [...truncated 1.08 MB...] packaging==23.0 pandas==1.5.3 parameterized==0.8.1 pbr==5.11.1 pip==23.0 pluggy==1.0.0 proto-plus==1.22.2 protobuf==3.19.6 psycopg2-binary==2.9.5 py==1.11.0 pyarrow==9.0.0 pyasn1==0.4.8 pyasn1-modules==0.2.8 pycparser==2.21 pydot==1.4.2 PyHamcrest==1.10.1 pymongo==3.13.0 PyMySQL==1.0.2 pyparsing==3.0.9 pytest==7.2.1 pytest-forked==1.4.0 pytest-timeout==2.1.0 pytest-xdist==2.5.0 python-dateutil==2.8.2 python-snappy==0.6.1 pytz==2022.7.1 PyYAML==6.0 regex==2022.10.31 requests==2.28.2 requests-mock==1.10.0 requests-oauthlib==1.3.1 rsa==4.9 scikit-learn==1.2.1 scipy==1.10.0 setuptools==67.1.0 six==1.16.0 sortedcontainers==2.4.0 soupsieve==2.3.2.post1 SQLAlchemy==1.4.46 sqlparse==0.4.3 tenacity==5.1.5 tensorboard==2.11.2 tensorboard-data-server==0.6.1 tensorboard-plugin-wit==1.8.1 tensorflow==2.11.0 tensorflow-estimator==2.11.0 tensorflow-io-gcs-filesystem==0.30.0 termcolor==2.2.0 testcontainers==3.7.1 threadpoolctl==3.1.0 tomli==2.0.1 tqdm==4.64.1 typing_extensions==4.4.0 uritemplate==4.1.1 urllib3==1.26.14 websocket-client==1.4.2 Werkzeug==2.2.2 wheel==0.38.4 wrapt==1.14.1 zstandard==0.19.0 Removing intermediate container aab87e608a06 ---> 7704e671c31a Step 17/32 : COPY target/LICENSE /opt/apache/beam/ ---> 1a379778cb31 Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/ ---> a9f6c3b8d153 Step 19/32 : COPY target/NOTICE /opt/apache/beam/ ---> 86a41d8947f3 Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/ ---> a0692af5de19 Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in ce8abcbb86d6 Removing intermediate container ce8abcbb86d6 ---> 1a3ad972129f Step 22/32 : FROM beam as third_party_licenses ---> 1a3ad972129f Step 23/32 : ARG pull_licenses ---> Running in 2f2607dd9fdc Removing intermediate container 2f2607dd9fdc ---> 5b2e588eeb8c Step 24/32 : COPY target/license_scripts /tmp/license_scripts/ ---> fb465d42953a Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> aa8a95a22821 Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 32509b6264e7 Removing intermediate container 32509b6264e7 ---> 4343f19fd748 Step 27/32 : COPY target/license_scripts /tmp/license_scripts/ ---> 19123680e4f1 Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in 540c08fbf81e Collecting pip-licenses<4.0.0 Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=57772ed619d745782bc25bed7e3f40c9ae98d2b4932d2d47fe34e8517fd558fc Stored in directory: /root/.cache/pip/wheels/bc/88/52/f2e9fc70f3a657cf256e9b01a8a42938c4c5ee69118d51ed90 Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-3.5.5 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0mSkip pulling license for bs4 [91mINFO:root:Successfully pulled licenses for 134 dependencies [0mRemoving intermediate container 540c08fbf81e ---> bb6fe2412eb7 Step 29/32 : FROM beam ---> 1a3ad972129f Step 30/32 : ARG pull_licenses ---> Running in acc67beceb73 Removing intermediate container acc67beceb73 ---> 0148a31bdfb3 Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> 8f3c18756040 Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 78c90b13f4e0 Removing intermediate container 78c90b13f4e0 ---> a06a5ceb3d5c Successfully built a06a5ceb3d5c Successfully tagged apache/beam_python3.10_sdk:2.46.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] d2bc2cf20820: Preparing 16e76893e257: Preparing 3b9c47cb46d0: Preparing b7868df6367a: Preparing f91bda0121b7: Preparing af8cf01964a2: Preparing 6ccad934776b: Preparing d5542ca0319d: Preparing 774dec7acece: Preparing 59ff883848d6: Preparing 6c08b9fd4890: Preparing bbf141d2c6e9: Preparing 3f66a14bfddd: Preparing 79dbc86daf80: Preparing 14f8c1c57058: Preparing 7c9f55d641e2: Preparing 2a5e0ed31f5a: Preparing dc6462f7bb8b: Preparing a4db1a405763: Preparing 9f4f964da727: Preparing 49b333f7bad4: Preparing a463dbda4664: Preparing a9099c3159f5: Preparing 59ff883848d6: Waiting 6c08b9fd4890: Waiting bbf141d2c6e9: Waiting 3f66a14bfddd: Waiting 79dbc86daf80: Waiting 14f8c1c57058: Waiting 7c9f55d641e2: Waiting af8cf01964a2: Waiting 2a5e0ed31f5a: Waiting dc6462f7bb8b: Waiting a4db1a405763: Waiting 9f4f964da727: Waiting 49b333f7bad4: Waiting 6ccad934776b: Waiting a463dbda4664: Waiting a9099c3159f5: Waiting 774dec7acece: Waiting d5542ca0319d: Waiting f91bda0121b7: Pushed d2bc2cf20820: Pushed b7868df6367a: Pushed 3b9c47cb46d0: Pushed 16e76893e257: Pushed 6ccad934776b: Pushed 774dec7acece: Pushed d5542ca0319d: Pushed 3f66a14bfddd: Pushed 6c08b9fd4890: Pushed 14f8c1c57058: Layer already exists 7c9f55d641e2: Layer already exists 2a5e0ed31f5a: Layer already exists dc6462f7bb8b: Layer already exists a4db1a405763: Layer already exists 79dbc86daf80: Pushed 9f4f964da727: Layer already exists 49b333f7bad4: Layer already exists a463dbda4664: Layer already exists a9099c3159f5: Layer already exists af8cf01964a2: Pushed 59ff883848d6: Pushed bbf141d2c6e9: Pushed name unknown: Failed to get blob sizes. > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 43087 Launching Python expansion service @ 37833 > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 3676104. Stopping expansion service pid: 3676105. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 330 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 10m 59s 127 actionable tasks: 22 executed, 105 up-to-date Publishing build scan... https://gradle.com/s/gm4wg477cu56a Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
