See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/1554/display/redirect?page=changes>
Changes: [noreply] [#24789][prism] Add testdofns for later (#25557) [noreply] [#24789][prism] Minimum required jobservices (#25556) [noreply] [#24789][prism] Handlers for combine, ParDo, GBK, Flatten (#25558) [noreply] [prism] Tiny lint fixes (#25564) [noreply] minor error handling fixes (#25555) ------------------------------------------ [...truncated 584.42 KB...] Removing intermediate container 2367340381bf ---> 4c33be740ec8 Step 22/32 : FROM beam as third_party_licenses ---> 4c33be740ec8 Step 23/32 : ARG pull_licenses ---> Running in 794c8601c57d Removing intermediate container 794c8601c57d ---> f2fbc2bc421c Step 24/32 : COPY target/license_scripts /tmp/license_scripts/ ---> 2127b2da5305 Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> b7296db4236a Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in f0946f4ec79f Removing intermediate container f0946f4ec79f ---> 0dda2d33b9be Step 27/32 : COPY target/license_scripts /tmp/license_scripts/ ---> 71cef1d83a75 Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in a8ed8d3d8c1d Collecting pip-licenses<4.0.0 Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=e6d56a9ed29bd0c43e1cd7a83aa79b3d6c683c75f9e8d5dd56eb0ae90db713e3 Stored in directory: /root/.cache/pip/wheels/33/df/2f/674985b3f8a2de3f96357d1eadef5110f74fa91b3785e52a54 Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-3.5.5 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mINFO:root:Successfully pulled licenses for 136 dependencies [0mSkip pulling license for bs4 Removing intermediate container a8ed8d3d8c1d ---> de01b9fc9323 Step 29/32 : FROM beam ---> 4c33be740ec8 Step 30/32 : ARG pull_licenses ---> Running in 9adbde20a09d Removing intermediate container 9adbde20a09d ---> e6051ee9b64d Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> 4bff15c0dbfa Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 3e17502a2b98 Removing intermediate container 3e17502a2b98 ---> c388a334534c Successfully built c388a334534c Successfully tagged apache/beam_python3.7_sdk:2.46.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 10d32fe606d4: Preparing 2262197ea218: Preparing e2d76f2d8c8f: Preparing 92318fb08770: Preparing f143fe869bc6: Preparing 08ccdfd59617: Preparing 925ff59f7b0b: Preparing 28f48564d230: Preparing 62c541b8ac51: Preparing d5acc079fa9a: Preparing c9b0f6377169: Preparing fee83c75f8e4: Preparing c0440a9769f3: Preparing c5d174b7f1fa: Preparing 4169ad63f09d: Preparing b2cc056dd71d: Preparing 2167aebfcb85: Preparing 17efc79ac0fe: Preparing 0b6859e9fff1: Preparing 11829b3be9c0: Preparing dc8e1d8b53e9: Preparing 9d49e0bc68a4: Preparing 8e396a1aad50: Preparing c5d174b7f1fa: Waiting 925ff59f7b0b: Waiting 62c541b8ac51: Waiting 2167aebfcb85: Waiting dc8e1d8b53e9: Waiting 17efc79ac0fe: Waiting 08ccdfd59617: Waiting fee83c75f8e4: Waiting 28f48564d230: Waiting 8e396a1aad50: Waiting 0b6859e9fff1: Waiting c0440a9769f3: Waiting 9d49e0bc68a4: Waiting b2cc056dd71d: Waiting e2d76f2d8c8f: Pushed 92318fb08770: Pushed f143fe869bc6: Pushed 10d32fe606d4: Pushed 2262197ea218: Pushed 28f48564d230: Pushed 62c541b8ac51: Pushed 925ff59f7b0b: Pushed c0440a9769f3: Pushed c5d174b7f1fa: Pushed 4169ad63f09d: Layer already exists b2cc056dd71d: Layer already exists 2167aebfcb85: Layer already exists 17efc79ac0fe: Layer already exists 0b6859e9fff1: Layer already exists c9b0f6377169: Pushed 11829b3be9c0: Layer already exists 9d49e0bc68a4: Layer already exists dc8e1d8b53e9: Layer already exists 8e396a1aad50: Layer already exists 08ccdfd59617: Pushed d5acc079fa9a: Pushed fee83c75f8e4: Pushed 20230220210948: digest: sha256:5b7a787fee36f1e01f26dcad1cebd5f0ddf7538e4953ed12e17e24aa7720d247 size: 5156 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Stopping expansion service pid: 442224. Stopping expansion service pid: 442225. Launching Java expansion service @ 45913 Launching Python expansion service @ 41771 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.45.0 INFO:root:No image given, using default Python SDK image INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.45.0 INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.45.0" for Docker environment INFO:__main__:Listening for expansion requests at 34491 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.45.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpu6m11v2c/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64'] INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.45.0 INFO:root:No image given, using default Python SDK image INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.45.0 INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.45.0" for Docker environment INFO:__main__:Listening for expansion requests at 41665 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED org.apache.beam.vendor.grpc.v1p48p1.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:242 Caused by: org.apache.beam.vendor.grpc.v1p48p1.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at Errors.java:155 java.lang.NullPointerException at Preconditions.java:980 org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonMap FAILED java.lang.RuntimeException at PythonMapTest.java:41 Caused by: java.util.concurrent.TimeoutException at PythonMapTest.java:41 java.lang.NullPointerException at Preconditions.java:980 org.apache.beam.sdk.extensions.python.transforms.DataframeTransformTest > testDataframeSum FAILED java.lang.RuntimeException at DataframeTransformTest.java:50 Caused by: java.util.concurrent.TimeoutException at DataframeTransformTest.java:50 java.lang.NullPointerException at Preconditions.java:980 org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonFlatMap FAILED java.lang.RuntimeException at PythonMapTest.java:54 Caused by: java.util.concurrent.TimeoutException at PythonMapTest.java:54 java.lang.NullPointerException at Preconditions.java:980 org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInferenceWithKVs FAILED java.lang.RuntimeException at RunInferenceTransformTest.java:108 Caused by: java.util.concurrent.TimeoutException at RunInferenceTransformTest.java:108 java.lang.NullPointerException at Preconditions.java:980 org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInference FAILED java.lang.RuntimeException at RunInferenceTransformTest.java:60 Caused by: java.util.concurrent.TimeoutException at RunInferenceTransformTest.java:60 java.lang.NullPointerException at Preconditions.java:980 16 tests completed, 6 failed > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230220210948 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b7a787fee36f1e01f26dcad1cebd5f0ddf7538e4953ed12e17e24aa7720d247 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230220210948] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b7a787fee36f1e01f26dcad1cebd5f0ddf7538e4953ed12e17e24aa7720d247] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230220210948] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b7a787fee36f1e01f26dcad1cebd5f0ddf7538e4953ed12e17e24aa7720d247])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b7a787fee36f1e01f26dcad1cebd5f0ddf7538e4953ed12e17e24aa7720d247 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b7a787fee36f1e01f26dcad1cebd5f0ddf7538e4953ed12e17e24aa7720d247 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:5b7a787fee36f1e01f26dcad1cebd5f0ddf7538e4953ed12e17e24aa7720d247]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230220210948 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7132cbfebbc289b04fad683f8f2b48b6706034362729e5bfeb002efcf789aa36 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230220210948] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7132cbfebbc289b04fad683f8f2b48b6706034362729e5bfeb002efcf789aa36] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230220210948] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7132cbfebbc289b04fad683f8f2b48b6706034362729e5bfeb002efcf789aa36])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7132cbfebbc289b04fad683f8f2b48b6706034362729e5bfeb002efcf789aa36 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7132cbfebbc289b04fad683f8f2b48b6706034362729e5bfeb002efcf789aa36 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7132cbfebbc289b04fad683f8f2b48b6706034362729e5bfeb002efcf789aa36]. > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 22m 42s 185 actionable tasks: 122 executed, 57 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/7jpofuqceccve Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
