See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/876/display/redirect?page=changes>
Changes: [noreply] [#19857] Migrate to using a memory aware cache within the Python SDK ------------------------------------------ [...truncated 515.30 KB...] soupsieve==2.3.2.post1 SQLAlchemy==1.4.39 tenacity==5.1.5 tensorboard==2.9.1 tensorboard-data-server==0.6.1 tensorboard-plugin-wit==1.8.1 tensorflow==2.9.1 tensorflow-estimator==2.9.0 tensorflow-io-gcs-filesystem==0.26.0 termcolor==1.1.0 testcontainers==3.6.0 threadpoolctl==3.1.0 tomli==2.0.1 tqdm==4.64.0 typing-utils==0.1.0 typing_extensions==4.3.0 uritemplate==4.1.1 urllib3==1.26.11 websocket-client==1.3.3 Werkzeug==2.2.1 wheel==0.37.1 wrapt==1.14.1 zipp==3.8.1 zstandard==0.18.0 Removing intermediate container 4dbd20eff8f1 ---> 0c67b05b4abf Step 17/32 : COPY target/LICENSE /opt/apache/beam/ ---> 0290696df443 Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/ ---> a9ac297727ca Step 19/32 : COPY target/NOTICE /opt/apache/beam/ ---> 6d5f5a81ba39 Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 85c546cd7baa Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in c2a354d2e520 Removing intermediate container c2a354d2e520 ---> 6f5d98044d53 Step 22/32 : FROM beam as third_party_licenses ---> 6f5d98044d53 Step 23/32 : ARG pull_licenses ---> Running in 694ac58527a4 Removing intermediate container 694ac58527a4 ---> 2817fd045cfa Step 24/32 : COPY target/license_scripts /tmp/license_scripts/ ---> ae65be602fa2 Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> d22f44674faa Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in de0ae767a8ee Removing intermediate container de0ae767a8ee ---> efe924361ed0 Step 27/32 : COPY target/license_scripts /tmp/license_scripts/ ---> a848ecf0a984 Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in 1d48f3021f1f Collecting pip-licenses<4.0.0 Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=99ec57521b4ce7b2f4e0c63add12ac6b44b9b7c0d832331ab5ce06be05f38a2e Stored in directory: /root/.cache/pip/wheels/33/df/2f/674985b3f8a2de3f96357d1eadef5110f74fa91b3785e52a54 Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-3.5.4 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0mSkip pulling license for bs4 [91mINFO:root:Successfully pulled licenses for 136 dependencies [0mRemoving intermediate container 1d48f3021f1f ---> 5a4452831da1 Step 29/32 : FROM beam ---> 6f5d98044d53 Step 30/32 : ARG pull_licenses ---> Running in 492dedcec92a Removing intermediate container 492dedcec92a ---> 90760c5cf3be Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> b4843ac216a9 Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in aaef669e39e8 Removing intermediate container aaef669e39e8 ---> 25dcb81ef6d2 Successfully built 25dcb81ef6d2 Successfully tagged apache/beam_python3.7_sdk:2.42.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] f75263c1bd04: Preparing 4945e0ec163f: Preparing 673b4340795f: Preparing fbf06164946b: Preparing 1240f0247807: Preparing 0ffcf9ae989b: Preparing 61f0d06e2d40: Preparing 30f4c56aa7a0: Preparing 7eeabe8a59bd: Preparing 9f1e63e78096: Preparing 667ab59857ac: Preparing 1a0effbb8694: Preparing 36ebb372743d: Preparing 20f917eea843: Preparing bd2aedacc58f: Preparing 0d858d352b03: Preparing 76bc459f764a: Preparing 100796cdf3b1: Preparing 54acb5a6fa0b: Preparing 8d51c618126f: Preparing 30f4c56aa7a0: Waiting 9ff6e4d46744: Preparing 0ffcf9ae989b: Waiting a89d1d47b5a1: Preparing 655ed1b7a428: Preparing 61f0d06e2d40: Waiting 76bc459f764a: Waiting 7eeabe8a59bd: Waiting 9f1e63e78096: Waiting 9ff6e4d46744: Waiting 667ab59857ac: Waiting 100796cdf3b1: Waiting 54acb5a6fa0b: Waiting 8d51c618126f: Waiting 1a0effbb8694: Waiting a89d1d47b5a1: Waiting 0d858d352b03: Waiting bd2aedacc58f: Waiting 20f917eea843: Waiting fbf06164946b: Pushed 673b4340795f: Pushed 1240f0247807: Pushed f75263c1bd04: Pushed 4945e0ec163f: Pushed 61f0d06e2d40: Pushed 30f4c56aa7a0: Pushed 7eeabe8a59bd: Pushed 36ebb372743d: Pushed 667ab59857ac: Pushed 20f917eea843: Pushed bd2aedacc58f: Layer already exists 76bc459f764a: Layer already exists 0d858d352b03: Layer already exists 100796cdf3b1: Layer already exists 54acb5a6fa0b: Layer already exists 8d51c618126f: Layer already exists a89d1d47b5a1: Layer already exists 9ff6e4d46744: Layer already exists 655ed1b7a428: Layer already exists 0ffcf9ae989b: Pushed 9f1e63e78096: Pushed 1a0effbb8694: Pushed 20220904030938: digest: sha256:79feee8ede839bda8a0f6707372efb6dcd3c58f108c6d2876b2e62b4cc1bc441 size: 5156 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 32965 Launching Python expansion service @ 35889 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInferenceWithKVs FAILED java.lang.IllegalStateException at RunInferenceTransformTest.java:108 java.lang.NullPointerException at Preconditions.java:980 org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInference FAILED java.lang.IllegalStateException at RunInferenceTransformTest.java:60 java.lang.NullPointerException at Preconditions.java:980 16 tests completed, 2 failed, 2 skipped > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 2850838. Stopping expansion service pid: 2850839. > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220904030938 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:79feee8ede839bda8a0f6707372efb6dcd3c58f108c6d2876b2e62b4cc1bc441 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220904030938] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:79feee8ede839bda8a0f6707372efb6dcd3c58f108c6d2876b2e62b4cc1bc441] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220904030938] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:79feee8ede839bda8a0f6707372efb6dcd3c58f108c6d2876b2e62b4cc1bc441])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:79feee8ede839bda8a0f6707372efb6dcd3c58f108c6d2876b2e62b4cc1bc441 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:79feee8ede839bda8a0f6707372efb6dcd3c58f108c6d2876b2e62b4cc1bc441 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:79feee8ede839bda8a0f6707372efb6dcd3c58f108c6d2876b2e62b4cc1bc441]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220904030938 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8637e42d3dc93a658b0a95273e619064c023a7d2a8a6dfdc2ec5c61d3e242b6a Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220904030938] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8637e42d3dc93a658b0a95273e619064c023a7d2a8a6dfdc2ec5c61d3e242b6a] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220904030938] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8637e42d3dc93a658b0a95273e619064c023a7d2a8a6dfdc2ec5c61d3e242b6a])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8637e42d3dc93a658b0a95273e619064c023a7d2a8a6dfdc2ec5c61d3e242b6a Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8637e42d3dc93a658b0a95273e619064c023a7d2a8a6dfdc2ec5c61d3e242b6a Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8637e42d3dc93a658b0a95273e619064c023a7d2a8a6dfdc2ec5c61d3e242b6a]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 33m 3s 184 actionable tasks: 121 executed, 57 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/ym7icy5tvssuk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
