See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/53/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-12976] Log projection pushdown optimizations. [benjamin.gonzalez] [BEAM-12572] Change jobs to run as cron jobs [alexander.zhuravlev] [BEAM-13820] Changed color of delete icon in pipeline options dropdown, [noreply] [BEAM-13193] Aggregates fn api outbound data/timers of different [noreply] [BEAM-13767] Migrate a bundle of grade tasks to use configuration [noreply] Merge pull request #16653 from [BEAM-12164]: Add integration tests for [noreply] Merge pull request #16728 from [BEAM-13823] Update docs for SnowflakeIO [noreply] Merge pull request #16660 from [BEAM-13771][Playground] Send multifile [noreply] Merge pull request #16646 from [BEAM-13643][Playground] Setup running [noreply] [BEAM-13015] Add state caching benchmark and move benchmarks to their [noreply] [BEAM-13419] Check for initialization in dataflow runner (#16765) [noreply] Merge pull request #16701 from [BEAM-13786] [Playground] [Bugfix] Update [noreply] Merge pull request #16754 from [BEAM-13838][Playground] Add logs in case [noreply] [BEAM-13293] consistent naming for expansion service address and flag [noreply] Merge pull request #16700 from [BEAM-13790][Playground] Change logic of [noreply] [BEAM-13830] update dependency for debeziumio expansion service (#16743) [noreply] [BEAM-13761] consistent namings for expansion address in Debezium IO [noreply] [BEAM-13806] Shutting down SchemaIO expansion services from Go VR [noreply] [release-2.36.0] Update website/changelog for release 2.36.0 (#16627) ------------------------------------------ [...truncated 542.40 KB...] testcontainers==3.4.2 tf-estimator-nightly==2.8.0.dev2021122109 threadpoolctl==3.1.0 tqdm==4.62.3 typing-inspect==0.7.1 typing-utils==0.1.0 typing_extensions==4.0.1 uritemplate==4.1.1 urllib3==1.26.8 wcwidth==0.2.5 websocket-client==1.2.3 Werkzeug==2.0.2 wheel==0.37.1 wrapt==1.13.3 zipp==3.7.0 Removing intermediate container ebd6c24d9b09 ---> 8aa574ccd96f Step 16/31 : COPY target/LICENSE /opt/apache/beam/ ---> b7987595c237 Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/ ---> 1da4401e5b6f Step 18/31 : COPY target/NOTICE /opt/apache/beam/ ---> f2c24ff145d3 Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 9c2b54f995d1 Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 0c3388692d40 Removing intermediate container 0c3388692d40 ---> 7cf428d07cae Step 21/31 : FROM beam as third_party_licenses ---> 7cf428d07cae Step 22/31 : ARG pull_licenses ---> Running in 9bb93eca5f73 Removing intermediate container 9bb93eca5f73 ---> 354b76ce1fcf Step 23/31 : COPY target/license_scripts /tmp/license_scripts/ ---> c98e8f37945f Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 99424f46ab02 Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 4f0a1c9345a5 Removing intermediate container 4f0a1c9345a5 ---> 1d1d58a3fe8e Step 26/31 : COPY target/license_scripts /tmp/license_scripts/ ---> e448bdf033b9 Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in 83434a12e98e Collecting pip-licenses<3.0.0 Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.8/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=a270fd0ad2d00ac937909bf86ad6660a5bbd044650e16f28095d10beb7865bf1 Stored in directory: /root/.cache/pip/wheels/1b/3a/02/8d8da2bca2223dda2f827949c88b2d82dc85dccbc2bb6265e5 Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-2.3.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mWARNING: You are using pip version 21.2.4; however, version 22.0.3 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0mSkip pulling license for bs4 [91mINFO:root:Successfully pulled licenses for 133 dependencies [0mRemoving intermediate container 83434a12e98e ---> 85eea580e432 Step 28/31 : FROM beam ---> 7cf428d07cae Step 29/31 : ARG pull_licenses ---> Running in aaedb9ce4100 Removing intermediate container aaedb9ce4100 ---> 9787c0ef2440 Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> 1d84f57869d6 Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 0ccacec10eb8 Removing intermediate container 0ccacec10eb8 ---> 1729b3bc79c7 Successfully built 1729b3bc79c7 Successfully tagged apache/beam_python3.8_sdk:2.37.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 06d96a223d07: Preparing 320eaaeab488: Preparing a84deb3e3858: Preparing a901de1772c7: Preparing fdfc66725bc9: Preparing ffcc37754b38: Preparing cb24d78a104b: Preparing 8d9bbbe6d5b9: Preparing 58039887ba33: Preparing b98f1dc5f916: Preparing 25eb4f5ece36: Preparing 9bd64ce37e42: Preparing 82ed95140387: Preparing 10392be9c727: Preparing e32bd6f8273b: Preparing 6110bc3bd626: Preparing fd6e60920678: Preparing 4c48fb37b7b0: Preparing a3232401de62: Preparing 204e42b3d47b: Preparing 613ab28cf833: Preparing bed676ceab7a: Preparing 6398d5cccd2c: Preparing 0b0f2f2f5279: Preparing ffcc37754b38: Waiting cb24d78a104b: Waiting 8d9bbbe6d5b9: Waiting 58039887ba33: Waiting b98f1dc5f916: Waiting 25eb4f5ece36: Waiting 9bd64ce37e42: Waiting 82ed95140387: Waiting 10392be9c727: Waiting e32bd6f8273b: Waiting 6110bc3bd626: Waiting fd6e60920678: Waiting 4c48fb37b7b0: Waiting a3232401de62: Waiting 204e42b3d47b: Waiting 613ab28cf833: Waiting bed676ceab7a: Waiting 6398d5cccd2c: Waiting 0b0f2f2f5279: Waiting a901de1772c7: Pushed fdfc66725bc9: Pushed a84deb3e3858: Pushed 06d96a223d07: Pushed cb24d78a104b: Pushed ffcc37754b38: Pushed 58039887ba33: Pushed 320eaaeab488: Pushed b98f1dc5f916: Pushed 25eb4f5ece36: Pushed 10392be9c727: Pushed 6110bc3bd626: Layer already exists fd6e60920678: Layer already exists 4c48fb37b7b0: Layer already exists a3232401de62: Layer already exists 204e42b3d47b: Layer already exists 613ab28cf833: Layer already exists bed676ceab7a: Layer already exists 6398d5cccd2c: Layer already exists 0b0f2f2f5279: Layer already exists e32bd6f8273b: Pushed 8d9bbbe6d5b9: Pushed 9bd64ce37e42: Pushed 82ed95140387: Pushed 20220208004254: digest: sha256:d5fb0dd30d91f8fc9f53880bd2c655366e4064cab99e38ef2560fd59ee57841c size: 5360 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 32991 Launching Python expansion service @ 38691 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:396 Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at Errors.java:155 java.lang.NullPointerException at ValidateRunnerXlangTest.java:391 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:414 Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException Caused by: java.net.ConnectException at Errors.java:155 java.lang.NullPointerException at ValidateRunnerXlangTest.java:409 8 tests completed, 2 failed > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 553676. Stopping expansion service pid: 553677. > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220208004254 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5fb0dd30d91f8fc9f53880bd2c655366e4064cab99e38ef2560fd59ee57841c Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220208004254] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5fb0dd30d91f8fc9f53880bd2c655366e4064cab99e38ef2560fd59ee57841c] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220208004254] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5fb0dd30d91f8fc9f53880bd2c655366e4064cab99e38ef2560fd59ee57841c])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5fb0dd30d91f8fc9f53880bd2c655366e4064cab99e38ef2560fd59ee57841c Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5fb0dd30d91f8fc9f53880bd2c655366e4064cab99e38ef2560fd59ee57841c Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:d5fb0dd30d91f8fc9f53880bd2c655366e4064cab99e38ef2560fd59ee57841c]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220208004254 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:05a7fe4adb7941013abe40352cb7c80970d49ca2f7cfc1cc90e3398dbf483cd8 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220208004254] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:05a7fe4adb7941013abe40352cb7c80970d49ca2f7cfc1cc90e3398dbf483cd8] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220208004254] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:05a7fe4adb7941013abe40352cb7c80970d49ca2f7cfc1cc90e3398dbf483cd8])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:05a7fe4adb7941013abe40352cb7c80970d49ca2f7cfc1cc90e3398dbf483cd8 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:05a7fe4adb7941013abe40352cb7c80970d49ca2f7cfc1cc90e3398dbf483cd8 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:05a7fe4adb7941013abe40352cb7c80970d49ca2f7cfc1cc90e3398dbf483cd8]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 21m 58s 157 actionable tasks: 25 executed, 132 up-to-date Publishing build scan... https://gradle.com/s/2l4ckeyrdvr7e Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
