See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/529/display/redirect?page=changes>
Changes: [dannymccormick] Update dashboards to use gh data instead of jira data [noreply] Update .test-infra/metrics/grafana/dashboards/source_data_freshness.json [noreply] Better cross langauge support for dataframe reads. (#21762) [noreply] Add template_location flag to Go Dataflow runner (#21774) [noreply] [BEAM-14406] Drain test for SDF truncation in Go SDK (#17814) [noreply] More Jira -> Issues doc updates (#21770) ------------------------------------------ [...truncated 487.89 KB...] tensorboard==2.8.0 tensorboard-data-server==0.6.1 tensorboard-plugin-wit==1.8.1 tensorflow==2.8.0 tensorflow-io-gcs-filesystem==0.25.0 termcolor==1.1.0 testcontainers==3.5.3 tf-estimator-nightly==2.8.0.dev2021122109 threadpoolctl==3.1.0 tqdm==4.64.0 typing-utils==0.1.0 typing_extensions==4.2.0 uritemplate==4.1.1 urllib3==1.26.9 wcwidth==0.2.5 websocket-client==1.3.2 Werkzeug==2.1.2 wheel==0.37.1 wrapt==1.14.1 zipp==3.8.0 Removing intermediate container 77c7edc5e227 ---> fdbd4f8eaba4 Step 16/31 : COPY target/LICENSE /opt/apache/beam/ ---> a0fdea47549a Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/ ---> fb2ff866c92e Step 18/31 : COPY target/NOTICE /opt/apache/beam/ ---> 3b6ec21ff1ed Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 3f0a0f32003c Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 35d2c3501cde Removing intermediate container 35d2c3501cde ---> 78f9d1b5b298 Step 21/31 : FROM beam as third_party_licenses ---> 78f9d1b5b298 Step 22/31 : ARG pull_licenses ---> Running in 0fdba7110d85 Removing intermediate container 0fdba7110d85 ---> 789073d53219 Step 23/31 : COPY target/license_scripts /tmp/license_scripts/ ---> e315eff4da2c Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 3e89fe22e910 Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 4eee023511d7 Removing intermediate container 4eee023511d7 ---> 81a33bea2fc3 Step 26/31 : COPY target/license_scripts /tmp/license_scripts/ ---> c6081195b982 Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in 057079fc202a Collecting pip-licenses<4.0.0 Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=70e60085b578f100decf0df4979b5d505329ac2e652f99b472c6dd8404561aea Stored in directory: /root/.cache/pip/wheels/33/df/2f/674985b3f8a2de3f96357d1eadef5110f74fa91b3785e52a54 Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-3.5.4 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mWARNING: You are using pip version 22.0.4; however, version 22.1.2 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0mSkip pulling license for bs4 [91mINFO:root:Successfully pulled licenses for 135 dependencies [0mRemoving intermediate container 057079fc202a ---> b32959d4db1c Step 28/31 : FROM beam ---> 78f9d1b5b298 Step 29/31 : ARG pull_licenses ---> Running in cc4f8b0ebf24 Removing intermediate container cc4f8b0ebf24 ---> df0d3b242863 Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> f06c8256be7f Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in be4188653d41 Removing intermediate container be4188653d41 ---> 739e888ab301 Successfully built 739e888ab301 Successfully tagged apache/beam_python3.7_sdk:2.40.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] dcbd0b7e0404: Preparing 1be34e34d039: Preparing 1f106cab1deb: Preparing 5bf36b05d077: Preparing b1be72daf4a2: Preparing 7ad611dcec90: Preparing cbae27fc9d62: Preparing 71f90321895e: Preparing 035d08a3beb8: Preparing e745939c124c: Preparing 75769f2b39fe: Preparing ff3533b4c958: Preparing 1237d35edf59: Preparing 9ff0311d8694: Preparing ec0b95516616: Preparing de535afa770b: Preparing 9846ae2df640: Preparing 7ad611dcec90: Waiting fe48e1733f4f: Preparing 13b045a1dfd2: Preparing 2fbabeba902e: Preparing ee509ed6e976: Preparing 9177197c67d0: Preparing 7dbadf2b9bd8: Preparing 71f90321895e: Waiting e7597c345c2e: Preparing 035d08a3beb8: Waiting 1237d35edf59: Waiting ec0b95516616: Waiting 75769f2b39fe: Waiting 9ff0311d8694: Waiting e745939c124c: Waiting de535afa770b: Waiting ff3533b4c958: Waiting 7dbadf2b9bd8: Waiting 2fbabeba902e: Waiting 9177197c67d0: Waiting e7597c345c2e: Waiting ee509ed6e976: Waiting fe48e1733f4f: Waiting 5bf36b05d077: Pushed b1be72daf4a2: Pushed dcbd0b7e0404: Pushed 1f106cab1deb: Pushed 1be34e34d039: Pushed cbae27fc9d62: Pushed 7ad611dcec90: Pushed 035d08a3beb8: Pushed e745939c124c: Pushed 75769f2b39fe: Pushed 9ff0311d8694: Pushed de535afa770b: Layer already exists 9846ae2df640: Layer already exists fe48e1733f4f: Layer already exists 13b045a1dfd2: Layer already exists 2fbabeba902e: Layer already exists ee509ed6e976: Layer already exists ec0b95516616: Pushed 9177197c67d0: Layer already exists 7dbadf2b9bd8: Layer already exists e7597c345c2e: Layer already exists 71f90321895e: Pushed ff3533b4c958: Pushed 1237d35edf59: Pushed 20220609225230: digest: sha256:3f21367c3d8ccd3c7c28be86da8519b478e5b6c9a0981b1018890701cb718983 size: 5361 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 34321 Launching Python expansion service @ 45763 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220609225230 >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/python/build/apache-beam.tar.gz >>> pytest options: --capture=no --numprocesses=8 --timeout=4500 >>> --log-cli-level=INFO >>> collect markers: -m=uses_java_expansion_service ============================= test session starts ============================== platform linux -- Python 3.7.12, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_PythonUsingJava_Dataflow/src/sdks/python, inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] gw0 [10] / gw1 [10] / gw2 [10] / gw3 [10] / gw4 [10] / gw5 [10] / gw6 [10] / gw7 [10] scheduling tests via LoadScheduling apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder [gw6] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key [gw2] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform [gw0] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition [gw7] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput [gw5] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key [gw3] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key [gw4] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally [gw1] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix FATAL: command execution failed java.io.IOException: Backing channel 'apache-beam-jenkins-10' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286) at com.sun.proxy.$Proxy124.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205) at hudson.Launcher$ProcStarter.join(Launcher.java:522) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:806) at hudson.model.Build$BuildExecution.build(Build.java:198) at hudson.model.Build$BuildExecution.doRun(Build.java:163) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:514) at hudson.model.Run.execute(Run.java:1888) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:99) at hudson.model.Executor.run(Executor.java:432) Caused by: hudson.remoting.Channel$OrderlyShutdown: Command Close created at at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1320) at hudson.remoting.Channel$1.handle(Channel.java:607) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81) Caused by: Command Close created at at hudson.remoting.Command.<init>(Command.java:70) at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1313) at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1311) at hudson.remoting.Channel.close(Channel.java:1487) at hudson.remoting.Channel.close(Channel.java:1454) at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1319) ... 2 more Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-10 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
