See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/881/display/redirect?page=changes>
Changes: [noreply] [Playground] [Backend] Datastore queries and mappers to get precompiled [noreply] Open Allow and test pyarrow 8.x and 9.x (#22997) [noreply] (BQ Python) Pass project field from options or parameter when writing [noreply] Update python-machine-learning.md (#23209) [noreply] Pin the version of cloudpickle to 2.1.x (#23120) ------------------------------------------ [...truncated 496.62 KB...] typing-utils==0.1.0 typing_extensions==4.3.0 uritemplate==4.1.1 urllib3==1.26.11 websocket-client==1.3.3 Werkzeug==2.2.1 wheel==0.37.1 wrapt==1.14.1 zipp==3.8.1 zstandard==0.18.0 Removing intermediate container c5b980e275ce ---> d4c6bb26bda8 Step 17/32 : COPY target/LICENSE /opt/apache/beam/ ---> 031ca247bc85 Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/ ---> da89da7f17e5 Step 19/32 : COPY target/NOTICE /opt/apache/beam/ ---> 4f2f3edaf97e Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/ ---> bcc3f7e7efb3 Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in dec78a5ed88a Removing intermediate container dec78a5ed88a ---> d6dc2f5c4514 Step 22/32 : FROM beam as third_party_licenses ---> d6dc2f5c4514 Step 23/32 : ARG pull_licenses ---> Running in d3e8e213edef Removing intermediate container d3e8e213edef ---> 3e87e026b7d6 Step 24/32 : COPY target/license_scripts /tmp/license_scripts/ ---> 2a90383a2fa8 Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 96101ca74fb7 Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in f071b2e32c50 Removing intermediate container f071b2e32c50 ---> e0db331779dd Step 27/32 : COPY target/license_scripts /tmp/license_scripts/ ---> c1e35b314970 Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi ---> Running in 69db702755c3 Collecting pip-licenses<4.0.0 Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=b00e547b741cce7215d4aa4669020c98ada9a7195cc7a8c07fb74e355a3d9730 Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-3.5.4 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mINFO:root:Successfully pulled licenses for 136 dependencies [0mSkip pulling license for bs4 Removing intermediate container 69db702755c3 ---> 0e70a8fc6a09 Step 29/32 : FROM beam ---> d6dc2f5c4514 Step 30/32 : ARG pull_licenses ---> Running in d3c1d623b093 Removing intermediate container d3c1d623b093 ---> 5dd67283e8a8 Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> 2187fe1fb8f1 Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 81e85fe2da13 Removing intermediate container 81e85fe2da13 ---> ad329ee15918 Successfully built ad329ee15918 Successfully tagged apache/beam_python3.9_sdk:2.43.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 61e4682cef60: Preparing 5a3826df5498: Preparing b4ae0be41519: Preparing f0bb8beb548f: Preparing 98114cf5919d: Preparing add2229ef7eb: Preparing 6d3756bf5f23: Preparing 92931f3b5d74: Preparing 233589143fc7: Preparing 580ffa44949c: Preparing 8e001791bd74: Preparing d9d40ac09d37: Preparing 2c27be3f3240: Preparing d5e7cf8db7fc: Preparing 2e5213d4db08: Preparing 673227354fd7: Preparing a03c29b1fd92: Preparing 100796cdf3b1: Preparing 54acb5a6fa0b: Preparing 8d51c618126f: Preparing 9ff6e4d46744: Preparing a89d1d47b5a1: Preparing d5e7cf8db7fc: Waiting 8e001791bd74: Waiting 92931f3b5d74: Waiting 655ed1b7a428: Preparing add2229ef7eb: Waiting 6d3756bf5f23: Waiting d9d40ac09d37: Waiting 2e5213d4db08: Waiting 580ffa44949c: Waiting a89d1d47b5a1: Waiting 655ed1b7a428: Waiting 2c27be3f3240: Waiting 233589143fc7: Waiting a03c29b1fd92: Waiting 673227354fd7: Waiting 100796cdf3b1: Waiting 54acb5a6fa0b: Waiting 8d51c618126f: Waiting 9ff6e4d46744: Waiting b4ae0be41519: Pushed 98114cf5919d: Pushed f0bb8beb548f: Pushed 61e4682cef60: Pushed 5a3826df5498: Pushed 92931f3b5d74: Pushed 6d3756bf5f23: Pushed 233589143fc7: Pushed 2c27be3f3240: Pushed d5e7cf8db7fc: Pushed 2e5213d4db08: Layer already exists 673227354fd7: Layer already exists a03c29b1fd92: Layer already exists 100796cdf3b1: Layer already exists 8e001791bd74: Pushed 54acb5a6fa0b: Layer already exists 8d51c618126f: Layer already exists a89d1d47b5a1: Layer already exists 9ff6e4d46744: Layer already exists 655ed1b7a428: Layer already exists add2229ef7eb: Pushed 580ffa44949c: Pushed d9d40ac09d37: Pushed 20220913181734: digest: sha256:a995b421525f835e4fcfc168a46bf1cb836b804c4c5fd71fe1165d9ccf0b30e6 size: 5156 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 43171 Launching Python expansion service @ 39751 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220913181734 >>> --experiments=shuffle_mode=appliance >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz> >>> pytest options: --capture=no --numprocesses=8 --timeout=4500 >>> --log-cli-level=INFO >>> collect markers: -m=xlang_sql_expansion_service ============================= test session starts ============================== platform linux -- Python 3.9.10, pytest-7.1.3, pluggy-1.0.0 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python,> configfile: pytest.ini plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [gw0] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw2] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw3] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw1] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw4] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw7] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw5] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] [gw6] Python 3.9.10 (main, Jan 15 2022, 18:17:56) -- [GCC 9.3.0] gw0 [9] / gw1 [9] / gw2 [9] / gw3 [9] / gw4 [9] / gw5 [9] / gw6 [9] / gw7 [9] scheduling tests via LoadScheduling apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data apache_beam/transforms/sql_test.py::SqlTransformTest::test_map apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter apache_beam/transforms/sql_test.py::SqlTransformTest::test_project apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg apache_beam/transforms/sql_test.py::SqlTransformTest::test_row apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql [gw4] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project [gw7] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row [gw5] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join [gw0] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data [gw1] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map [gw6] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql [gw2] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter [gw3] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data [gw0] node down: Not properly terminated [gw0] FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data Terminated The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=4ed6fced-ef16-4b2c-81b9-e12e808d64bb, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 3404983 log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-3404983.out.log ----- Last 20 lines from daemon log file - daemon-3404983.out.log ----- [gw2] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter [gw3] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data [gw0] node down: Not properly terminated [gw0] FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data Terminated Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
