See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1689/display/redirect>
Changes: ------------------------------------------ [...truncated 447.95 KB...] ---> Running in db160fab7af2 Collecting pip-licenses<3.0.0 Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB) Requirement already satisfied: pyyaml in /usr/local/lib/python3.6/site-packages (6.0) Requirement already satisfied: tenacity in /usr/local/lib/python3.6/site-packages (5.1.5) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.6/site-packages (from tenacity) (1.15.0) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=a495c9a3a4fcff29b4bf7dcd9ff2e4d18f69cbe4c9af14dc8316a99ffb49f2ee Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-2.3.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0mSkip pulling license for bs4 [91mINFO:root:Successfully pulled licenses for 134 dependencies [0mRemoving intermediate container db160fab7af2 ---> 2ecc7db496cd Step 28/31 : FROM beam ---> bd6109a35800 Step 29/31 : ARG pull_licenses ---> Running in ebe7c917045b Removing intermediate container ebe7c917045b ---> f292cbe0ae27 Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses ---> bd18b1b9fd7a Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in d23f1e4e3748 Removing intermediate container d23f1e4e3748 ---> c25804e85c41 Successfully built c25804e85c41 Successfully tagged apache/beam_python3.6_sdk:2.37.0.dev > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 40093 Launching Python expansion service @ 34733 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220116120143 >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz> >>> pytest options: --capture=no --numprocesses=8 --timeout=4500 >>> --log-cli-level=INFO >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.13, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [gw1] Python 3.6.13 (default, Feb 20 2021, 21:42:50) -- [GCC 5.4.0 20160609] [gw0] Python 3.6.13 (default, Feb 20 2021, 21:42:50) -- [GCC 5.4.0 20160609] [gw2] Python 3.6.13 (default, Feb 20 2021, 21:42:50) -- [GCC 5.4.0 20160609] [gw3] Python 3.6.13 (default, Feb 20 2021, 21:42:50) -- [GCC 5.4.0 20160609] [gw4] Python 3.6.13 (default, Feb 20 2021, 21:42:50) -- [GCC 5.4.0 20160609] [gw5] Python 3.6.13 (default, Feb 20 2021, 21:42:50) -- [GCC 5.4.0 20160609] [gw6] Python 3.6.13 (default, Feb 20 2021, 21:42:50) -- [GCC 5.4.0 20160609] [gw7] Python 3.6.13 (default, Feb 20 2021, 21:42:50) -- [GCC 5.4.0 20160609] gw0 [10] / gw1 [10] / gw2 [10] / gw3 [10] / gw4 [10] / gw5 [10] / gw6 [10] / gw7 [10] scheduling tests via LoadScheduling apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder [gw4] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally [gw0] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix [gw6] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key [gw1] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition [gw5] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key [gw3] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key [gw2] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform [gw7] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput [gw0] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix [gw1] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 apache_beam/io/filesystems_test.py:54 apache_beam/io/filesystems_test.py:54 apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 apache_beam/io/filesystems_test.py:62 apache_beam/io/filesystems_test.py:62 apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =================== 10 passed, 8 warnings in 1391.40 seconds =================== > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 17279. Stopping expansion service pid: 17280. > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220116120143 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:062087494d800c9668d5f34e2556a26c28d3a8dfc4e09c101e8863bb23f6afe6 Deleted: sha256:2f077797d7fd96c56129a2649bf224b80c83195eebc7a2e650501895e66db8aa Deleted: sha256:05f20a06f87151786518ca4ddaddf177d739de1d788a87a5716754406e80485c Deleted: sha256:4f2921b8fad7c13e822544c7e748b10d8e39ab841b00351ee0fb47f7d9b6181d Deleted: sha256:e25d5e4f324b9d3cbdc874261fe2af49da401b5a4c719046279d991235187418 Deleted: sha256:19220e001856e923593c10a78fd8edef59d88d33faa3817f28472604255625b3 Deleted: sha256:bac4aa8e306635f926818b581cc953510b1d58a7fdbb6e9a03c75fc15700bff0 Deleted: sha256:b718fe46f0b866ad446eb44b539ac8850bc9f8264f280ee805b2b0f96c2bdb7c Deleted: sha256:de4fe2ca55e04eaaee21cb93b6306e8b9223576dbbf0b26709b03a4b661bcd49 Deleted: sha256:dadaa07720e887dd7abb838588a7ce848d80b22e819e40385b519b205077727a Deleted: sha256:960639bfca74fd3b61bef326825eb9308dceaf63a2f3a9f1738a4156fd6057a0 Deleted: sha256:cf98ba3d1a7b8ee9097cf67ed9f5a4f8a9585f01f1c7f1b73dfa2b4c08ca0df6 Deleted: sha256:9c75bb3a968c1347a54659caa53960b7d98e00441d73755d050fa1899181d476 Deleted: sha256:b1f6730826df8cce0b51e653b9876728eb5191d9a96640b31acde795197da02f Deleted: sha256:3fa8b6b52ddd28e57ec2b4eb1c3127deb873db864308de5a370cf5e5f7bf40fb Deleted: sha256:8ccc379efdbf7cadca867f16539c569b3e8f0cdcce918231002965f3c0044111 Deleted: sha256:4f537de40e13f1084dc20ebf5e268b8e8148c9a0421117b9bc86554a82874c1c Deleted: sha256:7721fd8d242e114cbde565995f54888ec2bdee3f1b3445b4dbc58bcd1da2616c Deleted: sha256:ccdd0f829cb7c4862403caf9df1e21819ef061a5fba44d0eada4742bd81f7303 Deleted: sha256:821c8c7f48f981dd19922f5b56abac10d66ba9f30970e248a160727c9691b755 Deleted: sha256:2600055c288c09f89d20bcd15749adc9a033b3e9b28a81177f3922a792477d04 Deleted: sha256:b689fa5986585689385e5f7a07ae240b38dc5d18ac2ce9d4f9b1313f5f87f067 Deleted: sha256:5e2c5ba5e01a164a4a712942c28ae7c5466786eb3dae62ac857c2d6a750d9f05 Deleted: sha256:32e0698b087f2d27ef1f816a02f19afab70ace6a238764d2fa6155a5a3c8b830 Deleted: sha256:78b41f113db459f410e2c76f7a17ba629368390d457ab772f66c16d369272050 Deleted: sha256:6404bca2d2c04c6fd9db9f16deba0f371707354de73f7d3b09a5a3fbac43d0d7 Deleted: sha256:8aafa1baef8ea27ad495786a53c651d525d3cc802365edda085ae3798b0185cc Deleted: sha256:f1ca4ac5a9d2360531ae8caf99c4153ad025c5837fa48840a8a4b2bee4ad1181 Deleted: sha256:94b25a3d396aa58ba7bb90e534121bb33e93afdb617a1df2c1899551a22ef9bf Deleted: sha256:524357fe5feaad394b0cdb0db98a41be8bf24be3a6891b26a676d187e10752de Deleted: sha256:1e02d34f7affb70f0d7ca8e19e78408dfd0d69c590b2b244dcb907a41e06f2ba Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220116120143] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:062087494d800c9668d5f34e2556a26c28d3a8dfc4e09c101e8863bb23f6afe6] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220116120143] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:062087494d800c9668d5f34e2556a26c28d3a8dfc4e09c101e8863bb23f6afe6])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:062087494d800c9668d5f34e2556a26c28d3a8dfc4e09c101e8863bb23f6afe6 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:062087494d800c9668d5f34e2556a26c28d3a8dfc4e09c101e8863bb23f6afe6 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:062087494d800c9668d5f34e2556a26c28d3a8dfc4e09c101e8863bb23f6afe6]. Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD SUCCESSFUL in 33m 52s 137 actionable tasks: 93 executed, 38 from cache, 6 up-to-date Publishing build scan... https://scans.gradle.com/s/xlsq4fdxvlauq Build step 'Invoke Gradle script' changed build result to SUCCESS [beam_PostCommit_XVR_Dataflow] $ /bin/bash -xe /tmp/jenkins5724400718057782786.sh + echo '*** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA EXTERNAL TRANSFORMS USING PYTHON 3.8 ***' *** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA EXTERNAL TRANSFORMS USING PYTHON 3.8 *** [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE > Configure project :sdks:go:test System Go installation: /usr/bin/go is go version go1.16.13 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 > Configure project :sdks:python:container System Go installation: /usr/bin/go is go version go1.16.13 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 > Configure project :sdks:go System Go installation: /usr/bin/go is go version go1.16.13 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 > Configure project :sdks:java:container System Go installation: /usr/bin/go is go version go1.16.13 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 FAILURE: Build failed with an exception. * What went wrong: Could not determine the dependencies of task ':sdks:java:testing:expansion-service:buildTestExpansionServiceJar'. > Could not resolve all dependencies for configuration > ':sdks:java:testing:expansion-service:testRuntimeClasspath'. > Could not resolve net.minidev:json-smart:[1.3.1,2.3]. Required by: project :sdks:java:testing:expansion-service > org.apache.hadoop:hadoop-client:2.10.1 > org.apache.hadoop:hadoop-common:2.10.1 > org.apache.hadoop:hadoop-auth:2.10.1 > com.nimbusds:nimbus-jose-jwt:7.9 > Failed to list versions for net.minidev:json-smart. > Unable to load Maven meta-data from https://jcenter.bintray.com/net/minidev/json-smart/maven-metadata.xml. > Could not HEAD 'https://jcenter.bintray.com/net/minidev/json-smart/maven-metadata.xml'. Received status code 502 from server: Bad Gateway * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 8s 10 actionable tasks: 10 up-to-date Publishing build scan... https://scans.gradle.com/s/5wava645e4mrm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
