See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/2770/display/redirect?page=changes>
Changes: [randomstep] [BEAM-12899] Upgrade Gradle to version 6.9.x [zyichi] [BEAM-12603] Add retries to FnApiRunnerTest due to flakiness of grpc [noreply] [BEAM-12535] add dataframes notebook (#15470) ------------------------------------------ [...truncated 429.56 KB...] [0m Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.34.0.dev0-cp36-cp36m-linux_x86_64.whl size=9822074 sha256=4c0f916d6e90dc48e4e44eaa1ff62d5b8f565110e92711ee47ebc90088a158e3 Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8 Successfully built apache-beam Installing collected packages: apache-beam Successfully installed apache-beam-2.34.0.dev0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0mRemoving intermediate container e206b9c6a7b6 ---> 7e640c485e1c Step 15/27 : COPY target/license_scripts /tmp/license_scripts/ ---> f3738b995cc0 Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 455331a06d36 Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in d25fe16c2b15 Removing intermediate container d25fe16c2b15 ---> 97c7da1f6367 Step 18/27 : COPY target/license_scripts /tmp/license_scripts/ ---> 9b8f9f52ffb4 Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in a964b24f5da3 Collecting pip-licenses<3.0.0 Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB) Collecting PTable Downloading PTable-0.9.2.tar.gz (31 kB) Building wheels for collected packages: PTable Building wheel for PTable (setup.py): started Building wheel for PTable (setup.py): finished with status 'done' Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=fbf2f79d3f520f94886c2c0f3b076cd1c0e354f54f64ec30af6fc360a1a6bf1b Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e Successfully built PTable Installing collected packages: PTable, pip-licenses Successfully installed PTable-0.9.2 pip-licenses-2.3.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment > Task :sdks:java:io:kafka:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:kafka:classes > Task :sdks:java:io:kafka:jar > Task :sdks:python:container:py36:docker [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker Removing intermediate container 8576ba489c26 ---> 5a76e1920597 Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> 5502917544be Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in b0ff988b0ea0 Removing intermediate container b0ff988b0ea0 ---> 6dbea97e8229 Successfully built 6dbea97e8229 Successfully tagged apache/beam_java8_sdk:2.34.0.dev > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 39423 Launching Python expansion service @ 41773 > Task :runners:direct-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:direct-java:classes > Task :runners:direct-java:shadowJar FROM-CACHE > Task :runners:spark:2:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:2:classes > Task :runners:spark:2:jar > Task :runners:spark:2:job-server:compileJava NO-SOURCE > Task :runners:spark:2:job-server:classes UP-TO-DATE > Task :runners:spark:2:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:2:testClasses > Task :runners:spark:2:testJar > Task :runners:spark:2:job-server:shadowJar > Task :sdks:java:io:google-cloud-platform:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:google-cloud-platform:classes > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:spark:2:job-server:sparkJobServerSetup Launching job server @ 40759 ... > Task :sdks:java:extensions:sql:compileJava > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava > Task :sdks:java:extensions:sql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:extensions:sql:classes > Task :sdks:java:extensions:sql:jar > Task :sdks:java:extensions:sql:zetasql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:extensions:sql:zetasql:classes > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:expansion-service:compileJava Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/src/main/java/org/apache/beam/sdk/extensions/sql/expansion/ExternalSqlTransformRegistrar.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :sdks:java:extensions:sql:expansion-service:classes > Task :sdks:java:extensions:sql:expansion-service:shadowJar > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combinePerKeyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:126 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:126 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > singleInputOutputTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:126 8 tests completed, 3 failed > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava > FAILED > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython > Task > :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:40759 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.8, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5001 items / 4993 deselected / 8 selected apache_beam/io/external/generate_sequence_test.py . [ 12%] apache_beam/transforms/validate_runner_xlang_test.py ....... [100%] =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =========== 8 passed, 4993 deselected, 2 warnings in 191.53 seconds ============ > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:40759 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.8, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5001 items / 4993 deselected / 8 selected apache_beam/io/external/generate_sequence_test.py . [ 12%] apache_beam/transforms/validate_runner_xlang_test.py ....... [100%] - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - ================= 8 passed, 4993 deselected in 122.74 seconds ================== > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:40759 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_sql_expansion_service ============================= test session starts ============================== platform linux -- Python 3.6.8, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5001 items / 4992 deselected / 9 selected apache_beam/transforms/sql_test.py ......... [100%] - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> - ================= 9 passed, 4992 deselected in 294.57 seconds ================== > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 29156. Stopping expansion service pid: 29159. > Task :runners:spark:2:job-server:sparkJobServerCleanup Stopping job server pid: 4273. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 24m 47s 180 actionable tasks: 151 executed, 25 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/ewe4qplw73cvg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
