See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/1284/display/redirect?page=changes>
Changes: [srohde] Gracefully shutdown the channel reader in the test_stream_impl [ningk] [BEAM-10545] Added the inspector of PCollections and pipelines [ningk] Simplified some of the code based on comments [ningk] Fixed lint issues. [srohde] Add CANCELLED to non error codes for test stream events from grpc [Boyuan Zhang] Refactor split logic to reuse common logic. ------------------------------------------ [...truncated 59.32 KB...] root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> > Task :sdks:java:core:shadowTestJar > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net] Resolving golang.org/x/oauth2: commit='a032972e28060ca4f5644acffae3dfc268cc09db', urls=[https://go.googlesource.com/oauth2] Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync] > Task :runners:core-java:compileTestJava FROM-CACHE > Task :runners:core-java:testClasses UP-TO-DATE > Task :sdks:python:sdist RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> > Task :runners:core-construction-java:compileTestJava FROM-CACHE > Task :runners:core-construction-java:testClasses UP-TO-DATE > Task :runners:core-java:testJar > Task :runners:core-construction-java:testJar > Task :sdks:python:sdist RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> RefactoringTool: Files that were modified: RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py> warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py2:copyDockerfileDependencies > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/sys: commit='37707fdb30a5b38865cfb95e5aab41707daec7fd', urls=[https://go.googlesource.com/sys] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:java:harness:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:harness:classes > Task :sdks:python:installGcpTest DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support > Task :sdks:java:harness:jar > Task :sdks:java:harness:shadowJar > Task :runners:java-fn-execution:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:container:pullLicenses INFO:root:Pulling license for 175 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.773689 seconds with 16 threads. > Task :runners:java-fn-execution:classes > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:testing:expansion-service:compileJava NO-SOURCE > Task :sdks:java:testing:expansion-service:classes UP-TO-DATE > Task :runners:java-job-service:compileJava FROM-CACHE > Task :runners:java-job-service:classes UP-TO-DATE > Task :sdks:java:testing:expansion-service:compileTestJava FROM-CACHE > Task :sdks:java:testing:expansion-service:testClasses UP-TO-DATE > Task :runners:java-job-service:jar > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :runners:spark:compileJava FROM-CACHE > Task :runners:spark:classes > Task :runners:spark:jar > Task :runners:spark:job-server:compileJava NO-SOURCE > Task :runners:spark:job-server:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:direct-java:shadowJar > Task :sdks:java:container:copyDockerfileDependencies > Task :sdks:java:extensions:sql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:classes > Task :sdks:java:extensions:sql:jar > Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:expansion-service:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:expansion-service:classes UP-TO-DATE > Task :runners:portability:java:compileJava > Task :runners:portability:java:classes > Task :runners:portability:java:jar > Task :runners:portability:java:compileTestJava Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/portability/java/src/test/java/org/apache/beam/runners/portability/CloseableResourceTest.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :runners:portability:java:testClasses > Task :runners:portability:java:testJar > Task :release:go-licenses:java:docker Removing intermediate container e1d1c4c870ae ---> 20efb92e8491 Successfully built 20efb92e8491 Successfully tagged golicenses-java:latest > Task :release:go-licenses:py:dockerRun FAILED docker: Error response from daemon: Conflict. The container name "/license-container-python" is already in use by container "25cf8c1c9dac393c160a6d47551da85b8c259a51d669cf0e199af66716f4f063". You have to remove (or rename) that container to be able to reuse that name. See 'docker run --help'. > Task :runners:spark:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:testClasses > Task :runners:spark:testJar > Task :release:go-licenses:java:dockerRun + rm -rf '/output/*' + go get github.com/apache/beam/sdks/java/container > Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar > Task :runners:spark:job-server:shadowJar > Task :sdks:java:extensions:sql:expansion-service:shadowJar > Task :runners:spark:job-server:sparkJobServerSetup > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:copyGolangLicenses > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go> > Task :sdks:python:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go> > Task :sdks:python:container:installDependencies > Task :sdks:java:container:installDependencies > Task :sdks:python:container:buildDarwinAmd64 > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:dockerPrepare > Task :sdks:python:container:buildLinuxAmd64 > Task :sdks:python:container:goBuild > Task :sdks:python:container:py2:copyLauncherDependencies > Task :sdks:java:container:docker > Task :runners:spark:job-server:sparkJobServerCleanup FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':release:go-licenses:py:dockerRun'. > Process 'command 'docker'' finished with non-zero exit value 125 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6m 5s 142 actionable tasks: 109 executed, 29 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/jyfgdwufuuowk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
