See <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/140/display/redirect?page=changes>
Changes: [kcweaver] [BEAM-8139] Test Spark portable job jar. [kcweaver] [BEAM-8139] Add main method to SparkPipelineRunner. [kcweaver] [BEAM-8139] Add beam_PostCommit_PortableJar_Spark. [suztomo] BEAM-8693 com.google.cloud.datastore:datastore-v1-proto-client 1.6.3 [suztomo] google_cloud_bigquery is not declaring google_http_client_jackson [chadrik] Pass artifact and provision endpoints to external workers from python [apilloud] [BEAM-8362] Don't use toString() for accessing Enum Types [echauchot] [BEAM-8894] exclude FlattenWithHeterogeneousCoders category because [echauchot] [BEAM-8025] Under load we get a NoHostAvailable exception at cluster [ehudm] [BEAM-3713] pytest migration: py27-cython-pytest [aaltay] [BEAM-8811] Upgrade Beam pipeline diagrams in docs (#10200) [bhulette] [BEAM-8933] Update BigQuery proto dependency (#10334) [pabloem] [BEAM-7746] Add python type hints (part 1) (#9915) [heejong] [BEAM-8943] SDK harness servers don't shut down properly when SDK [github] [BEAM-8955] Exclude AvroSchemaTest for Spark Runner (#10358) [relax] attach values so we don't iterate over everything to verify types [echauchot] [BEAM-8025] Remove temporary folder rule because it suppresses files on [echauchot] [BEAM-8025] Disable auto compaction on Cassandra node to avoid race ------------------------------------------ [...truncated 38.16 KB...] RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py2:copyDockerfileDependencies > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, [email protected]:coreos/etcd.git] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, [email protected]:coreos/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:python:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/sdks/go> > Task :sdks:python:container:installDependencies > Task :sdks:python:container:buildDarwinAmd64 > Task :sdks:python:container:buildLinuxAmd64 > Task :sdks:python:container:goBuild > Task :sdks:python:container:py2:copyLauncherDependencies > Task :sdks:python:container:py2:dockerPrepare > Task :sdks:python:container:py2:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 6m 31s 18 actionable tasks: 17 executed, 1 up-to-date Publishing build scan... https://scans.gradle.com/s/d6k43yo5wnvnk Build step 'Invoke Gradle script' changed build result to SUCCESS [beam_LoadTests_Python_coGBK_Flink_Batch] $ /bin/bash -xe /tmp/jenkins3612796172298495341.sh + echo 'Tagging image...' Tagging image... [beam_LoadTests_Python_coGBK_Flink_Batch] $ /bin/bash -xe /tmp/jenkins2089895090553814639.sh + docker tag gcr.io/apache-beam-testing/beam_portability/python2.7_sdk gcr.io/apache-beam-testing/beam_portability/python2.7_sdk:latest [beam_LoadTests_Python_coGBK_Flink_Batch] $ /bin/bash -xe /tmp/jenkins329930964110214245.sh + echo 'Pushing image...' Pushing image... [beam_LoadTests_Python_coGBK_Flink_Batch] $ /bin/bash -xe /tmp/jenkins133524380154749947.sh + docker push gcr.io/apache-beam-testing/beam_portability/python2.7_sdk:latest The push refers to repository [gcr.io/apache-beam-testing/beam_portability/python2.7_sdk] afd6e862e748: Preparing 321c6fc37608: Preparing 382347650233: Preparing 565cb377b2b3: Preparing e8ddb8a44d33: Preparing 47ab7a8dc5f1: Preparing ea6116a1f0a8: Preparing f2815c342f9e: Preparing 9a9ee1e1b077: Preparing c28383f3aac4: Preparing 22b7de8c8281: Preparing 6f029f7fa589: Preparing cbdd44c5cbac: Preparing 2e517d68c391: Preparing 5f3a5adb8e97: Preparing 73bfa217d66f: Preparing 91ecdd7165d3: Preparing e4b20fcc48f4: Preparing cbdd44c5cbac: Waiting ea6116a1f0a8: Waiting f2815c342f9e: Waiting 91ecdd7165d3: Waiting 9a9ee1e1b077: Waiting 5f3a5adb8e97: Waiting c28383f3aac4: Waiting e4b20fcc48f4: Waiting 73bfa217d66f: Waiting 47ab7a8dc5f1: Waiting 22b7de8c8281: Waiting 2e517d68c391: Waiting 6f029f7fa589: Waiting 565cb377b2b3: Pushed 321c6fc37608: Pushed e8ddb8a44d33: Pushed afd6e862e748: Pushed f2815c342f9e: Pushed 47ab7a8dc5f1: Pushed c28383f3aac4: Layer already exists 22b7de8c8281: Layer already exists 6f029f7fa589: Layer already exists cbdd44c5cbac: Layer already exists 2e517d68c391: Layer already exists 5f3a5adb8e97: Layer already exists 73bfa217d66f: Layer already exists 91ecdd7165d3: Layer already exists e4b20fcc48f4: Layer already exists 9a9ee1e1b077: Pushed 382347650233: Pushed ea6116a1f0a8: Pushed latest: digest: sha256:53b5a65e6a11d087cd57eaff3ca1dfd6d7ff149cd14df4bd25d24bad04582683 size: 4110 [Gradle] - Launching build. [src] $ <https://builds.apache.org/job/beam_LoadTests_Python_coGBK_Flink_Batch/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-repository-root=gcr.io/apache-beam-testing/beam_portability -Pdocker-tag=latest :runners:flink:1.9:job-server-container:docker > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validateTaskProperties UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:java:core:generateAvroProtocol NO-SOURCE > Task :runners:core-construction-java:processResources NO-SOURCE > Task :sdks:java:fn-execution:processResources NO-SOURCE > Task :runners:core-java:processResources NO-SOURCE > Task :sdks:java:core:generateAvroJava NO-SOURCE > Task :vendor:sdks-java-extensions-protobuf:processResources NO-SOURCE > Task :sdks:java:extensions:google-cloud-platform-core:processResources > NO-SOURCE > Task :sdks:java:harness:processResources NO-SOURCE > Task :runners:flink:1.9:copyResourcesOverrides NO-SOURCE > Task :runners:java-fn-execution:processResources NO-SOURCE > Task :runners:flink:1.9:job-server:processResources NO-SOURCE > Task :sdks:java:io:kafka:processResources NO-SOURCE > Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE > Task :runners:flink:1.9:job-server-container:dockerClean UP-TO-DATE > Task :model:job-management:extractProto > Task :model:fn-execution:extractProto > Task :sdks:java:extensions:protobuf:extractProto > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE > Task :model:job-management:processResources > Task :model:fn-execution:processResources > Task :runners:flink:1.9:copySourceOverrides > Task :runners:flink:1.9:copyTestResourcesOverrides NO-SOURCE > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :runners:flink:1.9:processResources > Task :sdks:java:build-tools:compileJava FROM-CACHE > Task :sdks:java:build-tools:processResources > Task :sdks:java:build-tools:classes > Task :sdks:java:core:processResources > Task :sdks:java:build-tools:jar > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :model:pipeline:generateProto > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :model:pipeline:jar > Task :model:job-management:extractIncludeProto > Task :model:fn-execution:extractIncludeProto > Task :model:job-management:generateProto > Task :model:fn-execution:generateProto > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:pipeline:shadowJar > Task :model:job-management:shadowJar > Task :model:fn-execution:shadowJar > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar > Task :sdks:java:extensions:protobuf:extractIncludeProto > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :vendor:sdks-java-extensions-protobuf:compileJava FROM-CACHE > Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :vendor:sdks-java-extensions-protobuf:shadowJar > Task :sdks:java:io:kafka:jar > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :runners:core-construction-java:jar > Task :sdks:java:fn-execution:jar > Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:harness:shadowJar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :runners:flink:1.9:compileJava FROM-CACHE > Task :runners:flink:1.9:classes > Task :runners:flink:1.9:jar > Task :runners:flink:1.9:job-server:compileJava NO-SOURCE > Task :runners:flink:1.9:job-server:classes UP-TO-DATE > Task :runners:flink:1.9:job-server:shadowJar > Task :runners:flink:1.9:job-server-container:copyDockerfileDependencies > Task :runners:flink:1.9:job-server-container:dockerPrepare > Task :runners:flink:1.9:job-server-container:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 1m 3s 58 actionable tasks: 40 executed, 17 from cache, 1 up-to-date Publishing build scan... https://scans.gradle.com/s/utgnyp76fhnkm [beam_LoadTests_Python_coGBK_Flink_Batch] $ /bin/bash -xe /tmp/jenkins6377015683100352376.sh + echo 'Tagging image...' Tagging image... [beam_LoadTests_Python_coGBK_Flink_Batch] $ /bin/bash -xe /tmp/jenkins8928632315234832898.sh + docker tag gcr.io/apache-beam-testing/beam_portability/flink-job-server gcr.io/apache-beam-testing/beam_portability/flink-job-server:latest Error response from daemon: No such image: gcr.io/apache-beam-testing/beam_portability/flink-job-server:latest Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
