See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/659/display/redirect?page=changes>
Changes: [noreply] Avoid apiary submission of job graph when it is not needed. (#15458) [noreply] [BEAM-7261] Add support for BasicSessionCredentials for AWS credentials. ------------------------------------------ [...truncated 41.50 KB...] > Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava > FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:testJar > Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE > Task :sdks:java:extensions:protobuf:testClasses > Task :sdks:java:extensions:protobuf:testJar > Task :sdks:java:container:pullLicenses Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:container:pullLicenses Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:container:pullLicenses done. > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :sdks:java:extensions:ml:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar > Task :examples:java:jar > Task :sdks:java:container:pullLicenses DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:io:google-cloud-platform:testJar > Task :sdks:java:container:pullLicenses Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 207 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.63179 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] a77616ac4cf3: Preparing 9d987e2c2b6c: Preparing 0ba6cc127cdb: Preparing 6265fbc3ccec: Preparing 4a905a5f452a: Preparing e67585c601b1: Preparing c1eee0bcb300: Preparing 84d8f51c9e23: Preparing 5e1074d5ca82: Preparing 4ea485cfdefd: Preparing 6fa159acc5f2: Preparing 10f30ceaa1d0: Preparing d9b6ea8e7d5f: Preparing 9cb5eb95298c: Preparing 00ef5416d927: Preparing 8555e663f65b: Preparing d00da3cd7763: Preparing 4e61e63529c2: Preparing 799760671c38: Preparing d9b6ea8e7d5f: Waiting 00ef5416d927: Waiting 9cb5eb95298c: Waiting d00da3cd7763: Waiting 6fa159acc5f2: Waiting c1eee0bcb300: Waiting 10f30ceaa1d0: Waiting 84d8f51c9e23: Waiting 5e1074d5ca82: Waiting 4ea485cfdefd: Waiting 4e61e63529c2: Waiting 799760671c38: Waiting e67585c601b1: Waiting 8555e663f65b: Waiting 0ba6cc127cdb: Pushed 4a905a5f452a: Pushed 6265fbc3ccec: Pushed a77616ac4cf3: Pushed 9d987e2c2b6c: Pushed e67585c601b1: Pushed 5e1074d5ca82: Pushed 84d8f51c9e23: Pushed d9b6ea8e7d5f: Layer already exists 9cb5eb95298c: Layer already exists 00ef5416d927: Layer already exists 8555e663f65b: Layer already exists d00da3cd7763: Layer already exists 4e61e63529c2: Layer already exists 799760671c38: Layer already exists 6fa159acc5f2: Pushed c1eee0bcb300: Pushed 10f30ceaa1d0: Pushed 4ea485cfdefd: Pushed 20210914000055: digest: sha256:ba82e2a13d41862f0b8b3279c156be6c98b29309413eb5a38f131e5484d18a61 size: 4311 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0914000426-81b4bc05 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0914000426-81b4bc05 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1631577857528.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0914000426-81b4bc05 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0914000426-81b4bc05 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1631577857528.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-0914003020-f4b6db40 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0914003020-f4b6db40 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1631579419410.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-0914003020-f4b6db40 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0914003020-f4b6db40 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1631579419410.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED java.lang.AssertionError at ReadWriteIT.java:275 38 tests completed, 1 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210914000055 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ba82e2a13d41862f0b8b3279c156be6c98b29309413eb5a38f131e5484d18a61 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210914000055] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ba82e2a13d41862f0b8b3279c156be6c98b29309413eb5a38f131e5484d18a61] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210914000055] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ba82e2a13d41862f0b8b3279c156be6c98b29309413eb5a38f131e5484d18a61])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ba82e2a13d41862f0b8b3279c156be6c98b29309413eb5a38f131e5484d18a61 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ba82e2a13d41862f0b8b3279c156be6c98b29309413eb5a38f131e5484d18a61 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ba82e2a13d41862f0b8b3279c156be6c98b29309413eb5a38f131e5484d18a61]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 48m 12s 129 actionable tasks: 87 executed, 40 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/wqc3czpfblu74 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
