See <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1023/display/redirect?page=changes>
Changes: [Robert Bradshaw] Better type hints for Count combiners. [Kyle Weaver] Include name of missing tag in error message. [noreply] Updating Grafana from v8.1.2 to v8.1.6 [noreply] Change Pub/Sub Lite PollResult to set explicit watermark (#16216) [noreply] [BEAM-13454] Fix and test dataframe read_fwf. (#16064) ------------------------------------------ [...truncated 45.21 KB...] > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:container:pullLicenses Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:extensions:ml:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:container:pullLicenses Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB) Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, beautifulsoup4, pyyaml, six, tenacity Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.1 tenacity-5.1.5 WARNING: You are using pip version 20.2.3; however, version 21.3.1 is available. You should consider upgrading via the '<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python3.8> -m pip install --upgrade pip' command. Executing <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 213 dependencies using 16 threads. > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar > Task :examples:java:jar > Task :runners:direct-java:shadowJar > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:io:google-cloud-platform:testJar > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 43.198004 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] e4cab402cccf: Preparing a235d88a774c: Preparing 3e044ac773c8: Preparing 33ccef28883f: Preparing 8f61532ab359: Preparing 91f44bc9fc09: Preparing 37e77a62e989: Preparing be5b0570d121: Preparing 103bf660fc8d: Preparing 244c41485c9d: Preparing ea280a2cd4f9: Preparing ced447df167f: Preparing 4d327f577a2b: Preparing a6159ee91199: Preparing a81f1846a0d2: Preparing 3b441d7cb46b: Preparing d3710de04cb3: Preparing 91f7336bbfff: Preparing e2e8c39e0f77: Preparing 91f44bc9fc09: Waiting 103bf660fc8d: Waiting 244c41485c9d: Waiting 37e77a62e989: Waiting ea280a2cd4f9: Waiting ced447df167f: Waiting 4d327f577a2b: Waiting a6159ee91199: Waiting be5b0570d121: Waiting a81f1846a0d2: Waiting 3b441d7cb46b: Waiting d3710de04cb3: Waiting 91f7336bbfff: Waiting a235d88a774c: Pushed 8f61532ab359: Pushed 3e044ac773c8: Pushed 91f44bc9fc09: Pushed e4cab402cccf: Pushed be5b0570d121: Pushed 33ccef28883f: Pushed 103bf660fc8d: Pushed 4d327f577a2b: Layer already exists a6159ee91199: Layer already exists a81f1846a0d2: Layer already exists 3b441d7cb46b: Layer already exists d3710de04cb3: Layer already exists 91f7336bbfff: Layer already exists ea280a2cd4f9: Pushed 37e77a62e989: Pushed ced447df167f: Pushed e2e8c39e0f77: Layer already exists 244c41485c9d: Pushed 20211214000119: digest: sha256:53b5ec8d7409e54bc43adb554f70eb182de30b694477a7f0ae1d56023a4b005e size: 4311 > Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest > NO-SOURCE > Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1214000606-7fffa6d6 The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1214000606-7fffa6d6 ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_routes_1639440358928.traffic_routes_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1214000606-7fffa6d6 The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1214000606-7fffa6d6 The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_routes_1639440358928.traffic_routes_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** *********************************************************** *********************************************************** **********************Set Up Pubsub************************ The Pub/Sub topic has been set up for this example: projects/apache-beam-testing/topics/testpipeline-jenkins-1214003147-ea7dd0cd The Pub/Sub subscription has been set up for this example: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1214003147-ea7dd0cd ******************Set Up Big Query Table******************* The BigQuery table has been set up for this example: apache-beam-testing:traffic_max_lane_flow_1639441906675.traffic_max_lane_flow_table *************************Tear Down************************* The Pub/Sub topic has been deleted: projects/apache-beam-testing/topics/testpipeline-jenkins-1214003147-ea7dd0cd The Pub/Sub subscription has been deleted: projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1214003147-ea7dd0cd The BigQuery table might contain the example's output, and it is not deleted automatically: apache-beam-testing:traffic_max_lane_flow_1639441906675.traffic_max_lane_flow_table Please go to the Developers Console to delete it manually. Otherwise, you may be charged for its usage. *********************************************************** *********************************************************** > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED java.lang.AssertionError at ReadWriteIT.java:264 38 tests completed, 1 failed, 1 skipped > Task > :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest > FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211214000119 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:53b5ec8d7409e54bc43adb554f70eb182de30b694477a7f0ae1d56023a4b005e Deleted: sha256:8dc303b0a0f08bdb3fffe185288c5c7b7fa771b57f3f969c795575b775804587 Deleted: sha256:d2510c0f5fb76b393dfdffaf35a7aadaf9b390e5ee7146134bd45c8dde17908e Deleted: sha256:6b06350953002786d3744383bc8295123a45aac52a49a758184e8654bb4a694b Deleted: sha256:902b35a96365b83a3067d35a5dcf39e4c58dcae914a53c74623563d3dae0fb9f Deleted: sha256:edd8a0ffd7a88d3e1ee855f369f70ef82f36fca67f4f932c2d7a5477be394769 Deleted: sha256:5d6f78cb14090b42a49783f786cae96eae256eba366c35e9c07033fd6bb8426f Deleted: sha256:555ea321af7c6bb6b9e40f69eff498592b96e87661a5c00425a3b4af879baf6b Deleted: sha256:3e79d9b7b13712752c43b8d4287a69f054042c40edf5fbf1147f8c681bbfe073 Deleted: sha256:0cdfb1b3b79bce40aff5559b351414d4bcf927e4ed472b9b166fed654e40b606 Deleted: sha256:a4f6e834e569bc790c49cd1dd7cfa32561b92365181bd586c46d6718505a39c0 Deleted: sha256:b2726b996e645c12f21cd838bfb32bf50f93a1a500c9600fe50e9f0879c05870 Deleted: sha256:09082f67a0c2c62ffdba9afe2361a59ab80a75bece83848eae5d095f8684fe38 Deleted: sha256:32b762b3a47210fec97bbd49959da2b192df5f1bd78dfeeb4dc695d5f31a5664 Deleted: sha256:2e080dd9ee39246c534fc3e6e0cd878f93860f4924f057b33a4f3be794af6557 Deleted: sha256:920423d0ede8bb3970bbd7736726403e4a873204964424aeb11f0db04c339157 Deleted: sha256:5a0ed4cafb001f7a73d016c650edbca2c401e25b2712dfa83d809b38e647f4a1 Deleted: sha256:007d6f2c820d19e5d6181c8561a789cadd5521d9526baf3c345674a68b9d22c1 Deleted: sha256:3a1345eb33eab065d03ea1a65c5949364470a70798c23dee14fb53ca2abc0908 Deleted: sha256:b5c65039b9a1d952be58e1f1400949bc9347c114abefc81a19ae46f26148162f Deleted: sha256:96b505fec636268a195ef412308407128845d9c9d0aea388c1ff94aac2d1419b Deleted: sha256:ada26d58c451018a2faa8bbb74ec1344b90056d534af3d9d2d6c84d26cc07442 Deleted: sha256:381d6cde66e0f84436116ca45f374bea2e904a9bf577db8e6512d7fd5d9435c4 Deleted: sha256:fffdd88994c9551eeeda0c6583b5fbb53e4425e39fef42ac59113e0d91007cf9 Deleted: sha256:ca92f2870263bd969e3668c6ba6be558d6d6a579d0002b2c6bd841a621228e7f Deleted: sha256:ffcf39398abec2c40857f1ff7c794cee48c42fd6d0638df77e42668f27320406 Deleted: sha256:956929e5abeb3222d16716cd107219713cde599a62248733121c33f2800e1f12 Deleted: sha256:c391c99d9c9b32f7b6f144388e006a1271980cec4575b5583695c28df8a4f5a6 Deleted: sha256:5d9e600817ad35c70e268fd134da9e182586414e11da1c7492a33d893604ba9e Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211214000119] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:53b5ec8d7409e54bc43adb554f70eb182de30b694477a7f0ae1d56023a4b005e] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211214000119] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:53b5ec8d7409e54bc43adb554f70eb182de30b694477a7f0ae1d56023a4b005e])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:53b5ec8d7409e54bc43adb554f70eb182de30b694477a7f0ae1d56023a4b005e Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:53b5ec8d7409e54bc43adb554f70eb182de30b694477a7f0ae1d56023a4b005e Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:53b5ec8d7409e54bc43adb554f70eb182de30b694477a7f0ae1d56023a4b005e]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 50m 40s 129 actionable tasks: 88 executed, 39 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/kuxwawj7egoom Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
