See
<https://ci-beam.apache.org/job/beam_PostCommit_Java/7257/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Remove use of model SYNCHRONIZED_PROCESSING_TIME
[Kenneth Knowles] Remove SYNCHRONIZED_PROCESSING_TIME from model proto
[samuelw] [BEAM-11707] Change WindmillStateCache cache invalidation to be based
[shehzaad] [BEAM-10961] enable strict dependency checking for
[shehzaad] [BEAM-10961] undo line moves (originally intended for
alphabeticization)
[shehzaad] [BEAM-10961] enable strict dependency checking for
[shehzaad] [BEAM-10961] enable strict dependency checking for
[shehzaad] [BEAM-10961] enable strict dependency checking for
[shehzaad] [BEAM-10961] enable strict dependency checking for
[shehzaad] [BEAM-10961] enable strict dependency checking for
[shehzaad] [BEAM-10961] enable strict dependency checking for
[shehzaad] [BEAM-10961] enable strict dependency checking for
[shehzaad] [BEAM-10961] fix stray reordering of lines
[zyichi] Add validate runner test for testing custom merging windows fn without
[zyichi] Fix up! formatting
[Boyuan Zhang] Do not stage dataflow worker jar when use runner_v2.
[Kenneth Knowles] Recognize JOB_STATE_PENDING from Dataflow and map to RUNNING
[Pablo Estrada] Attempting improvements on DirectRunner Python dash
[shehzaad] [BEAM-10961] add explicit compile for auto_value_annotations in
[shehzaad] [BEAM-10961] add reference to BEAM-11761
[noreply] Merge pull request #13802: [BEAM-1474]. Adding MapState and SetState
[noreply] [BEAM-10961] enable strict dependency checking for
[Kenneth Knowles] Initial watermark latency benchmark
[noreply] [BEAM-10961] Strict dependency checking for sdks/java/io/gcp (#13791)
------------------------------------------
[...truncated 122.13 KB...]
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
at java.lang.Thread.run(Thread.java:748)
> Task :sdks:java:extensions:sorter:hadoopVersionsTest
> Task :sdks:java:io:kafka:kafkaVersion01103Test
> Task :runners:spark:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:hadoop-file-system:hadoopVersion292Test
> Task :sdks:java:io:parquet:hadoopVersion321Test
> Task :runners:spark:testClasses
> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/api:
commit='0324d5e90dc7753607860272666845fad9ceb97e',
urls=[https://code.googlesource.com/google-api-go-client]
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO2101IT
> Task :runners:spark:hadoopVersion2101Test
> Task :sdks:java:io:parquet:hadoopVersionsTest
> Task :sdks:java:io:kafka:kafkaVersion100BatchIT
> Task :sdks:java:io:hcatalog:hadoopVersion292Test
> Task :sdks:java:io:hadoop-file-system:hadoopVersion321Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO2101Test
> Task :sdks:java:io:kafka:kafkaVersion100Test
> Task :sdks:java:io:google-cloud-platform:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
5 errors
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava
> FAILED
> Task :sdks:java:io:google-cloud-platform:integrationTest
> Task :sdks:java:io:hadoop-file-system:hadoopVersionsTest
> Task :sdks:java:io:hcatalog:hadoopVersionsTest
> Task :sdks:java:io:kafka:kafkaVersion111BatchIT
> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/genproto:
commit='4d944d34d83c502a5f761500a14d8842648415c3',
urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc:
commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58',
urls=[https://github.com/grpc/grpc-go]
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO285ElasticIT
> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/protobuf:
commit='d165be301fb1e13390ad453281ded24385fd8ebc',
urls=[https://go.googlesource.com/protobuf]
Resolving cached github.com/etcd-io/etcd:
commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921',
urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd:
commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921',
urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git]
> Task :sdks:java:io:kafka:kafkaVersion111Test
> Task :sdks:go:installDependencies
> Task :runners:spark:hadoopVersion285Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO285IT
> Task :sdks:java:io:kafka:kafkaVersion201BatchIT
> Task :sdks:java:io:kafka:kafkaVersion201Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO285Test
> Task :sdks:java:io:kafka:kafkaVersion211BatchIT
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO292ElasticIT
> Task :sdks:java:io:kafka:kafkaVersion211Test
> Task :sdks:java:io:google-cloud-platform:integrationTestKms
> Task :runners:spark:hadoopVersion292Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO292IT
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild
> Task :sdks:java:io:kafka:kafkaVersion222BatchIT
> Task :sdks:java:container:resolveBuildDependencies
Resolving
./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/sdks/go>
> Task :sdks:java:container:installDependencies
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java8:copySdkHarnessLauncher
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
---> Running in 540260147bfa
Removing intermediate container 540260147bfa
---> 50d7ab69b3bc
Step 5/17 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
---> 1005b07524f4
Step 6/17 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> 6d02e52f47a0
Step 7/17 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> 4a4df78d52cb
Step 8/17 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> dcdc3e706eed
Step 9/17 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> b0bff41dfab3
Step 10/17 : ADD target/linux_amd64/boot /opt/apache/beam/
---> cf7c629b6c97
Step 11/17 : COPY target/LICENSE /opt/apache/beam/
---> 289b14b68ac9
Step 12/17 : COPY target/NOTICE /opt/apache/beam/
---> 8e8ec07bc45f
Step 13/17 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> 5768e32b5840
Step 14/17 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> d6a391bcc72b
Step 15/17 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 32e1e156f02b
Removing intermediate container 32e1e156f02b
---> 8729a8cbeb93
Step 16/17 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 9a59f0f5f0dc
Removing intermediate container 9a59f0f5f0dc
---> 428f8ab57de7
Step 17/17 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 2f0cce96fa7e
Removing intermediate container 2f0cce96fa7e
---> 42ba17d353a7
Successfully built 42ba17d353a7
Successfully tagged apache/beam_java8_sdk:2.29.0.dev
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO292Test
> Task :sdks:java:io:kafka:kafkaVersion222Test
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
org.apache.beam.examples.cookbook.MapClassIntegrationIT > testDataflowMapState
FAILED
java.lang.UnsupportedOperationException at MapClassIntegrationIT.java:69
> Task :sdks:java:io:kafka:kafkaVersion231BatchIT
> Task :sdks:java:io:google-cloud-platform:postCommit
> Task :runners:spark:hadoopVersion321Test
> Task :sdks:java:io:kafka:kafkaVersion231Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO321ElasticIT
> Task :sdks:java:io:kafka:kafkaVersion241BatchIT
> Task :sdks:java:io:kafka:kafkaVersion241Test
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO321IT
> Task :runners:spark:hadoopVersionsTest
> Task :sdks:java:io:hadoop-format:runHadoopFormatIO321Test
> Task :sdks:java:io:kafka:kafkaVersion251BatchIT
> Task :sdks:java:io:kafka:kafkaVersion251Test
> Task :sdks:java:io:kafka:kafkaVersionsCompatibilityTest
> Task :sdks:java:io:hadoop-format:hadoopVersionsTest
> Task :javaHadoopVersionsTest
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0227002644-373a4452
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0227002644-373a4452
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1614385603318.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0227002644-373a4452
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0227002644-373a4452
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1614385603318.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0227005424-cb963ae3
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0227005424-cb963ae3
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1614387264330.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0227005424-cb963ae3
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0227005424-cb963ae3
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1614387264330.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
9 tests completed, 1 failed
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
> FAILED
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b4c6ce25886fb3ba8e35039adbdd4698168f75f4a50ab8e408c23a0bdfa7b2b9
Associated tags:
- 20210227000101
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210227000101
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210227000101].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b4c6ce25886fb3ba8e35039adbdd4698168f75f4a50ab8e408c23a0bdfa7b2b9].
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava'.
> Compilation failed; see the compiler error output for details.
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 1m 29s
244 actionable tasks: 210 executed, 32 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/6oqzvifpjzpxq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
