See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/751/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Restore "Default to Runner v2 for Python Streaming jobs.
(#15140)"
[stefan.istrate] Fix "too many pings" errors.
[stefan.istrate] Increase keepalive timeout to 5 minutes.
[Robert Bradshaw] Dead letter option.
[Robert Bradshaw] Guard setup.py logic with __main__ condition.
[stefan.istrate] Fix yapf complaints.
[Robert Bradshaw] Avoid incompatible setting.
[aydar.zaynutdinov] [BEAM-12969] [Playground]
[Robert Bradshaw] Add the ability to use subprocesses with the dead letter
queue.
[Robert Bradshaw] Support multi-output DoFns.
[noreply] Merge pull request #15510 from [BEAM-12883] Add coder for
[Robert Bradshaw] multi-output fix
[Robert Bradshaw] Add thresholding to dead letter pattern.
[Robert Bradshaw] treshold test fixes
[Robert Bradshaw] Better naming, documentation.
[noreply] [BEAM-12482] Ensure that we ignore schema update options when loading
[Kyle Weaver] Moving to 2.35.0-SNAPSHOT on master branch.
[Kyle Weaver] Add 2.35.0 section to changelog.
[noreply] Fix email links in the contact page
------------------------------------------
[...truncated 56.78 KB...]
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:direct-java:classes
> Task :sdks:java:container:java8:docker
---> Running in f4c1eec760fe
Removing intermediate container f4c1eec760fe
---> d545a532558e
Step 4/18 : ARG pull_licenses
---> Running in f00fa3567432
Removing intermediate container f00fa3567432
---> a14d5e545397
Step 5/18 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
> Task :runners:direct-java:shadowJar
> Task :sdks:java:container:java8:docker
---> 3bc151116af5
Step 6/18 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> e2605a9d614e
Step 7/18 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> d4d48c9eeba6
Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> 4d85a34dbcf0
Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> 28ff365d8a33
Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/
---> 9a9a253e7a2f
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
---> 2fc0ee6d6ff3
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
---> f5d71e931e3f
Step 13/18 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> a455a3d19218
Step 14/18 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> d618f3aa6ad3
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 8e59146b4a00
Removing intermediate container 8e59146b4a00
---> 79ae7a5fead1
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 4bce098e0562
Removing intermediate container 4bce098e0562
---> 71031fc768ed
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> b44b5ba64ac4
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in d5f0d6d7bf33
Removing intermediate container d5f0d6d7bf33
---> 1ca3e9beeb75
Successfully built 1ca3e9beeb75
Successfully tagged apache/beam_java8_sdk:2.35.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
1165ca362212: Preparing
71189b89a378: Preparing
cb55359e8a06: Preparing
4d9969e7d75f: Preparing
b0e34d5cb3b9: Preparing
679d14971478: Preparing
f395f059c87e: Preparing
ad5da4c5806b: Preparing
21038852a6f0: Preparing
eb90d5806f0f: Preparing
c171d16c596b: Preparing
7603bc8e67e8: Preparing
ab19b46e9384: Preparing
080ef0ba5cc0: Preparing
d08e6b97bf21: Preparing
3054497613e6: Preparing
d35dc7f4c79e: Preparing
dabfe5b2ea81: Preparing
5e6a409f30b6: Preparing
ad5da4c5806b: Waiting
c171d16c596b: Waiting
7603bc8e67e8: Waiting
ab19b46e9384: Waiting
080ef0ba5cc0: Waiting
d08e6b97bf21: Waiting
3054497613e6: Waiting
d35dc7f4c79e: Waiting
dabfe5b2ea81: Waiting
5e6a409f30b6: Waiting
21038852a6f0: Waiting
eb90d5806f0f: Waiting
f395f059c87e: Waiting
b0e34d5cb3b9: Pushed
71189b89a378: Pushed
cb55359e8a06: Pushed
1165ca362212: Pushed
679d14971478: Pushed
4d9969e7d75f: Pushed
ad5da4c5806b: Pushed
21038852a6f0: Pushed
ab19b46e9384: Layer already exists
080ef0ba5cc0: Layer already exists
d08e6b97bf21: Layer already exists
c171d16c596b: Pushed
d35dc7f4c79e: Layer already exists
3054497613e6: Layer already exists
dabfe5b2ea81: Layer already exists
5e6a409f30b6: Layer already exists
7603bc8e67e8: Pushed
f395f059c87e: Pushed
eb90d5806f0f: Pushed
20211007000121: digest:
sha256:816772011c0bc8265dc93cf2f8a0ce0c5cc4c44c6a2348e83526aab249938010 size:
4311
> Task :sdks:java:io:google-cloud-platform:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:google-cloud-platform:classes
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:io:google-cloud-platform:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:google-cloud-dataflow-java:compileJava
> Task :examples:java:compileJava
> Task :sdks:java:io:google-cloud-platform:testClasses
> Task :sdks:java:io:google-cloud-platform:testJar
> Task :examples:java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :examples:java:classes
> Task :examples:java:jar
> Task :examples:java:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :runners:google-cloud-dataflow-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1007001952-2662ab02
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1007001952-2662ab02
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1633565981431.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1007001952-2662ab02
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1007001952-2662ab02
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1633565981431.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1007004651-d2a5ec15
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1007004651-d2a5ec15
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_max_lane_flow_1633567611250.traffic_max_lane_flow_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1007004651-d2a5ec15
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1007004651-d2a5ec15
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_max_lane_flow_1633567611250.traffic_max_lane_flow_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:258
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPubsubMessageId FAILED
java.lang.AssertionError at PubsubReadIT.java:88
org.apache.beam.sdk.io.gcp.pubsub.PubsubReadIT > testReadPublicData FAILED
java.lang.AssertionError at PubsubReadIT.java:60
38 tests completed, 3 failed, 1 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211007000121
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816772011c0bc8265dc93cf2f8a0ce0c5cc4c44c6a2348e83526aab249938010
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211007000121]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816772011c0bc8265dc93cf2f8a0ce0c5cc4c44c6a2348e83526aab249938010]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211007000121]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816772011c0bc8265dc93cf2f8a0ce0c5cc4c44c6a2348e83526aab249938010])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816772011c0bc8265dc93cf2f8a0ce0c5cc4c44c6a2348e83526aab249938010
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816772011c0bc8265dc93cf2f8a0ce0c5cc4c44c6a2348e83526aab249938010
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816772011c0bc8265dc93cf2f8a0ce0c5cc4c44c6a2348e83526aab249938010].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 17s
129 actionable tasks: 120 executed, 7 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/apsrur2p5ne6e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
