See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/1386/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if
[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if
[aydar.zaynutdinov] [BEAM-13224][Playground]
[noreply] [BEAM-13193] Add elements field in ProcessBundleRequest and ProcessBu…
[noreply] [BEAM-3304] Refactor trigger API (#15952)
[noreply] [BEAM-3293] Add NewKeyedIterable function to SideInputAdapter
interface
------------------------------------------
[...truncated 36.91 KB...]
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:java-fn-execution:classes
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:expansion-service:classes
> Task :sdks:java:expansion-service:jar
> Task :runners:direct-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:direct-java:classes
> Task :sdks:java:extensions:ml:compileJava
> Task :sdks:java:extensions:ml:classes
> Task :sdks:java:extensions:ml:jar
> Task :sdks:java:io:kafka:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:kafka:classes
> Task :sdks:java:io:kafka:jar
> Task :runners:direct-java:shadowJar
> Task :sdks:java:container:java11:copyDockerfileDependencies
> Task :sdks:java:container:java11:dockerPrepare
> Task :sdks:java:io:google-cloud-platform:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:google-cloud-platform:classes
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:container:java11:docker
---> 47e32af88697
Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> 0094c74e3c4d
Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> 6a2c283cf5aa
Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/
---> 9963400dd166
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
---> 78619e6dcb15
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
---> f3532e9074e3
Step 13/18 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> 9b6095141258
Step 14/18 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> b7e82321b1e9
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 22b5fc1d6256
Removing intermediate container 22b5fc1d6256
---> 6d1962ba3a41
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 365f14978300
> Task :runners:google-cloud-dataflow-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :examples:java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:google-cloud-dataflow-java:classes
> Task :examples:java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :examples:java:jar
> Task :sdks:java:container:java11:docker
Removing intermediate container 365f14978300
---> 71f94965ddf0
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> 0e55977d6294
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 4f228e8373f1
Removing intermediate container 4f228e8373f1
---> c0f90d470f2c
Successfully built c0f90d470f2c
Successfully tagged apache/beam_java11_sdk:2.35.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
ed4ddbc8321d: Preparing
a1eccceecb3c: Preparing
399b56368258: Preparing
165199a69dbc: Preparing
9c3627245fab: Preparing
a6b181842acf: Preparing
0be9350b37ce: Preparing
7957e5932441: Preparing
a2fd7e7a1ff4: Preparing
8a496974738b: Preparing
02f53d01835a: Preparing
b01789e71fdc: Preparing
78700b6b35d0: Preparing
62a5b8741e83: Preparing
36e0782f1159: Preparing
ba6e5ff31f23: Preparing
9f9f651e9303: Preparing
0b3c02b5d746: Preparing
62a747bf1719: Preparing
7957e5932441: Waiting
a2fd7e7a1ff4: Waiting
a6b181842acf: Waiting
8a496974738b: Waiting
0be9350b37ce: Waiting
02f53d01835a: Waiting
b01789e71fdc: Waiting
78700b6b35d0: Waiting
62a5b8741e83: Waiting
36e0782f1159: Waiting
ba6e5ff31f23: Waiting
9f9f651e9303: Waiting
0b3c02b5d746: Waiting
62a747bf1719: Waiting
399b56368258: Pushed
9c3627245fab: Pushed
a1eccceecb3c: Pushed
a6b181842acf: Pushed
ed4ddbc8321d: Pushed
7957e5932441: Pushed
165199a69dbc: Pushed
a2fd7e7a1ff4: Pushed
78700b6b35d0: Layer already exists
62a5b8741e83: Layer already exists
36e0782f1159: Layer already exists
ba6e5ff31f23: Layer already exists
9f9f651e9303: Layer already exists
0b3c02b5d746: Layer already exists
62a747bf1719: Layer already exists
0be9350b37ce: Pushed
02f53d01835a: Pushed
b01789e71fdc: Pushed
> Task :examples:java:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :examples:java:testClasses
> Task :examples:java:testJar
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
8a496974738b: Pushed
20211113000118: digest:
sha256:eae720de63b6415822103b10db2261f2aac90ace72b6ab75986d2b88614de929 size:
4311
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-1113000513-12739ca2
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1113000513-12739ca2
******************Set Up Big Query Table*******************
The BigQuery table has been set up for this example:
apache-beam-testing:traffic_routes_1636761906784.traffic_routes_table
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-1113000513-12739ca2
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-1113000513-12739ca2
The BigQuery table might contain the example's output, and it is not deleted
automatically:
apache-beam-testing:traffic_routes_1636761906784.traffic_routes_table
Please go to the Developers Console to delete it manually. Otherwise, you may
be charged for its usage.
***********************************************************
***********************************************************
org.apache.beam.examples.snippets.transforms.io.gcp.bigquery.BigQuerySamplesIT
> testTableIO FAILED
java.lang.RuntimeException at BigQuerySamplesIT.java:125
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApi FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.cookbook.BigQueryTornadoesIT >
testE2eBigQueryTornadoesWithStorageApiUsingQuery FAILED
java.lang.RuntimeException at BigQueryTornadoesIT.java:68
org.apache.beam.examples.complete.TrafficMaxLaneFlowIT >
testE2ETrafficMaxLaneFlow FAILED
java.lang.RuntimeException at TrafficMaxLaneFlowIT.java:74
8 tests completed, 4 failed
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Error: No such image:
us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211113000118
ERROR: (gcloud.container.images.untag) Image could not be found:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211113000118]
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/examplesJavaRunnerV2IntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Java_Examples_Dataflow_V2_java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 278
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 43m 58s
84 actionable tasks: 75 executed, 7 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/asn6d7y7bz3vu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]