See 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1433/display/redirect?page=changes>

Changes:

[chamikaramj] Convert URLs to local jars when constructing filesToStage

[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline

[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for


------------------------------------------
[...truncated 54.58 KB...]
  Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
  Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
  Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0 
soupsieve-2.3.1 tenacity-5.1.5
Executing python 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
 
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
        
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
        
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
        
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 224 dependencies using 16 threads.
INFO:root:Replaced local file URL with 
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
 for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 8.644649 seconds with 16 
threads.
Copying licenses from 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
 to 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :runners:google-cloud-dataflow-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar

> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container 
--save_path=/output/licenses
+ tee /output/licenses/list.csv
+ go-licenses csv github.com/apache/beam/sdks/java/container
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 
18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: 
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
8df87ca8c4ab: Preparing
f516a57c87d2: Preparing
c66d117961b5: Preparing
a95f3ee0e01e: Preparing
b5e59cbcd929: Preparing
c03c31c11528: Preparing
2bdbedc6dbe0: Preparing
eec1b744b27a: Preparing
1003a8a9afe8: Preparing
27b437db3434: Preparing
df8e1b0030e9: Preparing
bb6b937fc07c: Preparing
fd6e96d70280: Preparing
c083aa2a553e: Preparing
5b41a39b0db9: Preparing
0607554a700f: Preparing
3add5b0a88e9: Preparing
3cddd9de99b4: Preparing
327e42081bbe: Preparing
6e632f416458: Preparing
e019be289189: Preparing
c9a63110150b: Preparing
3cddd9de99b4: Waiting
c9a63110150b: Waiting
1003a8a9afe8: Waiting
e019be289189: Waiting
6e632f416458: Waiting
5b41a39b0db9: Waiting
c03c31c11528: Waiting
fd6e96d70280: Waiting
df8e1b0030e9: Waiting
27b437db3434: Waiting
2bdbedc6dbe0: Waiting
eec1b744b27a: Waiting
0607554a700f: Waiting
327e42081bbe: Waiting
b5e59cbcd929: Pushed
f516a57c87d2: Pushed
a95f3ee0e01e: Pushed
c66d117961b5: Pushed
8df87ca8c4ab: Pushed
eec1b744b27a: Pushed
27b437db3434: Pushed
c03c31c11528: Pushed
1003a8a9afe8: Pushed
df8e1b0030e9: Pushed
bb6b937fc07c: Pushed
0607554a700f: Layer already exists
3add5b0a88e9: Layer already exists
3cddd9de99b4: Layer already exists
c083aa2a553e: Pushed
327e42081bbe: Layer already exists
6e632f416458: Layer already exists
e019be289189: Layer already exists
c9a63110150b: Layer already exists
2bdbedc6dbe0: Pushed
5b41a39b0db9: Pushed
fd6e96d70280: Pushed
20220329180056: digest: 
sha256:375a112890f90fb06fb5c549897b2e2eba177eae949206269961153880ac34f9 size: 
4935

> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest 
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: 
projects/apache-beam-testing/topics/testpipeline-jenkins-0329180453-ef5b10da
The Pub/Sub subscription has been set up for this example: 
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0329180453-ef5b10da
*************************Tear Down*************************
The Pub/Sub topic has been deleted: 
projects/apache-beam-testing/topics/testpipeline-jenkins-0329180453-ef5b10da
The Pub/Sub subscription has been deleted: 
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0329180453-ef5b10da
***********************************************************
***********************************************************

***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example: 
projects/apache-beam-testing/topics/testpipeline-jenkins-0329180453-9a0ddba3
The Pub/Sub subscription has been set up for this example: 
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0329180453-9a0ddba3
*************************Tear Down*************************
The Pub/Sub topic has been deleted: 
projects/apache-beam-testing/topics/testpipeline-jenkins-0329180453-9a0ddba3
The Pub/Sub subscription has been deleted: 
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0329180453-9a0ddba3
***********************************************************
***********************************************************

> Task 
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest

org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOStorageWriteIT > 
testBigQueryStorageWrite30MProto FAILED
    java.lang.RuntimeException at BigQueryIOStorageWriteIT.java:101

org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamIT > 
testReadSpannerChangeStream FAILED
    java.lang.IllegalArgumentException at SpannerChangeStreamIT.java:139

org.apache.beam.sdk.io.gcp.spanner.changestreams.it.SpannerChangeStreamTransactionBoundariesIT
 > testTransactionBoundaries FAILED
    java.lang.IllegalArgumentException at 
SpannerChangeStreamTransactionBoundariesIT.java:145

org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1Read FAILED
    java.lang.RuntimeException at V1ReadIT.java:92

org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > 
testE2EV1ReadWithGQLQueryWithLimit FAILED
    java.lang.RuntimeException at V1ReadIT.java:135

org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > 
testE2EV1ReadWithGQLQueryWithNoLimit FAILED
    java.lang.RuntimeException at V1ReadIT.java:135

org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
    java.lang.AssertionError at ReadWriteIT.java:264

org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadAllRecordsInDb FAILED
    java.lang.RuntimeException at SpannerReadIT.java:288

49 tests completed, 8 failed, 3 skipped

> Task 
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
>  FAILED

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220329180056
Untagged: 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:375a112890f90fb06fb5c549897b2e2eba177eae949206269961153880ac34f9
Deleted: sha256:b3f89c8ff36e0d831b126db178026d341bef2e81e36df9e759bbe0081e7c8ac5
Deleted: sha256:ecc81e12109cb65dece3744a8ec64912e4084c72a816533e6d3af4624663f307
Deleted: sha256:8ca83b69dd6c8caa0a607d653f93a549697a57ebf03df187c9bcc30cb8778037
Deleted: sha256:87bdae1645847e4d4a62409d6f24926915f66c90ee31e6577798484d8aae23fa
Deleted: sha256:113b955cd1f86d11d95550b0ec4250ac0d32db597652d18e623c9727724b24b8
Deleted: sha256:19be1f804b20d942665ff6334e342a19eee142056e1ec8bbec2fd765485942c7
Deleted: sha256:a56804aeae824a3f929cbe951559f4ca9d6f453bf987439a91048cddb8c2c263
Deleted: sha256:8f387a6966b78d49a1433cc520e928be6c5f60142a74300bca4e1b682c26a29f
Deleted: sha256:93fb22ce863fac898a0b4ef0aeaccd4d6ce40669fd34db9963f0158247a7c1d1
Deleted: sha256:9f711fc4db5dd6c57dee1f24ca81b32c937e70785ecdab4b8c0e5afc605b2f9f
Deleted: sha256:06f98b0e16e57d1d4d09860339c82aea039a73445dad42ba2ea2ba1002205a78
Deleted: sha256:3f4213cac7fa7061450507376e87c0c1f121e5eb6be4afa55b56543b4669db0d
Deleted: sha256:a26704788bb61617104434f31c43f7983b2b87b6f34d27807e2a7828c6944338
Deleted: sha256:b853ec2f60f9a6b80103e3b5b89da4cf5ece7889f24acec6934e858f456a7c1d
Deleted: sha256:8708a87adffaa933ecd6caab891acfe1bbc2b6ec7b07bc0f4f1a68dccb9d656e
Deleted: sha256:61426fcdc5dfd26945518861c7265098b3baf25f2c7bab30715a95f480dea859
Deleted: sha256:924d388dfdf9e11b5b1aeb10f839dfdf51be7666b86296257c572942ba37a2ed
Deleted: sha256:ba6795f4d0bec6ea16f35f07f9c7326a7a4922b02d871ece3a0ca4c386a14361
Deleted: sha256:bb2caaf541a9501c53a598698e3892183cd2a2a6ef0db581aa8646f0e9293060
Deleted: sha256:ce6cf1d8b7edf9344a2c92dffb1092b4d2ebb6babb5950037f873fc4a9c52fa1
Deleted: sha256:e585586d2d88114f19eba0f4649cc5517516c2661c3011a621256234309c210b
Deleted: sha256:0e436ddc6ae0069c10f369fbfacf87761ac007c34f00869e0f8c22effc11ff3e
Deleted: sha256:ee7f8c07ccadff118b6f870898c544c86bdb66ce45f4bd46ec6cbe899575ccbe
Deleted: sha256:901ee16eb276821b85f9e2c20fe5ef60045363cb28fa1a8f1fd28a1705d96bb7
Deleted: sha256:4f06c631b3e41f14bf83128ee717d3bf26e595c92048370a3aef0cd6a6f0551b
Deleted: sha256:20ccf38abd7cc004923d168d3b27a914b92d3169c82bf9b61b95ad4582d519c9
Deleted: sha256:ae46df5b32597238ea3d35d09099a02c381c50a074c869711e718f01a2af142d
Deleted: sha256:c0ed9b2c121fc9e8df12157140202686a943babc5169c19347d3ee9c8d45be0e
Deleted: sha256:90be63f81f747ec13bcb4d1b2c3151196095b045ef019049d14290582b986c98
Deleted: sha256:e5c814b1824b271a52e6a30ad8489b19531310f82b46a6f2f15667aa8d9ecbe5
Deleted: sha256:30fe9faf56bcce62b66aee0593b7ef1359364ce38953f40681943368f073bce6
Deleted: sha256:2262c3bf513120492bced150876d2a25a379c2a161442726d0ed890844ac1e88
Deleted: sha256:b3fc2e33f1a3dd9ca96885d5fd724edad8bd375bc9d80f293a9e51d8bf43af57
Deleted: sha256:e8f70aeaba393bf78718167777715093675fdf0af25a2c9686533c2105e99a08
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220329180056]
- referencing digest: 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:375a112890f90fb06fb5c549897b2e2eba177eae949206269961153880ac34f9]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220329180056] 
(referencing 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:375a112890f90fb06fb5c549897b2e2eba177eae949206269961153880ac34f9])].
Removing untagged image 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:375a112890f90fb06fb5c549897b2e2eba177eae949206269961153880ac34f9
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:375a112890f90fb06fb5c549897b2e2eba177eae949206269961153880ac34f9
Deleted 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:375a112890f90fb06fb5c549897b2e2eba177eae949206269961153880ac34f9].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task 
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at: 
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

See 
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during 
this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 2h 11m 41s
141 actionable tasks: 91 executed, 46 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/iwit53iph2way

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to