See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1493/display/redirect?page=changes>
Changes:
[relax] handle changing schemas in Storage API sink
[noreply] Fix a couple style issues (#17361)
[noreply] [BEAM-14287] Clean up staticcheck warnings in graph/coder (#17337)
[noreply] Improvements to dataflow job service for non-Python jobs. (#17338)
[noreply] Bump minimist (#17290)
[noreply] Bump ansi-regex (#17291)
[noreply] Bump nanoid (#17292)
[noreply] Bump lodash (#17293)
[noreply] Bump url-parse (#17294)
[noreply] Bump moment (#17328)
[noreply] Merge pull request #15549 from [BEAM-11997] Changed RedisIO
------------------------------------------
[...truncated 53.94 KB...]
> Task :sdks:java:container:pullLicenses
Collecting pip
Using cached pip-22.0.4-py3-none-any.whl (2.1 MB)
Collecting setuptools
Using cached setuptools-62.1.0-py3-none-any.whl (1.1 MB)
Collecting wheel
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.0.4 setuptools-62.1.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.2-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.2 tenacity-5.1.5
Executing python
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 225 dependencies using 16 threads.
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 9.753808 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ export GO111MODULE=off
+ GO111MODULE=off
+ go get github.com/apache/beam/sdks/java/container
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/java]
4ddae97ecc99: Preparing
949571ae82ba: Preparing
761f8a6402bb: Preparing
56b18362baf2: Preparing
15f6669223df: Preparing
4cd9e19192fe: Preparing
7284ffea221a: Preparing
499d9900ce5c: Preparing
42d2c58d1e39: Preparing
d9c7b754391d: Preparing
4f72a1db62fc: Preparing
44448c5c9ad5: Preparing
cc6cba01ab83: Preparing
f3eb450e629a: Preparing
d3e48ddec666: Preparing
7494d840ea88: Preparing
357cc1947e95: Preparing
b0dc1a441986: Preparing
7a7698da17f2: Preparing
d59769727d80: Preparing
348622fdcc61: Preparing
4ac8bc2cd0be: Preparing
d9c7b754391d: Waiting
d3e48ddec666: Waiting
4f72a1db62fc: Waiting
7494d840ea88: Waiting
357cc1947e95: Waiting
44448c5c9ad5: Waiting
b0dc1a441986: Waiting
cc6cba01ab83: Waiting
7a7698da17f2: Waiting
f3eb450e629a: Waiting
d59769727d80: Waiting
7284ffea221a: Waiting
348622fdcc61: Waiting
499d9900ce5c: Waiting
42d2c58d1e39: Waiting
4cd9e19192fe: Waiting
949571ae82ba: Pushed
761f8a6402bb: Pushed
15f6669223df: Pushed
56b18362baf2: Pushed
499d9900ce5c: Pushed
4ddae97ecc99: Pushed
4cd9e19192fe: Pushed
7284ffea221a: Pushed
42d2c58d1e39: Pushed
d9c7b754391d: Pushed
44448c5c9ad5: Pushed
7494d840ea88: Layer already exists
357cc1947e95: Layer already exists
b0dc1a441986: Layer already exists
7a7698da17f2: Layer already exists
4f72a1db62fc: Pushed
d59769727d80: Layer already exists
348622fdcc61: Layer already exists
4ac8bc2cd0be: Layer already exists
f3eb450e629a: Pushed
d3e48ddec666: Pushed
cc6cba01ab83: Pushed
20220413215735: digest:
sha256:5b259411a57f2db53769c2c7ef84c5bf75fc149fc06cf7a48157c1c142fa0530 size:
4935
> Task :runners:google-cloud-dataflow-java:coreSDKJavaRunnerV2IntegrationTest
> NO-SOURCE
> Task :runners:google-cloud-dataflow-java:examplesJavaRunnerV2IntegrationTest
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0413220006-77b0b999
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0413220006-77b0b999
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0413220006-77b0b999
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0413220006-77b0b999
***********************************************************
***********************************************************
***********************************************************
***********************************************************
**********************Set Up Pubsub************************
The Pub/Sub topic has been set up for this example:
projects/apache-beam-testing/topics/testpipeline-jenkins-0413220005-d26cee36
The Pub/Sub subscription has been set up for this example:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0413220005-d26cee36
*************************Tear Down*************************
The Pub/Sub topic has been deleted:
projects/apache-beam-testing/topics/testpipeline-jenkins-0413220005-d26cee36
The Pub/Sub subscription has been deleted:
projects/apache-beam-testing/subscriptions/testpipeline-jenkins-0413220005-d26cee36
***********************************************************
***********************************************************
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
org.apache.beam.sdk.io.gcp.pubsublite.ReadWriteIT > testReadWrite FAILED
java.lang.AssertionError at ReadWriteIT.java:264
47 tests completed, 1 failed, 5 skipped
> Task
> :runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220413215735
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b259411a57f2db53769c2c7ef84c5bf75fc149fc06cf7a48157c1c142fa0530
Deleted: sha256:e3a9d0da42eb26f30d1a6fc4e8f72f7718f77ae005a70d1d980d608926bb16a7
Deleted: sha256:2b35504eb9fc28c34f55621c5e5b73e706d15dd174bfd90668d8c4e715dd951a
Deleted: sha256:676c1bb1d5c20b783486680a17ff1c75e8f74be0d5ed5d7de8d00fb46399a97b
Deleted: sha256:786515cfbeded182912e4a2bb109bfb4d0889429ef3182941ce5b840cff9e8e1
Deleted: sha256:6bc33ba40cca814784d7ff1ce2ebfd5f1bbe9aacba023ad63341e94969d2b24e
Deleted: sha256:8ce3cbba222d02e8b2f168a9fa207501bca7520b1754db5ec0cb58d4bd28a216
Deleted: sha256:8e153116ced58f7a93723e8aaec552e286a8b3410b641417764b55080b98b215
Deleted: sha256:3345ef2958acea9721fab7b0131f30eb7507072c904f3cc46b733195dda79411
Deleted: sha256:6e276528509d230bf13d4915b9250eb06215fb44eeb4dc2634eefb03f04f90ad
Deleted: sha256:3758c73e8bd878b1fcc70ad784abd01f6e102316cf4ce7d9d7c81114d8880c65
Deleted: sha256:f8528783ca5a8f4f087e964cb4ecef554c14edd47e8bd8340adccd44436addb3
Deleted: sha256:be19cf27964782332e35fd77ab7538407624c0075a4bab14cd353d1323d5d9b1
Deleted: sha256:8ee9b8f01e065d59df2160110554615d3d529c2f482c1bf524f8b7f56b1becb9
Deleted: sha256:262d7fcfe34008d3d4031fc5ef3896f839f033dac57b7eb6c995d665316a4115
Deleted: sha256:1a8b1f1933777065b67e46088108eda30934d940085c58cf477db3551e1464f0
Deleted: sha256:674159f50b07004fe213d3849aca3ecb647f45c9e3e04162afbe0d7be63b2a1e
Deleted: sha256:da874439d88ba3c29ede3ac26c9df66913aa429911f374f29de75f4e25a45128
Deleted: sha256:e2999884fe326e4615393b8439bc57e80e434f05cb0c4e9f4bfe8d61afd66fdf
Deleted: sha256:7e5f1e3de591390756ef2ea8d3258da1f8b7d59b8b3b720ea21ae141966f6d33
Deleted: sha256:6aeff34c7a995b32f2020d82b9ac0e34fb35e4f8ef08d067d4d932873647d761
Deleted: sha256:bea2cccb5b284551351e0fbb18788a758e0c6d14b8019f72aaf48ca89e9a0704
Deleted: sha256:919d7dd420beaaa24ad163ad09433b3cb0d3e5e996719f49520d97cbad4c310d
Deleted: sha256:0f492d11eb96259882e277714077766c782ee44012992331393f0d7f07d620b2
Deleted: sha256:7e46a9d99a84e035b10bec3e112570ca90628984cf566e0b09f68cdf99157857
Deleted: sha256:705610720138a83a35bf776817406ab91d08e136456cf499bc96f4de0c0d9f28
Deleted: sha256:78c31b4835ec17228b48d59eb036db58abf5b1649a262e88048dbbd78e7b9e3c
Deleted: sha256:a3caa6a99688c36a353881f2e2febfeee8500d94c4894cd3262a19bf68edd4b5
Deleted: sha256:3edaa1d0c9922ddfcc7783213cfc3261c7b003bbb302d79fb1a8045301491fc1
Deleted: sha256:e449f3a6098b2e29b1912dd75b7b98c8e95cce2c5c87cc01d558a90bc3308341
Deleted: sha256:b5bf38913f8427238e1dfcb3adf1cf074a4b485a95f53d57c83f466e58ae29c1
Deleted: sha256:38c7ee4a839357596d48a6c67357366873a829f953bed522f702ed6d2a96aeb4
Deleted: sha256:fecc2714ff65c94df3c5c129712cbd63182f3315f4e0565d03471ab3601a9287
Deleted: sha256:1873f7ac6d79a8827ed0bc0b01f195bbd4a45ed75bba0cf48bca109bdca23fef
Deleted: sha256:45ff8a16ab65a1544a8e11636c9efe8936ae43f9539d38b34898433b9a3040d6
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220413215735]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b259411a57f2db53769c2c7ef84c5bf75fc149fc06cf7a48157c1c142fa0530]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220413215735]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b259411a57f2db53769c2c7ef84c5bf75fc149fc06cf7a48157c1c142fa0530])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b259411a57f2db53769c2c7ef84c5bf75fc149fc06cf7a48157c1c142fa0530
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b259411a57f2db53769c2c7ef84c5bf75fc149fc06cf7a48157c1c142fa0530
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b259411a57f2db53769c2c7ef84c5bf75fc149fc06cf7a48157c1c142fa0530].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:googleCloudPlatformRunnerV2IntegrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformRunnerV2IntegrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 23m 42s
141 actionable tasks: 90 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/eqjarjatscvau
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]