See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/1247/display/redirect?page=changes>
Changes:
[noreply] Update nbconvert requirement in /sdks/python
[noreply] Replaced deprecated finalize with DoFn Teardown (#24516)
[noreply] Bump cloud.google.com/go/storage from 1.28.0 to 1.28.1 in /sdks
(#24517)
[noreply] add clarifier to error message (#24449)
[noreply] Batch rename requests in fileio.WriteToFiles (#24341)
[noreply] Bump golang.org/x/text from 0.4.0 to 0.5.0 in /sdks (#24520)
[noreply] Support for JsonSchema in Kafka Read Schema Transform (#24272)
[noreply] Run go fmt over full go directory with go 1.19 (#24525)
[noreply] Cloudbuild+manualsetup+playground (#24144)
[noreply] Bump golang.org/x/sys from 0.2.0 to 0.3.0 in /sdks (#24519)
[noreply] Bump cloud.google.com/go/bigtable from 1.18.0 to 1.18.1 in /sdks
[noreply] Update from interface{} -> any for core packages (#24505)
[noreply] Implement FileWriteSchemaTransformConfiguration (#24479)
------------------------------------------
[...truncated 1.04 MB...]
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> e2fa4d1944b9
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 5eff5d11e792
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 90ca068570ab
Removing intermediate container 90ca068570ab
---> fdcceae77c22
Step 22/32 : FROM beam as third_party_licenses
---> fdcceae77c22
Step 23/32 : ARG pull_licenses
---> Running in a42f004e98de
Removing intermediate container a42f004e98de
---> 57856300e791
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> 17db3f90a99a
Step 25/32 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 2c4523d66bf7
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in da89e68a1076
Removing intermediate container da89e68a1076
---> 31a57bd46cc1
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> cc87ce3823e4
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install
'pip-licenses<4.0.0' pyyaml tenacity && python
/tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 431091521f1e
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in
/usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in
/usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in
/usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908
sha256=959be793ca48112f0800688c8f46fa082f152c33fc9f1051a4936679b4637d16
Stored in directory:
/root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mSkip pulling license for bs4
Removing intermediate container 431091521f1e
---> d56546764a3e
Step 29/32 : FROM beam
---> fdcceae77c22
Step 30/32 : ARG pull_licenses
---> Running in 6c8ad5b995c1
Removing intermediate container 6c8ad5b995c1
---> bfa82357c327
Step 31/32 : COPY --from=third_party_licenses
/opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 2dedfb69a9f1
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 9605610c6b7d
Removing intermediate container 9605610c6b7d
---> 902c25b006cc
Successfully built 902c25b006cc
Successfully tagged apache/beam_python3.10_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/python]
7a7920016ee6: Preparing
d5c3c4247d4b: Preparing
f354bad944e8: Preparing
b805d5cd9116: Preparing
1a2d68c400b7: Preparing
cc9e07ea5659: Preparing
bc1e14cf65bf: Preparing
46b6bf282968: Preparing
d1b3dddc2d75: Preparing
296e88138dec: Preparing
da3781755d36: Preparing
a2be575c3da4: Preparing
68dff39c8291: Preparing
f9bf5a2f2b45: Preparing
5183217745a1: Preparing
905ede8abeca: Preparing
63ab2579942e: Preparing
e6e9854ca999: Preparing
397a239a053b: Preparing
89c3244a87b2: Preparing
80231db1194c: Preparing
f1c1f2298584: Preparing
ccba29d69370: Preparing
cc9e07ea5659: Waiting
905ede8abeca: Waiting
e6e9854ca999: Waiting
80231db1194c: Waiting
bc1e14cf65bf: Waiting
63ab2579942e: Waiting
f9bf5a2f2b45: Waiting
46b6bf282968: Waiting
f1c1f2298584: Waiting
397a239a053b: Waiting
89c3244a87b2: Waiting
5183217745a1: Waiting
ccba29d69370: Waiting
d1b3dddc2d75: Waiting
68dff39c8291: Waiting
a2be575c3da4: Waiting
296e88138dec: Waiting
b805d5cd9116: Pushed
7a7920016ee6: Pushed
f354bad944e8: Pushed
1a2d68c400b7: Pushed
46b6bf282968: Pushed
d5c3c4247d4b: Pushed
bc1e14cf65bf: Pushed
d1b3dddc2d75: Pushed
68dff39c8291: Pushed
f9bf5a2f2b45: Pushed
5183217745a1: Layer already exists
905ede8abeca: Layer already exists
63ab2579942e: Layer already exists
e6e9854ca999: Layer already exists
397a239a053b: Layer already exists
89c3244a87b2: Layer already exists
80231db1194c: Layer already exists
f1c1f2298584: Layer already exists
ccba29d69370: Layer already exists
da3781755d36: Pushed
cc9e07ea5659: Pushed
296e88138dec: Pushed
a2be575c3da4: Pushed
20221205214539: digest:
sha256:0be7e31a5eb7ab996ac61760f1400798b245e08204b7cfd5d4b85a91435abb2e size:
5156
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 40229
Launching Python expansion service @ 45235
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.sdk.extensions.python.transforms.DataframeTransformTest >
testDataframeSum FAILED
java.lang.RuntimeException at TestDataflowRunner.java:141
16 tests completed, 1 failed, 2 skipped
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221205214539
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0be7e31a5eb7ab996ac61760f1400798b245e08204b7cfd5d4b85a91435abb2e
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221205214539]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0be7e31a5eb7ab996ac61760f1400798b245e08204b7cfd5d4b85a91435abb2e]
Deleted
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221205214539]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0be7e31a5eb7ab996ac61760f1400798b245e08204b7cfd5d4b85a91435abb2e])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0be7e31a5eb7ab996ac61760f1400798b245e08204b7cfd5d4b85a91435abb2e
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0be7e31a5eb7ab996ac61760f1400798b245e08204b7cfd5d4b85a91435abb2e
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:0be7e31a5eb7ab996ac61760f1400798b245e08204b7cfd5d4b85a91435abb2e].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221205214539
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce2b2229ee9719e376fbf8a63026147ee0846bcae6890dbd26ffaf21146219b2
Deleted: sha256:d81d25c5f5e3700c16b1a38be62cbaec2b9d9dc54bfd9cbe1a2c0902fac21f3b
Deleted: sha256:53d1fffef044ff45e0da4d188be6b563e82870ad9031d0a1c8ba8c60d3685c00
Deleted: sha256:36c80d52dca1b82b670fa79d417ace477f92a3ade33b037e8bc65e64d7398c5e
Deleted: sha256:c1325f586fcf574f573cff54191024b184d14b39f4f7d5bab2a2a9c38951a8db
Deleted: sha256:cc54b1ab8a4b8b846a07fceb247ede08018268f270c00bde651535fdfac23ffa
Deleted: sha256:5079603ac2b033cb2ddc8ed3d9ce32cd54f274d2c7c6c4cf7a40acb2403db016
Deleted: sha256:a89a3bffc348b2a49ad515a1fc2af01b7aeff6728a796d323c3917786514001f
Deleted: sha256:753087cdf2510d2396fbc76ee5b4b690b53389c46e75e8b0b1c9afb40ce466ce
Deleted: sha256:49a89f0368bb641ac643b96b9bbf7dc7357d0ebb2c8daa4608eecb158778262b
Deleted: sha256:d735b3ecc69bb6378aca919ba27ade41abd63a03df715e3c07b464d5fbb01a97
Deleted: sha256:2a58d8293547f4248890036d33b4bf4733ceb7bef51d4d40dc845f6b2603aa54
Deleted: sha256:684710bc42060deeed9f9597853fa79ddd0af33deaebbaf3a18f4254e31c1c6a
Deleted: sha256:5d600df689653f05ed33f1e923fe15a08d2483bf5952b55cff73707ab013c38f
Deleted: sha256:2fa6af050d99472ee98e9e277c773672732de03ae6d20d4970b03f7eff180371
Deleted: sha256:02c31e3e259f85f78c2ff54649f392a8a5fad3f6d6a79b9fd86e88b711dd4bac
Deleted: sha256:e7ebfd4ac1d967d4e50171a64984508dd574919eaeff26f85112788964e3d3f9
Deleted: sha256:1c4cb597fdccc40dd5f0186665b0af49de5fe5f660d618a444371318f46c6fc2
Deleted: sha256:e32a2acfa9568ee7a184bcb400ff3fe266fd824fe7c32303cf4c1f9bf715566e
Deleted: sha256:6d92773c93c4c675b1ca8568e5ad686a1078260076cef192d23d996f555527de
Deleted: sha256:9a8849fef772866ff24e96c2965deb2d1947877a25c0e07e90c8c7c39966b413
Deleted: sha256:84b4b967e9f3002aa0f20ade3375a314372d217df0069f70b5260bb9b25aafb2
Deleted: sha256:5642d3e575a2f45250a39a32187d7fd6d95ca50c20b29555237b3a8a6ab34bd4
Deleted: sha256:a9a548c46c1f8fae0813c6ec217c965affac492a5b78d1cdbbf7343d0e623fcb
Deleted: sha256:af29281ef34948fc6eb6b4d0f3908e98dd381701e62ca9fb70739e4608db60f0
Deleted: sha256:6f9d7cc4efcf217e42cf2b23e41034a84a19962339e70f3d2dde546b196879e6
Deleted: sha256:77b7399b07ea6d42fabc08a6bb9d7e67d5b3d12d00f9dbec758f82bf62d9a25d
Deleted: sha256:6f48e29db36dd5117acbdc77137e7e2cd436d02e502fd3bdbd77dc5790b7b6b6
Deleted: sha256:01e45fb4b72929b085a4e916c7ea9f5aa8d2e75fdeb484f915a9551d4c3549fa
Deleted: sha256:6416ede06bff37d12c84d1c874e175e2cc888d4996054e3aedd469d6370730f0
Deleted: sha256:77b89ff1dc6977c76bd9277873783fda76c9c15fd466e51bbdf982854f0a5ed9
Deleted: sha256:4088bb3be4f71a5bc71de65345d781bb72e1f945b2610037b155d028383805cd
Deleted: sha256:947a9a5768337dff5fb99a634d5ac92dc2de75280313e37f47a01b396e7d6b9b
Deleted: sha256:4bee02ce93befadf258a31a426b4be7b4bebcab13c2102a4248cf71a05224cdd
Deleted: sha256:09bfc349bef4ad14f586b2331b7a957c74b145335571da7c462c2009d77206a8
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221205214539]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce2b2229ee9719e376fbf8a63026147ee0846bcae6890dbd26ffaf21146219b2]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221205214539]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce2b2229ee9719e376fbf8a63026147ee0846bcae6890dbd26ffaf21146219b2])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce2b2229ee9719e376fbf8a63026147ee0846bcae6890dbd26ffaf21146219b2
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce2b2229ee9719e376fbf8a63026147ee0846bcae6890dbd26ffaf21146219b2
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ce2b2229ee9719e376fbf8a63026147ee0846bcae6890dbd26ffaf21146219b2].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1044967.
Stopping expansion service pid: 1044968.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 35m 19s
174 actionable tasks: 25 executed, 149 up-to-date
Publishing build scan...
https://gradle.com/s/44kcyfeqfkwhk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
