See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/1255/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Suppress keyfor warnings
[Kenneth Knowles] Suppress checker warnings that are confusing and difficult
[Kenneth Knowles] Add @Pure annotations to MongoDbIO autovalue fields
[Kenneth Knowles] Suppress checker in FnApiDoFnRunner due to crash
[Kenneth Knowles] Suppress checker framework in Dataflow
[Kenneth Knowles] Fix some nullness errors in Spark runner
[Kenneth Knowles] Upgrade checker framework to 3.27.0
[noreply] Migrate testing subpackages from interface{} to any (#24570)
[noreply] fix go lints (#24566)
[noreply] Samza runner support for non unique stateId across multiple ParDos
[noreply] Bump to Hadoop 3.3.4 for performance tests (#24550)
------------------------------------------
[...truncated 656.05 KB...]
scikit-learn==1.1.2
scipy==1.9.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.42
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.10.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.10.0
tensorflow-estimator==2.10.0
tensorflow-io-gcs-filesystem==0.27.0
termcolor==2.0.1
testcontainers==3.7.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
websocket-client==1.4.1
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zstandard==0.18.0
Removing intermediate container 27d9134c32ae
---> fe6b29738f57
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 5b36bbd3adaa
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> 623bf2c91df9
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> e4bd24fd3974
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 74d3267d1051
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in e9b4e2d090ea
Removing intermediate container e9b4e2d090ea
---> 32efd0907d4d
Step 22/32 : FROM beam as third_party_licenses
---> 32efd0907d4d
Step 23/32 : ARG pull_licenses
---> Running in 1b69a9a4f75d
Removing intermediate container 1b69a9a4f75d
---> f189a723f88c
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> 98d794dbab96
Step 25/32 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 09fa180dd1d9
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 0d511c63ad44
Removing intermediate container 0d511c63ad44
---> 67169a9bd5ca
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 2262821967ad
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install
'pip-licenses<4.0.0' pyyaml tenacity && python
/tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 6634637f2c31
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in
/usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in
/usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in
/usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908
sha256=2df0dc0df3c3e81a0222becca6fe331d497d707d189622393ee14419d5fc5583
Stored in directory:
/root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions
and conflicting behaviour with the system package manager. It is recommended to
use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mSkip pulling license for bs4
Removing intermediate container 6634637f2c31
---> ea44e40a98f7
Step 29/32 : FROM beam
---> 32efd0907d4d
Step 30/32 : ARG pull_licenses
---> Running in 6ffdb8ad6b72
Removing intermediate container 6ffdb8ad6b72
---> 91929f934f70
Step 31/32 : COPY --from=third_party_licenses
/opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> b860dabeb571
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 43a988256d9c
Removing intermediate container 43a988256d9c
---> f293857b0af7
Successfully built f293857b0af7
Successfully tagged apache/beam_python3.10_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/java-postcommit-it/python]
a10a5ca025ab: Preparing
ef42f7edc6d2: Preparing
fd3f1cd7cdf2: Preparing
1569d19b9400: Preparing
5ad0635534b2: Preparing
edf3f3272f6e: Preparing
3956d2bc278c: Preparing
6c18b8a563b7: Preparing
957835cae4b0: Preparing
9199448ea870: Preparing
999e063f6898: Preparing
ba129a49bb2f: Preparing
9fcc2003c8cd: Preparing
c547162c87c8: Preparing
89d6344d2aa8: Preparing
404130ce4519: Preparing
17cdb8503b04: Preparing
1cad4dc57058: Preparing
edf3f3272f6e: Waiting
4ff8844d474a: Preparing
b77487480ddb: Preparing
6c18b8a563b7: Waiting
cd247c0fb37b: Preparing
3956d2bc278c: Waiting
957835cae4b0: Waiting
cfdd5c3bd77e: Preparing
870a241bfebd: Preparing
9fcc2003c8cd: Waiting
ba129a49bb2f: Waiting
17cdb8503b04: Waiting
9199448ea870: Waiting
999e063f6898: Waiting
1cad4dc57058: Waiting
404130ce4519: Waiting
b77487480ddb: Waiting
cfdd5c3bd77e: Waiting
cd247c0fb37b: Waiting
c547162c87c8: Waiting
4ff8844d474a: Waiting
89d6344d2aa8: Waiting
fd3f1cd7cdf2: Pushed
5ad0635534b2: Pushed
a10a5ca025ab: Pushed
1569d19b9400: Pushed
ef42f7edc6d2: Pushed
6c18b8a563b7: Pushed
3956d2bc278c: Pushed
957835cae4b0: Pushed
9fcc2003c8cd: Pushed
c547162c87c8: Pushed
89d6344d2aa8: Layer already exists
404130ce4519: Layer already exists
17cdb8503b04: Layer already exists
999e063f6898: Pushed
1cad4dc57058: Layer already exists
4ff8844d474a: Layer already exists
b77487480ddb: Layer already exists
cfdd5c3bd77e: Layer already exists
cd247c0fb37b: Layer already exists
870a241bfebd: Layer already exists
edf3f3272f6e: Pushed
9199448ea870: Pushed
ba129a49bb2f: Pushed
20221207215340: digest:
sha256:c6363583e93f715c247d7055664e7616282f84b895bfee2fb5beb552c3fcba44 size:
5156
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 34637
Launching Python expansion service @ 40541
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.sdk.extensions.python.transforms.DataframeTransformTest >
testDataframeSum FAILED
java.lang.RuntimeException at TestDataflowRunner.java:141
16 tests completed, 1 failed, 2 skipped
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221207215340
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6363583e93f715c247d7055664e7616282f84b895bfee2fb5beb552c3fcba44
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221207215340]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6363583e93f715c247d7055664e7616282f84b895bfee2fb5beb552c3fcba44]
Deleted
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221207215340]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6363583e93f715c247d7055664e7616282f84b895bfee2fb5beb552c3fcba44])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6363583e93f715c247d7055664e7616282f84b895bfee2fb5beb552c3fcba44
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6363583e93f715c247d7055664e7616282f84b895bfee2fb5beb552c3fcba44
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c6363583e93f715c247d7055664e7616282f84b895bfee2fb5beb552c3fcba44].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221207215340
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7ce567d4aa3af9eaf2c561ff7267a29389f228dd0c6368fd46517f49ca4b548
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221207215340]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7ce567d4aa3af9eaf2c561ff7267a29389f228dd0c6368fd46517f49ca4b548]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221207215340]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7ce567d4aa3af9eaf2c561ff7267a29389f228dd0c6368fd46517f49ca4b548])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7ce567d4aa3af9eaf2c561ff7267a29389f228dd0c6368fd46517f49ca4b548
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7ce567d4aa3af9eaf2c561ff7267a29389f228dd0c6368fd46517f49ca4b548
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d7ce567d4aa3af9eaf2c561ff7267a29389f228dd0c6368fd46517f49ca4b548].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2972241.
Stopping expansion service pid: 2972242.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 41m 15s
174 actionable tasks: 25 executed, 149 up-to-date
Publishing build scan...
https://gradle.com/s/gfevi3up2kum4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
