See 
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/886/display/redirect?page=changes>

Changes:

[noreply] Allow users to pass classloader to dynamically load JDBC drivers.

[noreply] Fix withCheckStopReadingFn to not cause the pipeline to crash (#22962)

[noreply] Inference benchmark tests (#21738)

[noreply] [Go SDK]: Add support for Google Cloud Profiler for pipelines (#22824)


------------------------------------------
[...truncated 534.21 KB...]
SQLAlchemy==1.4.39
tenacity==5.1.5
tensorboard==2.9.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.9.1
tensorflow-estimator==2.9.0
tensorflow-io-gcs-filesystem==0.26.0
termcolor==1.1.0
testcontainers==3.6.0
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.0
typing-utils==0.1.0
typing_extensions==4.3.0
uritemplate==4.1.1
urllib3==1.26.11
websocket-client==1.3.3
Werkzeug==2.2.1
wheel==0.37.1
wrapt==1.14.1
zipp==3.8.1
zstandard==0.18.0
Removing intermediate container aab8a6bcb752
 ---> d4bbeea9cbc8
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
 ---> 14fefb005eee
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
 ---> e6871670a23a
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
 ---> ce11d5698f84
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> f9926d4a02c1
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in c51a77f25210
Removing intermediate container c51a77f25210
 ---> d8f25a0ca92a
Step 22/32 : FROM beam as third_party_licenses
 ---> d8f25a0ca92a
Step 23/32 : ARG pull_licenses
 ---> Running in 537280ffa551
Removing intermediate container 537280ffa551
 ---> 114762288c11
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> 80f5c848e956
Step 25/32 : COPY target/LICENSE target/go-licenses/* 
/opt/apache/beam/third_party_licenses/golang/
 ---> 234fb464a989
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 725a941b9528
Removing intermediate container 725a941b9528
 ---> cb71596813e0
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
 ---> 809faf15e464
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 
'pip-licenses<4.0.0' pyyaml tenacity &&       python 
/tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 5ea5dd5d6606
Collecting pip-licenses<4.0.0
  Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages 
(6.0)
Requirement already satisfied: tenacity in 
/usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in 
/usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 
sha256=8deaa1829d58edaee44de650315c0884166e1282115936bcaacc6f2cd2dac4ac
  Stored in directory: 
/root/.cache/pip/wheels/33/df/2f/674985b3f8a2de3f96357d1eadef5110f74fa91b3785e52a54
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.4
WARNING: Running pip as the 'root' user can result in broken permissions 
and conflicting behaviour with the system package manager. It is recommended to 
use a virtual environment instead: https://pip.pypa.io/warnings/venv
Skip pulling license for  bs4
INFO:root:Successfully pulled licenses for 136 dependencies
Removing intermediate container 5ea5dd5d6606
 ---> 10f566b2fde1
Step 29/32 : FROM beam
 ---> d8f25a0ca92a
Step 30/32 : ARG pull_licenses
 ---> Running in 91d9879a6ef7
Removing intermediate container 91d9879a6ef7
 ---> 6d04bf0d28ff
Step 31/32 : COPY --from=third_party_licenses 
/opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
 ---> 8f3118e9695c
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then       rm -rf 
/opt/apache/beam/third_party_licenses ;     fi
 ---> Running in 21248acb65f8
Removing intermediate container 21248acb65f8
 ---> b48fce1e3731
Successfully built b48fce1e3731
Successfully tagged apache/beam_python3.7_sdk:2.42.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 
18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: 
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python]
e8251af1c7f0: Preparing
68187977b184: Preparing
ec199aefdee6: Preparing
fc2bad53e207: Preparing
081f85ee53be: Preparing
8e9ecff2104b: Preparing
bafc5a16b439: Preparing
6b805b0b9e56: Preparing
98ff04b00e70: Preparing
29bc6b6c4ab3: Preparing
90ef32a5f866: Preparing
0f0d59a69967: Preparing
5fdb4ab7cc29: Preparing
9163743e9793: Preparing
bd2aedacc58f: Preparing
0d858d352b03: Preparing
76bc459f764a: Preparing
100796cdf3b1: Preparing
54acb5a6fa0b: Preparing
8d51c618126f: Preparing
9ff6e4d46744: Preparing
a89d1d47b5a1: Preparing
8e9ecff2104b: Waiting
655ed1b7a428: Preparing
98ff04b00e70: Waiting
6b805b0b9e56: Waiting
bafc5a16b439: Waiting
8d51c618126f: Waiting
5fdb4ab7cc29: Waiting
0d858d352b03: Waiting
0f0d59a69967: Waiting
29bc6b6c4ab3: Waiting
90ef32a5f866: Waiting
9163743e9793: Waiting
9ff6e4d46744: Waiting
a89d1d47b5a1: Waiting
76bc459f764a: Waiting
bd2aedacc58f: Waiting
54acb5a6fa0b: Waiting
100796cdf3b1: Waiting
ec199aefdee6: Pushed
fc2bad53e207: Pushed
e8251af1c7f0: Pushed
081f85ee53be: Pushed
68187977b184: Pushed
6b805b0b9e56: Pushed
98ff04b00e70: Pushed
bafc5a16b439: Pushed
5fdb4ab7cc29: Pushed
9163743e9793: Pushed
bd2aedacc58f: Layer already exists
90ef32a5f866: Pushed
0d858d352b03: Layer already exists
76bc459f764a: Layer already exists
100796cdf3b1: Layer already exists
54acb5a6fa0b: Layer already exists
9ff6e4d46744: Layer already exists
8d51c618126f: Layer already exists
a89d1d47b5a1: Layer already exists
655ed1b7a428: Layer already exists
8e9ecff2104b: Pushed
29bc6b6c4ab3: Pushed
0f0d59a69967: Pushed
20220906150940: digest: 
sha256:1468ff0a042671dda78185fe59676fe428c1521187f6ff87586bcca3a9e24a45 size: 
5156

> Task :runners:google-cloud-dataflow-java:setupXVR

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 39101
Launching Python expansion service @ 37065

> Task 
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython

org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > 
testRunInferenceWithKVs FAILED
    java.lang.IllegalStateException at RunInferenceTransformTest.java:108
    java.lang.NullPointerException at Preconditions.java:980

org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > 
testRunInference FAILED
    java.lang.IllegalStateException at RunInferenceTransformTest.java:60
    java.lang.NullPointerException at Preconditions.java:980

16 tests completed, 2 failed, 2 skipped

> Task 
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython
>  FAILED

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 833237.
Stopping expansion service pid: 833238.

> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE

> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906150940
Untagged: 
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1468ff0a042671dda78185fe59676fe428c1521187f6ff87586bcca3a9e24a45
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906150940]
- referencing digest: 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1468ff0a042671dda78185fe59676fe428c1521187f6ff87586bcca3a9e24a45]

Deleted 
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906150940] 
(referencing 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1468ff0a042671dda78185fe59676fe428c1521187f6ff87586bcca3a9e24a45])].
Removing untagged image 
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1468ff0a042671dda78185fe59676fe428c1521187f6ff87586bcca3a9e24a45
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1468ff0a042671dda78185fe59676fe428c1521187f6ff87586bcca3a9e24a45
Deleted 
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1468ff0a042671dda78185fe59676fe428c1521187f6ff87586bcca3a9e24a45].

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906150940
Untagged: 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22d0742e39c8299df3ea7d5a19e484f88b649bc327a3442817b3a2966540a8ed
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906150940]
- referencing digest: 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22d0742e39c8299df3ea7d5a19e484f88b649bc327a3442817b3a2966540a8ed]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906150940] 
(referencing 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22d0742e39c8299df3ea7d5a19e484f88b649bc327a3442817b3a2966540a8ed])].
Removing untagged image 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22d0742e39c8299df3ea7d5a19e484f88b649bc327a3442817b3a2966540a8ed
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22d0742e39c8299df3ea7d5a19e484f88b649bc327a3442817b3a2966540a8ed
Deleted 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:22d0742e39c8299df3ea7d5a19e484f88b649bc327a3442817b3a2966540a8ed].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task 
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: 
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

See 
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during 
this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 38m 23s
184 actionable tasks: 121 executed, 57 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/hyxrhoy6tmc7q

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to