See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/2152/display/redirect?page=changes>
Changes: [noreply] Update releases 2.33.0 and 2.34.0 to include broken BQ copy jobs in ------------------------------------------ [...truncated 1.27 MB...] #9 420.0 proto-plus==1.22.3 #9 420.0 protobuf==4.23.4 #9 420.0 psycopg2-binary==2.9.6 #9 420.0 pyarrow==11.0.0 #9 420.0 pyasn1==0.5.0 #9 420.0 pyasn1-modules==0.3.0 #9 420.0 pycparser==2.21 #9 420.0 pydot==1.4.2 #9 420.0 PyHamcrest==2.0.4 #9 420.0 pymongo==4.4.1 #9 420.0 PyMySQL==1.1.0 #9 420.0 pyparsing==3.1.0 #9 420.0 pytest==7.4.0 #9 420.0 pytest-timeout==2.1.0 #9 420.0 pytest-xdist==3.3.1 #9 420.0 python-dateutil==2.8.2 #9 420.0 pytz==2023.3 #9 420.0 PyYAML==6.0 #9 420.0 regex==2023.6.3 #9 420.0 requests==2.31.0 #9 420.0 requests-mock==1.11.0 #9 420.0 requests-oauthlib==1.3.1 #9 420.0 rsa==4.9 #9 420.0 scikit-learn==1.3.0 #9 420.0 scipy==1.11.1 #9 420.0 setuptools==68.0.0 #9 420.0 Shapely==1.8.5.post1 #9 420.0 six==1.16.0 #9 420.0 sortedcontainers==2.4.0 #9 420.0 soupsieve==2.4.1 #9 420.0 SQLAlchemy==1.4.49 #9 420.0 sqlparse==0.4.4 #9 420.0 tenacity==8.2.2 #9 420.0 tensorboard==2.13.0 #9 420.0 tensorboard-data-server==0.7.1 #9 420.0 tensorflow==2.13.0 #9 420.0 tensorflow-estimator==2.13.0 #9 420.0 tensorflow-io-gcs-filesystem==0.32.0 #9 420.0 termcolor==2.3.0 #9 420.0 testcontainers==3.7.1 #9 420.0 threadpoolctl==3.2.0 #9 420.0 tqdm==4.65.0 #9 420.0 typing_extensions==4.5.0 #9 420.0 urllib3==1.26.16 #9 420.0 websocket-client==1.6.1 #9 420.0 Werkzeug==2.3.6 #9 420.0 wheel==0.40.0 #9 420.0 wrapt==1.15.0 #9 420.0 zstandard==0.21.0 #9 DONE 421.4s #10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #10 DONE 0.1s #11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #11 DONE 0.1s #12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #12 DONE 0.1s #13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #13 0.968 Collecting pip-licenses<5 #13 1.031 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB) #13 1.041 Requirement already satisfied: pyyaml in /usr/local/lib/python3.11/site-packages (6.0) #13 1.042 Requirement already satisfied: tenacity in /usr/local/lib/python3.11/site-packages (8.2.2) #13 1.090 Collecting prettytable>=2.3.0 (from pip-licenses<5) #13 1.105 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB) #13 1.155 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5) #13 1.169 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #13 2.302 Installing collected packages: wcwidth, prettytable, pip-licenses #13 2.421 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6 #13 2.422 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #13 2.689 #13 2.689 [notice] A new release of pip is available: 23.1.2 -> 23.2 #13 2.689 [notice] To update, run: pip install --upgrade pip #13 17.72 INFO:root:Successfully pulled licenses for 129 dependencies #13 17.72 Skip pulling license for bs4 #13 DONE 17.8s #14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #14 DONE 0.1s #15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #15 DONE 0.3s #16 exporting to image #16 exporting layers #16 exporting layers 22.0s done #16 writing image sha256:71f5d6dcf50c9b9b16c040e22fc6d82a6253aaceea361519a4712b38e692da8b 0.0s done #16 naming to docker.io/apache/beam_python3.11_sdk:2.50.0.dev done #16 DONE 22.0s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 02d549937aee: Preparing d326fe4cc23c: Preparing 10f9b2f21094: Preparing 5a5ce7b7f1f3: Preparing bf7ebf6d35c8: Preparing e349f30d7ef9: Preparing e7e0c6ab75a9: Preparing d362680a7e37: Preparing 71151acac3ee: Preparing 9f3a110198f0: Preparing 4e50dd34b02a: Preparing 7a08885b1c16: Preparing 42369e26e6d6: Preparing 3dec696a3faa: Preparing d362680a7e37: Waiting e349f30d7ef9: Waiting 9f3a110198f0: Waiting e7e0c6ab75a9: Waiting 4e50dd34b02a: Waiting 7a08885b1c16: Waiting 71151acac3ee: Waiting 3dec696a3faa: Waiting d326fe4cc23c: Pushed bf7ebf6d35c8: Pushed e7e0c6ab75a9: Layer already exists d362680a7e37: Layer already exists 71151acac3ee: Layer already exists 9f3a110198f0: Layer already exists 4e50dd34b02a: Layer already exists 7a08885b1c16: Layer already exists 42369e26e6d6: Layer already exists 3dec696a3faa: Layer already exists 5a5ce7b7f1f3: Pushed e349f30d7ef9: Pushed 02d549937aee: Pushed 10f9b2f21094: Pushed 20230720154320: digest: sha256:ef565a6badd2fb25867d52d7e02f162f8959d46c67488db75ffe2ab2531d8993 size: 3268 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 38653 Launching Python expansion service @ 44075 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython INFO:root:No image given, using default Python SDK image INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.49.0" for Docker environment INFO:__main__:Listening for expansion requests at 34317 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.49.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp0m3nbqic/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64'] INFO:root:No image given, using default Python SDK image INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.49.0" for Docker environment INFO:__main__:Listening for expansion requests at 37419 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInferenceWithKVs FAILED java.lang.RuntimeException at TestDataflowRunner.java:141 org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonMap FAILED java.lang.RuntimeException at TestDataflowRunner.java:141 org.apache.beam.sdk.extensions.python.transforms.DataframeTransformTest > testDataframeSum FAILED java.lang.RuntimeException at TestDataflowRunner.java:141 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED java.lang.RuntimeException at TestDataflowRunner.java:141 org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInference FAILED java.lang.RuntimeException at TestDataflowRunner.java:141 org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonFlatMap FAILED java.lang.RuntimeException at TestDataflowRunner.java:141 16 tests completed, 6 failed > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230720154320 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ef565a6badd2fb25867d52d7e02f162f8959d46c67488db75ffe2ab2531d8993 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230720154320] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ef565a6badd2fb25867d52d7e02f162f8959d46c67488db75ffe2ab2531d8993] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230720154320] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ef565a6badd2fb25867d52d7e02f162f8959d46c67488db75ffe2ab2531d8993])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ef565a6badd2fb25867d52d7e02f162f8959d46c67488db75ffe2ab2531d8993 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230720154320 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:97c5645df32a7d558893327a9224a47e137ae0ceb45643540f226a5305ee3374 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230720154320] > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 3907766. Stopping expansion service pid: 3907767. FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 302 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 41m 6s 185 actionable tasks: 25 executed, 160 up-to-date Publishing build scan... https://ge.apache.org/s/th72vckwjvcew Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
