See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/2200/display/redirect?page=changes>
Changes: [noreply] fix: fix segment reader and update bigtable emulator version (#27779) ------------------------------------------ [...truncated 667.89 KB...] #9 603.3 hypothesis==6.81.1 #9 603.3 idna==3.4 #9 603.3 importlib-metadata==6.8.0 #9 603.3 iniconfig==2.0.0 #9 603.3 joblib==1.3.1 #9 603.3 keras==2.13.1 #9 603.3 libclang==16.0.0 #9 603.3 Markdown==3.4.3 #9 603.3 MarkupSafe==2.1.3 #9 603.3 mmh3==4.0.0 #9 603.3 mock==5.1.0 #9 603.3 nltk==3.8.1 #9 603.3 nose==1.3.7 #9 603.3 numpy==1.24.3 #9 603.3 oauth2client==4.1.3 #9 603.3 oauthlib==3.2.2 #9 603.3 objsize==0.6.1 #9 603.3 opt-einsum==3.3.0 #9 603.3 orjson==3.9.2 #9 603.3 overrides==6.5.0 #9 603.3 packaging==23.1 #9 603.3 pandas==1.5.3 #9 603.3 parameterized==0.9.0 #9 603.3 pip==23.0.1 #9 603.3 pluggy==1.2.0 #9 603.3 proto-plus==1.22.3 #9 603.3 protobuf==4.23.4 #9 603.3 psycopg2-binary==2.9.6 #9 603.3 pyarrow==11.0.0 #9 603.3 pyasn1==0.5.0 #9 603.3 pyasn1-modules==0.3.0 #9 603.3 pycparser==2.21 #9 603.3 pydot==1.4.2 #9 603.3 PyHamcrest==2.0.4 #9 603.3 pymongo==4.4.1 #9 603.3 PyMySQL==1.1.0 #9 603.3 pyparsing==3.1.0 #9 603.3 pytest==7.4.0 #9 603.3 pytest-timeout==2.1.0 #9 603.3 pytest-xdist==3.3.1 #9 603.3 python-dateutil==2.8.2 #9 603.3 python-snappy==0.6.1 #9 603.3 pytz==2023.3 #9 603.3 PyYAML==6.0 #9 603.3 regex==2023.6.3 #9 603.3 requests==2.31.0 #9 603.3 requests-mock==1.11.0 #9 603.3 requests-oauthlib==1.3.1 #9 603.3 rsa==4.9 #9 603.3 scikit-learn==1.3.0 #9 603.3 scipy==1.10.1 #9 603.3 setuptools==68.0.0 #9 603.3 Shapely==1.8.5.post1 #9 603.3 six==1.16.0 #9 603.3 sortedcontainers==2.4.0 #9 603.3 soupsieve==2.4.1 #9 603.3 SQLAlchemy==1.4.49 #9 603.3 sqlparse==0.4.4 #9 603.3 tenacity==8.2.2 #9 603.3 tensorboard==2.13.0 #9 603.3 tensorboard-data-server==0.7.1 #9 603.3 tensorflow==2.13.0 #9 603.3 tensorflow-estimator==2.13.0 #9 603.3 tensorflow-io-gcs-filesystem==0.32.0 #9 603.3 termcolor==2.3.0 #9 603.3 testcontainers==3.7.1 #9 603.3 threadpoolctl==3.2.0 #9 603.3 tomli==2.0.1 #9 603.3 tqdm==4.65.0 #9 603.3 typing_extensions==4.5.0 #9 603.3 uritemplate==4.1.1 #9 603.3 urllib3==1.26.16 #9 603.3 websocket-client==1.6.1 #9 603.3 Werkzeug==2.3.6 #9 603.3 wheel==0.41.0 #9 603.3 wrapt==1.15.0 #9 603.3 zipp==3.16.1 #9 603.3 zstandard==0.21.0 #9 DONE 604.7s #10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #10 DONE 0.3s #11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #11 DONE 0.1s #12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #12 DONE 0.1s #13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #13 3.675 Collecting pip-licenses<5 #13 3.777 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB) #13 3.800 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0) #13 3.802 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2) #13 3.967 Collecting prettytable>=2.3.0 #13 3.989 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB) #13 4.134 Collecting wcwidth #13 4.160 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #13 8.664 Installing collected packages: wcwidth, prettytable, pip-licenses #13 10.72 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6 #13 10.72 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #13 11.58 #13 11.58 [notice] A new release of pip is available: 23.0.1 -> 23.2.1 #13 11.58 [notice] To update, run: pip install --upgrade pip #13 27.39 INFO:root:Successfully pulled licenses for 137 dependencies #13 27.39 Skip pulling license for bs4 #13 DONE 27.5s #14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #14 DONE 0.2s #15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #15 DONE 2.5s #16 exporting to image #16 exporting layers #16 exporting layers 52.3s done #16 writing image sha256:18e2d31e2937f8522c843ab69a8eea4b4fd18ad22035a3a9ab964e2381b3f65c done #16 naming to docker.io/apache/beam_python3.8_sdk:2.50.0.dev done #16 DONE 52.4s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 46f6625b6021: Preparing 4fa9d883fc20: Preparing 0582c74eb3af: Preparing 0d097fbfcb2c: Preparing 6b97a309b0cc: Preparing 8fa3d9856096: Preparing 77e1f2fba20a: Preparing 2eaa4ad2751a: Preparing f9f5dc620ebf: Preparing 801d9ec76403: Preparing 4bae804cfcdc: Preparing 891fa86dfd1d: Preparing 4438bc41581a: Preparing f370a05d981b: Preparing 8fa3d9856096: Waiting 77e1f2fba20a: Waiting 2eaa4ad2751a: Waiting f9f5dc620ebf: Waiting 801d9ec76403: Waiting 4bae804cfcdc: Waiting 891fa86dfd1d: Waiting 4438bc41581a: Waiting f370a05d981b: Waiting 46f6625b6021: Pushed 4fa9d883fc20: Pushed 77e1f2fba20a: Layer already exists 6b97a309b0cc: Pushed 2eaa4ad2751a: Layer already exists f9f5dc620ebf: Layer already exists 801d9ec76403: Layer already exists 4bae804cfcdc: Layer already exists 891fa86dfd1d: Layer already exists 4438bc41581a: Layer already exists f370a05d981b: Layer already exists 8fa3d9856096: Pushed 0d097fbfcb2c: Pushed 0582c74eb3af: Pushed 20230801151402: digest: sha256:9f6aa94b17e8437e2d762e20b6f5494de9bf9e32e7531c23cbf70b267a924466 size: 3268 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 41147 Launching Python expansion service @ 44799 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython org.apache.beam.sdk.extensions.python.PythonExternalTransformTest > trivialPythonTransform FAILED java.lang.RuntimeException at PythonExternalTransformTest.java:58 Caused by: java.util.concurrent.TimeoutException at PythonExternalTransformTest.java:58 INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.49.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpmfjlu9yk/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64'] INFO:root:No image given, using default Python SDK image INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.49.0" for Docker environment INFO:__main__:Listening for expansion requests at 42875 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. 16 tests completed, 1 failed > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230801151402 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f6aa94b17e8437e2d762e20b6f5494de9bf9e32e7531c23cbf70b267a924466 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230801151402] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f6aa94b17e8437e2d762e20b6f5494de9bf9e32e7531c23cbf70b267a924466] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230801151402] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f6aa94b17e8437e2d762e20b6f5494de9bf9e32e7531c23cbf70b267a924466])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9f6aa94b17e8437e2d762e20b6f5494de9bf9e32e7531c23cbf70b267a924466 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230801151402 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d0e6455e68e5c1da55fa8e716905ad0618521419fefa63b434fb644e2c51d2 Deleted: sha256:be7097f6ebcd0dc12904ed59ed38b454bef67b6bfc07a2ce7a97662fbf0edded WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230801151402] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d0e6455e68e5c1da55fa8e716905ad0618521419fefa63b434fb644e2c51d2] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230801151402] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d0e6455e68e5c1da55fa8e716905ad0618521419fefa63b434fb644e2c51d2])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c7d0e6455e68e5c1da55fa8e716905ad0618521419fefa63b434fb644e2c51d2 > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 2475138. Stopping expansion service pid: 2475139. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 47m 27s 195 actionable tasks: 134 executed, 55 from cache, 6 up-to-date Publishing build scan... https://ge.apache.org/s/lurmbvl6xaehc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
