See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/2498/display/redirect>
Changes: ------------------------------------------ [...truncated 1.58 MB...] #9 354.0 google-resumable-media==2.6.0 #9 354.0 googleapis-common-protos==1.60.0 #9 354.0 greenlet==2.0.2 #9 354.0 grpc-google-iam-v1==0.12.6 #9 354.0 grpcio==1.58.0 #9 354.0 grpcio-status==1.58.0 #9 354.0 guppy3==3.1.3 #9 354.0 hdfs==2.7.2 #9 354.0 httplib2==0.22.0 #9 354.0 hypothesis==6.87.0 #9 354.0 idna==3.4 #9 354.0 iniconfig==2.0.0 #9 354.0 joblib==1.3.2 #9 354.0 Js2Py==0.74 #9 354.0 mmh3==4.0.1 #9 354.0 mock==5.1.0 #9 354.0 nltk==3.8.1 #9 354.0 nose==1.3.7 #9 354.0 numpy==1.24.4 #9 354.0 oauth2client==4.1.3 #9 354.0 objsize==0.6.1 #9 354.0 orjson==3.9.7 #9 354.0 overrides==6.5.0 #9 354.0 packaging==23.1 #9 354.0 pandas==1.5.3 #9 354.0 parameterized==0.9.0 #9 354.0 pip==23.2.1 #9 354.0 pluggy==1.3.0 #9 354.0 proto-plus==1.22.3 #9 354.0 protobuf==4.24.3 #9 354.0 psycopg2-binary==2.9.7 #9 354.0 pyarrow==11.0.0 #9 354.0 pyasn1==0.5.0 #9 354.0 pyasn1-modules==0.3.0 #9 354.0 pycparser==2.21 #9 354.0 pydot==1.4.2 #9 354.0 PyHamcrest==2.0.4 #9 354.0 pyjsparser==2.7.1 #9 354.0 pymongo==4.5.0 #9 354.0 PyMySQL==1.1.0 #9 354.0 pyparsing==3.1.1 #9 354.0 pytest==7.4.2 #9 354.0 pytest-timeout==2.1.0 #9 354.0 pytest-xdist==3.3.1 #9 354.0 python-dateutil==2.8.2 #9 354.0 pytz==2023.3.post1 #9 354.0 PyYAML==6.0.1 #9 354.0 regex==2023.8.8 #9 354.0 requests==2.31.0 #9 354.0 requests-mock==1.11.0 #9 354.0 rsa==4.9 #9 354.0 scikit-learn==1.3.1 #9 354.0 scipy==1.11.2 #9 354.0 setuptools==68.2.2 #9 354.0 Shapely==1.8.5.post1 #9 354.0 six==1.16.0 #9 354.0 sortedcontainers==2.4.0 #9 354.0 soupsieve==2.5 #9 354.0 SQLAlchemy==1.4.49 #9 354.0 sqlparse==0.4.4 #9 354.0 tenacity==8.2.3 #9 354.0 testcontainers==3.7.1 #9 354.0 threadpoolctl==3.2.0 #9 354.0 tqdm==4.66.1 #9 354.0 typing_extensions==4.8.0 #9 354.0 tzlocal==5.0.1 #9 354.0 urllib3==1.26.16 #9 354.0 websocket-client==1.6.3 #9 354.0 wheel==0.41.2 #9 354.0 wrapt==1.15.0 #9 354.0 zstandard==0.21.0 #9 DONE 355.5s #10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #10 DONE 0.1s #11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #11 DONE 0.1s #12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #12 DONE 0.1s #13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #13 0.996 Collecting pip-licenses<5 #13 0.996 Obtaining dependency information for pip-licenses<5 from https://files.pythonhosted.org/packages/90/73/d5260c7bd4bfa8d32972e1a8fdec957b999b0a6a8736913fcd8f8d254d25/pip_licenses-4.3.3-py3-none-any.whl.metadata #13 1.058 Downloading pip_licenses-4.3.3-py3-none-any.whl.metadata (31 kB) #13 1.074 Requirement already satisfied: pyyaml in /usr/local/lib/python3.11/site-packages (6.0.1) #13 1.075 Requirement already satisfied: tenacity in /usr/local/lib/python3.11/site-packages (8.2.3) #13 1.123 Collecting prettytable>=2.3.0 (from pip-licenses<5) #13 1.123 Obtaining dependency information for prettytable>=2.3.0 from https://files.pythonhosted.org/packages/4d/81/316b6a55a0d1f327d04cc7b0ba9d04058cb62de6c3a4d4b0df280cbe3b0b/prettytable-3.9.0-py3-none-any.whl.metadata #13 1.138 Downloading prettytable-3.9.0-py3-none-any.whl.metadata (26 kB) #13 1.190 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5) #13 1.190 Obtaining dependency information for wcwidth from https://files.pythonhosted.org/packages/58/19/a9ce39f89cf58cf1e7ce01c8bb76ab7e2c7aadbc5a2136c3e192097344f5/wcwidth-0.2.8-py2.py3-none-any.whl.metadata #13 1.205 Downloading wcwidth-0.2.8-py2.py3-none-any.whl.metadata (13 kB) #13 1.229 Downloading pip_licenses-4.3.3-py3-none-any.whl (20 kB) #13 1.249 Downloading prettytable-3.9.0-py3-none-any.whl (27 kB) #13 1.268 Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB) #13 2.408 Installing collected packages: wcwidth, prettytable, pip-licenses #13 2.535 Successfully installed pip-licenses-4.3.3 prettytable-3.9.0 wcwidth-0.2.8 #13 2.536 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #13 13.65 INFO:root:Successfully pulled licenses for 111 dependencies #13 13.65 Skip pulling license for bs4 #13 DONE 13.7s #14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #14 DONE 0.1s #15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #15 DONE 0.4s #16 exporting to image #16 exporting layers #16 exporting layers 13.4s done #16 writing image sha256:7895b99378d1fdea58c9240466036a809c69bfb043d036e796bb3478f63a7551 done #16 naming to docker.io/apache/beam_python3.11_sdk:2.52.0.dev done #16 DONE 13.4s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 144d679c945a: Preparing 1daa9d707eb3: Preparing 80c6e4571637: Preparing 7af83a0c6a90: Preparing dba1624cfe7c: Preparing 81d37bebecae: Preparing 555a3c07bae9: Preparing ec8e9a19a69d: Preparing e54ced030aa1: Preparing bfc6c51b6add: Preparing 2f1b637d38f5: Preparing 09ca2e96f2e3: Preparing 54951a6a1cf0: Preparing 3500a0e921a9: Preparing 2f1b637d38f5: Waiting bfc6c51b6add: Waiting 09ca2e96f2e3: Waiting 81d37bebecae: Waiting 54951a6a1cf0: Waiting 3500a0e921a9: Waiting 555a3c07bae9: Waiting e54ced030aa1: Waiting ec8e9a19a69d: Waiting 1daa9d707eb3: Pushed dba1624cfe7c: Pushed 555a3c07bae9: Layer already exists ec8e9a19a69d: Layer already exists e54ced030aa1: Layer already exists bfc6c51b6add: Layer already exists 2f1b637d38f5: Layer already exists 09ca2e96f2e3: Layer already exists 54951a6a1cf0: Layer already exists 3500a0e921a9: Layer already exists 144d679c945a: Pushed 7af83a0c6a90: Pushed 81d37bebecae: Pushed 80c6e4571637: Pushed 20231015034205: digest: sha256:494b1ba1c22f6c805c92b36d658aa900949a510200cd314195dbcb3868483d65 size: 3267 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 34083 Launching Python expansion service @ 36563 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython INFO:root:No image given, using default Python SDK image INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment INFO:__main__:Listening for expansion requests at 39231 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp61npbfdb/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64'] INFO:root:No image given, using default Python SDK image INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment INFO:__main__:Listening for expansion requests at 42407 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonFlatMap FAILED java.lang.RuntimeException at PythonMapTest.java:54 Caused by: java.io.IOException at PythonMapTest.java:54 java.lang.NullPointerException at Preconditions.java:1010 org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInference FAILED java.lang.RuntimeException at RunInferenceTransformTest.java:60 Caused by: java.io.IOException at RunInferenceTransformTest.java:60 java.lang.NullPointerException at Preconditions.java:1010 16 tests completed, 2 failed > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231015034205 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:494b1ba1c22f6c805c92b36d658aa900949a510200cd314195dbcb3868483d65 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231015034205] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:494b1ba1c22f6c805c92b36d658aa900949a510200cd314195dbcb3868483d65] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231015034205] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:494b1ba1c22f6c805c92b36d658aa900949a510200cd314195dbcb3868483d65])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:494b1ba1c22f6c805c92b36d658aa900949a510200cd314195dbcb3868483d65 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231015034205 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:72ab478b2989fbc5ca9c93dd114bc837c9b658fb4416df1cd32e7d05dda3e573 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231015034205] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:72ab478b2989fbc5ca9c93dd114bc837c9b658fb4416df1cd32e7d05dda3e573] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231015034205] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:72ab478b2989fbc5ca9c93dd114bc837c9b658fb4416df1cd32e7d05dda3e573])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:72ab478b2989fbc5ca9c93dd114bc837c9b658fb4416df1cd32e7d05dda3e573 > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 2734869. Stopping expansion service pid: 2734870. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 26m 38s 180 actionable tasks: 25 executed, 155 up-to-date Publishing build scan... https://ge.apache.org/s/js3wusd5e3kz6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
