See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/2470/display/redirect>
Changes: ------------------------------------------ [...truncated 1.28 MB...] #9 321.9 google-cloud-resource-manager==1.10.4 #9 321.9 google-cloud-spanner==3.40.1 #9 321.9 google-cloud-storage==2.11.0 #9 321.9 google-cloud-videointelligence==2.11.4 #9 321.9 google-cloud-vision==3.4.4 #9 321.9 google-crc32c==1.5.0 #9 321.9 google-resumable-media==2.6.0 #9 321.9 googleapis-common-protos==1.60.0 #9 321.9 greenlet==2.0.2 #9 321.9 grpc-google-iam-v1==0.12.6 #9 321.9 grpcio==1.58.0 #9 321.9 grpcio-status==1.58.0 #9 321.9 guppy3==3.1.3 #9 321.9 hdfs==2.7.2 #9 321.9 httplib2==0.22.0 #9 321.9 hypothesis==6.87.0 #9 321.9 idna==3.4 #9 321.9 iniconfig==2.0.0 #9 321.9 joblib==1.3.2 #9 321.9 Js2Py==0.74 #9 321.9 mmh3==4.0.1 #9 321.9 mock==5.1.0 #9 321.9 nltk==3.8.1 #9 321.9 nose==1.3.7 #9 321.9 numpy==1.24.4 #9 321.9 oauth2client==4.1.3 #9 321.9 objsize==0.6.1 #9 321.9 orjson==3.9.7 #9 321.9 overrides==6.5.0 #9 321.9 packaging==23.1 #9 321.9 pandas==1.5.3 #9 321.9 parameterized==0.9.0 #9 321.9 pip==23.2.1 #9 321.9 pluggy==1.3.0 #9 321.9 proto-plus==1.22.3 #9 321.9 protobuf==4.24.3 #9 321.9 psycopg2-binary==2.9.7 #9 321.9 pyarrow==11.0.0 #9 321.9 pyasn1==0.5.0 #9 321.9 pyasn1-modules==0.3.0 #9 321.9 pycparser==2.21 #9 321.9 pydot==1.4.2 #9 321.9 PyHamcrest==2.0.4 #9 321.9 pyjsparser==2.7.1 #9 321.9 pymongo==4.5.0 #9 321.9 PyMySQL==1.1.0 #9 321.9 pyparsing==3.1.1 #9 321.9 pytest==7.4.2 #9 321.9 pytest-timeout==2.1.0 #9 321.9 pytest-xdist==3.3.1 #9 321.9 python-dateutil==2.8.2 #9 321.9 pytz==2023.3.post1 #9 321.9 PyYAML==6.0.1 #9 321.9 regex==2023.8.8 #9 321.9 requests==2.31.0 #9 321.9 requests-mock==1.11.0 #9 321.9 rsa==4.9 #9 321.9 scikit-learn==1.3.1 #9 321.9 scipy==1.11.2 #9 321.9 setuptools==68.2.2 #9 321.9 Shapely==1.8.5.post1 #9 321.9 six==1.16.0 #9 321.9 sortedcontainers==2.4.0 #9 321.9 soupsieve==2.5 #9 321.9 SQLAlchemy==1.4.49 #9 321.9 sqlparse==0.4.4 #9 321.9 tenacity==8.2.3 #9 321.9 testcontainers==3.7.1 #9 321.9 threadpoolctl==3.2.0 #9 321.9 tqdm==4.66.1 #9 321.9 typing_extensions==4.8.0 #9 321.9 tzlocal==5.0.1 #9 321.9 urllib3==1.26.16 #9 321.9 websocket-client==1.6.3 #9 321.9 wheel==0.41.2 #9 321.9 wrapt==1.15.0 #9 321.9 zstandard==0.21.0 #9 DONE 323.2s #10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #10 DONE 0.1s #11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #11 DONE 0.1s #12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #12 DONE 0.1s #13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #13 1.018 Collecting pip-licenses<5 #13 1.019 Obtaining dependency information for pip-licenses<5 from https://files.pythonhosted.org/packages/90/73/d5260c7bd4bfa8d32972e1a8fdec957b999b0a6a8736913fcd8f8d254d25/pip_licenses-4.3.3-py3-none-any.whl.metadata #13 1.080 Downloading pip_licenses-4.3.3-py3-none-any.whl.metadata (31 kB) #13 1.096 Requirement already satisfied: pyyaml in /usr/local/lib/python3.11/site-packages (6.0.1) #13 1.097 Requirement already satisfied: tenacity in /usr/local/lib/python3.11/site-packages (8.2.3) #13 1.143 Collecting prettytable>=2.3.0 (from pip-licenses<5) #13 1.144 Obtaining dependency information for prettytable>=2.3.0 from https://files.pythonhosted.org/packages/4d/81/316b6a55a0d1f327d04cc7b0ba9d04058cb62de6c3a4d4b0df280cbe3b0b/prettytable-3.9.0-py3-none-any.whl.metadata #13 1.159 Downloading prettytable-3.9.0-py3-none-any.whl.metadata (26 kB) #13 1.209 Collecting wcwidth (from prettytable>=2.3.0->pip-licenses<5) #13 1.210 Obtaining dependency information for wcwidth from https://files.pythonhosted.org/packages/58/19/a9ce39f89cf58cf1e7ce01c8bb76ab7e2c7aadbc5a2136c3e192097344f5/wcwidth-0.2.8-py2.py3-none-any.whl.metadata #13 1.223 Downloading wcwidth-0.2.8-py2.py3-none-any.whl.metadata (13 kB) #13 1.248 Downloading pip_licenses-4.3.3-py3-none-any.whl (20 kB) #13 1.279 Downloading prettytable-3.9.0-py3-none-any.whl (27 kB) #13 1.296 Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB) #13 2.440 Installing collected packages: wcwidth, prettytable, pip-licenses #13 2.563 Successfully installed pip-licenses-4.3.3 prettytable-3.9.0 wcwidth-0.2.8 #13 2.563 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #13 13.45 INFO:root:Successfully pulled licenses for 111 dependencies #13 13.45 Skip pulling license for bs4 #13 DONE 13.5s #14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #14 DONE 0.1s #15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #15 DONE 0.3s #16 exporting to image #16 exporting layers #16 exporting layers 13.1s done #16 writing image sha256:906a2c8722c6aa1fdf464530659d0cf865f4f9da9f25360493d3a0f1eab9bf12 done #16 naming to docker.io/apache/beam_python3.11_sdk:2.52.0.dev done #16 DONE 13.1s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] b02df18b8220: Preparing c4133ce14acc: Preparing f8a39804c92f: Preparing 8df5bdb438ae: Preparing 5bf3f429a5c8: Preparing 19fddc3d9b14: Preparing 4150bc52c071: Preparing 7e74799b7d41: Preparing c8a297463a78: Preparing 6db4cf9c31a6: Preparing 172b32107611: Preparing b237bc5a2ac8: Preparing dcbfd799de9c: Preparing 8a5350ad66cb: Preparing 6db4cf9c31a6: Waiting 19fddc3d9b14: Waiting 172b32107611: Waiting 4150bc52c071: Waiting b237bc5a2ac8: Waiting c8a297463a78: Waiting 7e74799b7d41: Waiting 8a5350ad66cb: Waiting c4133ce14acc: Pushed 5bf3f429a5c8: Pushed 4150bc52c071: Layer already exists 7e74799b7d41: Layer already exists c8a297463a78: Layer already exists b02df18b8220: Pushed 6db4cf9c31a6: Layer already exists 172b32107611: Layer already exists b237bc5a2ac8: Layer already exists dcbfd799de9c: Layer already exists 8a5350ad66cb: Layer already exists 8df5bdb438ae: Pushed 19fddc3d9b14: Pushed f8a39804c92f: Pushed 20231008034131: digest: sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1 size: 3267 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 36551 Launching Python expansion service @ 43155 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython INFO:root:No image given, using default Python SDK image INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment INFO:__main__:Listening for expansion requests at 35039 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0rc1-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmprbb3rdt2/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64'] INFO:root:No image given, using default Python SDK image INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment INFO:__main__:Listening for expansion requests at 38331 INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner. INFO:__main__:Shutting down expansion service. > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonFlatMap FAILED java.lang.RuntimeException at PythonMapTest.java:54 Caused by: java.io.IOException at PythonMapTest.java:54 java.lang.NullPointerException at Preconditions.java:1010 16 tests completed, 1 failed > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231008034131 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231008034131] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20231008034131] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ead48c78e7915fb363bc9df1410c8c996d4e9836de5d2db5897272f1773326c1 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231008034131 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04d6760f8d97da951b1bfb3380dff346ccbe631936a3446eef4dcab8ab4b0f53 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231008034131] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04d6760f8d97da951b1bfb3380dff346ccbe631936a3446eef4dcab8ab4b0f53] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20231008034131] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04d6760f8d97da951b1bfb3380dff346ccbe631936a3446eef4dcab8ab4b0f53])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:04d6760f8d97da951b1bfb3380dff346ccbe631936a3446eef4dcab8ab4b0f53 > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 518506. Stopping expansion service pid: 518507. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 31m 180 actionable tasks: 25 executed, 155 up-to-date Publishing build scan... https://ge.apache.org/s/psrwstbmqzjni Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
