See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6888/display/redirect>
Changes: ------------------------------------------ [...truncated 628.38 KB...] #9 399.0 google-cloud-pubsublite==1.8.3 #9 399.0 google-cloud-recommendations-ai==0.10.4 #9 399.0 google-cloud-resource-manager==1.10.3 #9 399.0 google-cloud-spanner==3.40.0 #9 399.0 google-cloud-storage==2.10.0 #9 399.0 google-cloud-videointelligence==2.11.3 #9 399.0 google-cloud-vision==3.4.4 #9 399.0 google-crc32c==1.5.0 #9 399.0 google-pasta==0.2.0 #9 399.0 google-resumable-media==2.5.0 #9 399.0 googleapis-common-protos==1.60.0 #9 399.0 greenlet==2.0.2 #9 399.0 grpc-google-iam-v1==0.12.6 #9 399.0 grpcio==1.56.2 #9 399.0 grpcio-status==1.56.2 #9 399.0 guppy3==3.1.3 #9 399.0 h5py==3.9.0 #9 399.0 hdfs==2.7.2 #9 399.0 httplib2==0.22.0 #9 399.0 hypothesis==6.82.3 #9 399.0 idna==3.4 #9 399.0 importlib-metadata==6.8.0 #9 399.0 iniconfig==2.0.0 #9 399.0 joblib==1.3.2 #9 399.0 keras==2.13.1 #9 399.0 libclang==16.0.6 #9 399.0 Markdown==3.4.4 #9 399.0 MarkupSafe==2.1.3 #9 399.0 mmh3==4.0.1 #9 399.0 mock==5.1.0 #9 399.0 nltk==3.8.1 #9 399.0 nose==1.3.7 #9 399.0 numpy==1.24.3 #9 399.0 oauth2client==4.1.3 #9 399.0 oauthlib==3.2.2 #9 399.0 objsize==0.6.1 #9 399.0 opt-einsum==3.3.0 #9 399.0 orjson==3.9.4 #9 399.0 overrides==6.5.0 #9 399.0 packaging==23.1 #9 399.0 pandas==1.5.3 #9 399.0 parameterized==0.9.0 #9 399.0 pip==23.0.1 #9 399.0 pluggy==1.2.0 #9 399.0 proto-plus==1.22.3 #9 399.0 protobuf==4.23.4 #9 399.0 psycopg2-binary==2.9.7 #9 399.0 pyarrow==11.0.0 #9 399.0 pyasn1==0.5.0 #9 399.0 pyasn1-modules==0.3.0 #9 399.0 pycparser==2.21 #9 399.0 pydot==1.4.2 #9 399.0 PyHamcrest==2.0.4 #9 399.0 pymongo==4.4.1 #9 399.0 PyMySQL==1.1.0 #9 399.0 pyparsing==3.1.1 #9 399.0 pytest==7.4.0 #9 399.0 pytest-timeout==2.1.0 #9 399.0 pytest-xdist==3.3.1 #9 399.0 python-dateutil==2.8.2 #9 399.0 python-snappy==0.6.1 #9 399.0 pytz==2023.3 #9 399.0 PyYAML==6.0.1 #9 399.0 regex==2023.8.8 #9 399.0 requests==2.31.0 #9 399.0 requests-mock==1.11.0 #9 399.0 requests-oauthlib==1.3.1 #9 399.0 rsa==4.9 #9 399.0 scikit-learn==1.3.0 #9 399.0 scipy==1.10.1 #9 399.0 setuptools==68.1.2 #9 399.0 Shapely==1.8.5.post1 #9 399.0 six==1.16.0 #9 399.0 sortedcontainers==2.4.0 #9 399.0 soupsieve==2.4.1 #9 399.0 SQLAlchemy==1.4.49 #9 399.0 sqlparse==0.4.4 #9 399.0 tenacity==8.2.2 #9 399.0 tensorboard==2.13.0 #9 399.0 tensorboard-data-server==0.7.1 #9 399.0 tensorflow==2.13.0 #9 399.0 tensorflow-estimator==2.13.0 #9 399.0 tensorflow-io-gcs-filesystem==0.33.0 #9 399.0 termcolor==2.3.0 #9 399.0 testcontainers==3.7.1 #9 399.0 threadpoolctl==3.2.0 #9 399.0 tomli==2.0.1 #9 399.0 tqdm==4.66.0 #9 399.0 typing_extensions==4.5.0 #9 399.0 uritemplate==4.1.1 #9 399.0 urllib3==1.26.16 #9 399.0 websocket-client==1.6.1 #9 399.0 Werkzeug==2.3.6 #9 399.0 wheel==0.41.2 #9 399.0 wrapt==1.15.0 #9 399.0 zipp==3.16.2 #9 399.0 zstandard==0.21.0 #9 DONE 400.2s #10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #10 DONE 0.0s #11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #11 DONE 0.1s #12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #12 DONE 0.1s #13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #13 1.041 Collecting pip-licenses<5 #13 1.095 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB) #13 1.104 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1) #13 1.104 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2) #13 1.208 Collecting prettytable>=2.3.0 #13 1.224 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB) #13 1.334 Collecting wcwidth #13 1.350 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #13 2.617 Installing collected packages: wcwidth, prettytable, pip-licenses #13 2.784 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6 #13 2.785 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #13 2.935 #13 2.935 [notice] A new release of pip is available: 23.0.1 -> 23.2.1 #13 2.935 [notice] To update, run: pip install --upgrade pip #13 11.65 Skip pulling license for bs4 #13 11.65 INFO:root:Successfully pulled licenses for 137 dependencies #13 DONE 11.7s #14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #14 DONE 0.1s #15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #15 DONE 0.4s #16 exporting to image #16 exporting layers #16 exporting layers 21.7s done #16 writing image sha256:d5ad68a14a20e3c580410d758c47e9dd32d3be438722e86e4ad9be00883a4a3b done #16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done #16 DONE 21.7s > Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:40899 INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f34f09dd940> ==================== INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f34f09dd9d0> ==================== INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f34f09de160> ==================== Traceback (most recent call last): File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py";,> line 111, in <module> run() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py";,> line 106, in run output | 'Write' >> WriteToText(known_args.output) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py";,> line 600, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py";,> line 577, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py";,> line 192, in run_pipeline return self.run_portable_pipeline( File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 381, in run_portable_pipeline job_service_handle = self.create_job_service(options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 296, in create_job_service return self.create_job_service_handle(server.start(), options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 81, in start self._endpoint = self._job_server.start() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 106, in start cmd, endpoint = self.subprocess_cmd_and_endpoint() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 150, in subprocess_cmd_and_endpoint jar_path = self.local_jar(self.path_to_jar()) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py";,> line 102, in path_to_jar raise ValueError( ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar";.> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`. > Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch > FAILED > Task > :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:39593 Traceback (most recent call last): File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py";,> line 111, in <module> run() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py";,> line 106, in run output | 'Write' >> WriteToText(known_args.output) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py";,> line 600, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py";,> line 577, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py";,> line 192, in run_pipeline return self.run_portable_pipeline( File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 381, in run_portable_pipeline job_service_handle = self.create_job_service(options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 296, in create_job_service return self.create_job_service_handle(server.start(), options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 81, in start self._endpoint = self._job_server.start() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 106, in start cmd, endpoint = self.subprocess_cmd_and_endpoint() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 150, in subprocess_cmd_and_endpoint jar_path = self.local_jar(self.path_to_jar()) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py";,> line 102, in path_to_jar raise ValueError( ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar";.> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`. > Task > :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming > FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 8m 12s 149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date Publishing build scan... https://ge.apache.org/s/f7pgfl4u2lduo Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
