See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6891/display/redirect>
Changes: ------------------------------------------ [...truncated 634.78 KB...] #9 410.8 google-cloud-pubsublite==1.8.3 #9 410.8 google-cloud-recommendations-ai==0.10.4 #9 410.8 google-cloud-resource-manager==1.10.3 #9 410.8 google-cloud-spanner==3.40.0 #9 410.8 google-cloud-storage==2.10.0 #9 410.8 google-cloud-videointelligence==2.11.3 #9 410.8 google-cloud-vision==3.4.4 #9 410.8 google-crc32c==1.5.0 #9 410.8 google-pasta==0.2.0 #9 410.8 google-resumable-media==2.5.0 #9 410.8 googleapis-common-protos==1.60.0 #9 410.8 greenlet==2.0.2 #9 410.8 grpc-google-iam-v1==0.12.6 #9 410.8 grpcio==1.56.2 #9 410.8 grpcio-status==1.56.2 #9 410.8 guppy3==3.1.3 #9 410.8 h5py==3.9.0 #9 410.8 hdfs==2.7.2 #9 410.8 httplib2==0.22.0 #9 410.8 hypothesis==6.82.3 #9 410.8 idna==3.4 #9 410.8 importlib-metadata==6.8.0 #9 410.8 iniconfig==2.0.0 #9 410.8 joblib==1.3.2 #9 410.8 keras==2.13.1 #9 410.8 libclang==16.0.6 #9 410.8 Markdown==3.4.4 #9 410.8 MarkupSafe==2.1.3 #9 410.8 mmh3==4.0.1 #9 410.8 mock==5.1.0 #9 410.8 nltk==3.8.1 #9 410.8 nose==1.3.7 #9 410.8 numpy==1.24.3 #9 410.8 oauth2client==4.1.3 #9 410.8 oauthlib==3.2.2 #9 410.8 objsize==0.6.1 #9 410.8 opt-einsum==3.3.0 #9 410.8 orjson==3.9.4 #9 410.8 overrides==6.5.0 #9 410.8 packaging==23.1 #9 410.8 pandas==1.5.3 #9 410.8 parameterized==0.9.0 #9 410.8 pip==23.0.1 #9 410.8 pluggy==1.2.0 #9 410.8 proto-plus==1.22.3 #9 410.8 protobuf==4.23.4 #9 410.8 psycopg2-binary==2.9.7 #9 410.8 pyarrow==11.0.0 #9 410.8 pyasn1==0.5.0 #9 410.8 pyasn1-modules==0.3.0 #9 410.8 pycparser==2.21 #9 410.8 pydot==1.4.2 #9 410.8 PyHamcrest==2.0.4 #9 410.8 pymongo==4.4.1 #9 410.8 PyMySQL==1.1.0 #9 410.8 pyparsing==3.1.1 #9 410.8 pytest==7.4.0 #9 410.8 pytest-timeout==2.1.0 #9 410.8 pytest-xdist==3.3.1 #9 410.8 python-dateutil==2.8.2 #9 410.8 python-snappy==0.6.1 #9 410.8 pytz==2023.3 #9 410.8 PyYAML==6.0.1 #9 410.8 regex==2023.8.8 #9 410.8 requests==2.31.0 #9 410.8 requests-mock==1.11.0 #9 410.8 requests-oauthlib==1.3.1 #9 410.8 rsa==4.9 #9 410.8 scikit-learn==1.3.0 #9 410.8 scipy==1.10.1 #9 410.8 setuptools==68.1.2 #9 410.8 Shapely==1.8.5.post1 #9 410.8 six==1.16.0 #9 410.8 sortedcontainers==2.4.0 #9 410.8 soupsieve==2.4.1 #9 410.8 SQLAlchemy==1.4.49 #9 410.8 sqlparse==0.4.4 #9 410.8 tenacity==8.2.2 #9 410.8 tensorboard==2.13.0 #9 410.8 tensorboard-data-server==0.7.1 #9 410.8 tensorflow==2.13.0 #9 410.8 tensorflow-estimator==2.13.0 #9 410.8 tensorflow-io-gcs-filesystem==0.33.0 #9 410.8 termcolor==2.3.0 #9 410.8 testcontainers==3.7.1 #9 410.8 threadpoolctl==3.2.0 #9 410.8 tomli==2.0.1 #9 410.8 tqdm==4.66.0 #9 410.8 typing_extensions==4.5.0 #9 410.8 uritemplate==4.1.1 #9 410.8 urllib3==1.26.16 #9 410.8 websocket-client==1.6.1 #9 410.8 Werkzeug==2.3.6 #9 410.8 wheel==0.41.2 #9 410.8 wrapt==1.15.0 #9 410.8 zipp==3.16.2 #9 410.8 zstandard==0.21.0 #9 DONE 412.0s #10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/ #10 DONE 0.1s #11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #11 DONE 0.1s #12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/ #12 DONE 0.1s #13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi #13 1.079 Collecting pip-licenses<5 #13 1.145 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB) #13 1.155 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1) #13 1.156 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2) #13 1.216 Collecting prettytable>=2.3.0 #13 1.239 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB) #13 1.297 Collecting wcwidth #13 1.313 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB) #13 2.614 Installing collected packages: wcwidth, prettytable, pip-licenses #13 2.790 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6 #13 2.791 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv #13 2.948 #13 2.948 [notice] A new release of pip is available: 23.0.1 -> 23.2.1 #13 2.948 [notice] To update, run: pip install --upgrade pip #13 72.28 INFO:root:Successfully pulled licenses for 137 dependencies #13 72.28 Skip pulling license for bs4 #13 DONE 72.3s #14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses #14 DONE 0.1s #15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #15 DONE 0.4s #16 exporting to image #16 exporting layers #16 exporting layers 22.5s done #16 writing image sha256:ede486f6afad025dab372bc8318f7deaafc9daf66f294436745be6489621b288 done #16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done #16 DONE 22.5s > Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:37421 INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f30e8c45940> ==================== INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f30e8c459d0> ==================== INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f30e8c44160> ==================== Traceback (most recent call last): File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py";,> line 111, in <module> run() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py";,> line 106, in run output | 'Write' >> WriteToText(known_args.output) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py";,> line 600, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py";,> line 577, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py";,> line 192, in run_pipeline return self.run_portable_pipeline( File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 381, in run_portable_pipeline job_service_handle = self.create_job_service(options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 296, in create_job_service return self.create_job_service_handle(server.start(), options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 81, in start self._endpoint = self._job_server.start() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 106, in start cmd, endpoint = self.subprocess_cmd_and_endpoint() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 150, in subprocess_cmd_and_endpoint jar_path = self.local_jar(self.path_to_jar()) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py";,> line 102, in path_to_jar raise ValueError( ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar";.> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`. > Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch > FAILED > Task > :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:44491 Traceback (most recent call last): File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py";,> line 111, in <module> run() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py";,> line 106, in run output | 'Write' >> WriteToText(known_args.output) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py";,> line 600, in __exit__ self.result = self.run() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py";,> line 577, in run return self.runner.run_pipeline(self, self._options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py";,> line 192, in run_pipeline return self.run_portable_pipeline( File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 381, in run_portable_pipeline job_service_handle = self.create_job_service(options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 296, in create_job_service return self.create_job_service_handle(server.start(), options) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 81, in start self._endpoint = self._job_server.start() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 106, in start cmd, endpoint = self.subprocess_cmd_and_endpoint() File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py";,> line 150, in subprocess_cmd_and_endpoint jar_path = self.local_jar(self.path_to_jar()) File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py";,> line 102, in path_to_jar raise ValueError( ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar";.> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`. > Task > :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming > FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 9m 27s 149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date Publishing build scan... https://ge.apache.org/s/r7r7oza3rdass Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
