See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/681/display/redirect>
Changes: ------------------------------------------ [...truncated 1.72 MB...] apache_beam/runners/portability/portable_runner_test.py::PortableRunnerTestWithExternalEnv::test_error_traceback_includes_user_code <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-1895 Traceback (most recent call last): File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner self.run() File "/usr/lib/python3.9/threading.py", line 910, in run self._target(*self._args, **self._kwargs) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/local_job_service.py";,> line 296, in _run_job self.result = self._invoke_runner() File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/local_job_service.py";,> line 318, in _invoke_runner return fn_runner.FnApiRunner( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 224, in run_via_runner_api return self.run_stages(stage_context, stages) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 455, in run_stages bundle_results = self._execute_bundle( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 783, in _execute_bundle self._run_bundle( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 1012, in _run_bundle result, splits = bundle_manager.process_bundle( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 1387, in process_bundle raise RuntimeError(result.error) RuntimeError: Traceback (most recent call last): File "apache_beam/runners/common.py", line 1418, in apache_beam.runners.common.DoFnRunner.process return self.do_fn_invoker.invoke_process(windowed_value) File "apache_beam/runners/common.py", line 625, in apache_beam.runners.common.SimpleInvoker.invoke_process windowed_value, self.process_method(windowed_value.value)) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/transforms/core.py";,> line 1963, in <lambda> wrapper = lambda x: [fn(x)] File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner_test.py";,> line 1165, in first return second(x) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner_test.py";,> line 1168, in second return third(x) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner_test.py";,> line 1171, in third raise ValueError( ValueError: This error is expected and does not indicate a test failure. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 297, in _execute response = task() File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 372, in <lambda> lambda: self.create_worker().do_instruction(request), request) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 631, in do_instruction return getattr(self, request_type)( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 669, in process_bundle bundle_processor.process_bundle(instruction_id)) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/bundle_processor.py";,> line 1038, in process_bundle input_op_by_transform_id[element.transform_id].process_encoded( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/bundle_processor.py";,> line 230, in process_encoded self.output(decoded_value) File "apache_beam/runners/worker/operations.py", line 556, in apache_beam.runners.worker.operations.Operation.output def output(self, windowed_value, output_index=0): File "apache_beam/runners/worker/operations.py", line 558, in apache_beam.runners.worker.operations.Operation.output _cast_to_receiver(self.receivers[output_index]).receive(windowed_value) File "apache_beam/runners/worker/operations.py", line 257, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive def receive(self, windowed_value): File "apache_beam/runners/worker/operations.py", line 260, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive self.consumer.process(windowed_value) File "apache_beam/runners/worker/operations.py", line 937, in apache_beam.runners.worker.operations.DoOperation.process with self.scoped_process_state: File "apache_beam/runners/worker/operations.py", line 938, in apache_beam.runners.worker.operations.DoOperation.process delayed_applications = self.dofn_runner.process(o) File "apache_beam/runners/common.py", line 1420, in apache_beam.runners.common.DoFnRunner.process self._reraise_augmented(exn) File "apache_beam/runners/common.py", line 1492, in apache_beam.runners.common.DoFnRunner._reraise_augmented raise exn File "apache_beam/runners/common.py", line 1418, in apache_beam.runners.common.DoFnRunner.process return self.do_fn_invoker.invoke_process(windowed_value) File "apache_beam/runners/common.py", line 624, in apache_beam.runners.common.SimpleInvoker.invoke_process self.output_handler.handle_process_outputs( File "apache_beam/runners/common.py", line 1582, in apache_beam.runners.common._OutputHandler.handle_process_outputs self._write_value_to_tag(tag, windowed_value, watermark_estimator) File "apache_beam/runners/common.py", line 1695, in apache_beam.runners.common._OutputHandler._write_value_to_tag self.main_receivers.receive(windowed_value) File "apache_beam/runners/worker/operations.py", line 260, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive self.consumer.process(windowed_value) File "apache_beam/runners/worker/operations.py", line 937, in apache_beam.runners.worker.operations.DoOperation.process with self.scoped_process_state: File "apache_beam/runners/worker/operations.py", line 938, in apache_beam.runners.worker.operations.DoOperation.process delayed_applications = self.dofn_runner.process(o) File "apache_beam/runners/common.py", line 1420, in apache_beam.runners.common.DoFnRunner.process self._reraise_augmented(exn) File "apache_beam/runners/common.py", line 1492, in apache_beam.runners.common.DoFnRunner._reraise_augmented raise exn File "apache_beam/runners/common.py", line 1418, in apache_beam.runners.common.DoFnRunner.process return self.do_fn_invoker.invoke_process(windowed_value) File "apache_beam/runners/common.py", line 624, in apache_beam.runners.common.SimpleInvoker.invoke_process self.output_handler.handle_process_outputs( File "apache_beam/runners/common.py", line 1582, in apache_beam.runners.common._OutputHandler.handle_process_outputs self._write_value_to_tag(tag, windowed_value, watermark_estimator) File "apache_beam/runners/common.py", line 1695, in apache_beam.runners.common._OutputHandler._write_value_to_tag self.main_receivers.receive(windowed_value) File "apache_beam/runners/worker/operations.py", line 260, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive self.consumer.process(windowed_value) File "apache_beam/runners/worker/operations.py", line 937, in apache_beam.runners.worker.operations.DoOperation.process with self.scoped_process_state: File "apache_beam/runners/worker/operations.py", line 938, in apache_beam.runners.worker.operations.DoOperation.process delayed_applications = self.dofn_runner.process(o) File "apache_beam/runners/common.py", line 1420, in apache_beam.runners.common.DoFnRunner.process self._reraise_augmented(exn) File "apache_beam/runners/common.py", line 1508, in apache_beam.runners.common.DoFnRunner._reraise_augmented raise new_exn.with_traceback(tb) File "apache_beam/runners/common.py", line 1418, in apache_beam.runners.common.DoFnRunner.process return self.do_fn_invoker.invoke_process(windowed_value) File "apache_beam/runners/common.py", line 625, in apache_beam.runners.common.SimpleInvoker.invoke_process windowed_value, self.process_method(windowed_value.value)) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/transforms/core.py";,> line 1963, in <lambda> wrapper = lambda x: [fn(x)] File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner_test.py";,> line 1165, in first return second(x) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner_test.py";,> line 1168, in second return third(x) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner_test.py";,> line 1171, in third raise ValueError( ValueError: This error is expected and does not indicate a test failure. [while running 'Map(first)'] warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) apache_beam/runners/portability/portable_runner_test.py::PortableRunnerTestWithLocalDocker::test_sdf_with_check_done_failed <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-1443 Traceback (most recent call last): File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner self.run() File "/usr/lib/python3.9/threading.py", line 910, in run self._target(*self._args, **self._kwargs) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/local_job_service.py";,> line 296, in _run_job self.result = self._invoke_runner() File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/local_job_service.py";,> line 318, in _invoke_runner return fn_runner.FnApiRunner( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 224, in run_via_runner_api return self.run_stages(stage_context, stages) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 455, in run_stages bundle_results = self._execute_bundle( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 783, in _execute_bundle self._run_bundle( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 1012, in _run_bundle result, splits = bundle_manager.process_bundle( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,> line 1348, in process_bundle result_future = self._worker_handler.control_conn.push(process_bundle_req) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,> line 379, in push response = self.worker.do_instruction(request) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 631, in do_instruction return getattr(self, request_type)( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 669, in process_bundle bundle_processor.process_bundle(instruction_id)) File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/bundle_processor.py";,> line 1038, in process_bundle input_op_by_transform_id[element.transform_id].process_encoded( File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/worker/bundle_processor.py";,> line 230, in process_encoded self.output(decoded_value) File "apache_beam/runners/worker/operations.py", line 556, in apache_beam.runners.worker.operations.Operation.output def output(self, windowed_value, output_index=0): File "apache_beam/runners/worker/operations.py", line 558, in apache_beam.runners.worker.operations.Operation.output _cast_to_receiver(self.receivers[output_index]).receive(windowed_value) File "apache_beam/runners/worker/operations.py", line 257, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive def receive(self, windowed_value): File "apache_beam/runners/worker/operations.py", line 260, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive self.consumer.process(windowed_value) File "apache_beam/runners/worker/operations.py", line 1051, in apache_beam.runners.worker.operations.SdfProcessSizedElements.process with self.scoped_process_state: File "apache_beam/runners/worker/operations.py", line 1060, in apache_beam.runners.worker.operations.SdfProcessSizedElements.process delayed_applications = self.dofn_runner.process_with_sized_restriction( File "apache_beam/runners/common.py", line 1433, in apache_beam.runners.common.DoFnRunner.process_with_sized_restriction return self.do_fn_invoker.invoke_process( File "apache_beam/runners/common.py", line 818, in apache_beam.runners.common.PerWindowInvoker.invoke_process residual = self._invoke_process_per_window( File "apache_beam/runners/common.py", line 989, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window self.threadsafe_restriction_tracker.check_done() File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/runners/sdf_utils.py";,> line 111, in check_done return self._restriction_tracker.check_done() File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/apache_beam/io/restriction_trackers.py";,> line 93, in check_done raise ValueError( ValueError: OffsetRestrictionTracker is not done since work in range [0, 6) has not been claimed. warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/pytest_py39-cython.xml> - ========== 1183 passed, 769 skipped, 34 warnings in 243.91s (0:04:03) ========== ============================= test session starts ============================== platform linux -- Python 3.9.10, pytest-7.4.0, pluggy-1.2.0 cachedir: target/.tox-py39-cython/py39-cython/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python> configfile: pytest.ini plugins: xdist-3.3.1, requests-mock-1.11.0, timeout-2.1.0, hypothesis-6.79.2 timeout: 600.0s timeout method: signal timeout func_only: False collected 1954 items / 1951 deselected / 1 skipped / 3 selected apache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py s [ 33%] [ 33%] apache_beam/runners/portability/stager_test.py .. [100%] =============================== warnings summary =============================== target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/pkg_resources/__init__.py:121 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/target/.tox-py39-cython/py39-cython/lib/python3.9/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/pytest_py39-cython_no_xdist.xml> - ========== 2 passed, 2 skipped, 1951 deselected, 2 warnings in 1.17s =========== py39-cython: commands_post[0]> bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> .pkg_external_sdist_meta: _exit <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/sdks/python/test-suites/tox/py39/build/srcs/sdks/python/target/.tox-py39-cython/.pkg_external/tmp/sdist-extract/apache-beam-2.49.0.dev0>> python <https://ci-beam.apache.org/job/beam_PreCommit_Python_Runners_Cron/ws/src/build/gradleenv/-1227304281/lib/python3.9/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ py39-cython: OK (835.42=setup[328.95]+cmd[0.01,0.40,1.27,0.03,251.06,3.69,249.96,0.05] seconds) congratulations :) (835.60 seconds) FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:tox:py39:testPy39Cloud'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:tox:py310:testPy310Cython'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org BUILD FAILED in 23m 24s 23 actionable tasks: 17 executed, 4 from cache, 2 up-to-date Publishing build scan... https://ge.apache.org/s/ga5tzfzmhmijy Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
