See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3623/display/redirect?page=changes>
Changes:
[Kiley Sok] Update beam-master version
[noreply] Remove datastore intersphinx_dependency to fix docs job. (#25000)
[noreply] Use CC-BY image for custom remote inference notebook (#25004)
[noreply] Fix kafka performance test write failing due to server overwhelmed
------------------------------------------
[...truncated 1.27 MB...]
2023/01/13 23:29:52 2023-01-13 23:29:52. (3): ==================== <function
fix_side_input_pcoll_coders at 0x7fbb7584af80> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (4): ==================== <function
pack_combiners at 0x7fbb7584e4d0> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (5): ==================== <function
lift_combiners at 0x7fbb7584e560> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (6): ==================== <function
expand_sdf at 0x7fbb7584e710> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (7): ==================== <function
expand_gbk at 0x7fbb7584e7a0> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (8): ==================== <function
sink_flattens at 0x7fbb7584e8c0> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (9): ==================== <function
greedily_fuse at 0x7fbb7584e950> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (10): ==================== <function
read_to_impulse at 0x7fbb7584e9e0> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (11): ==================== <function
impulse_to_input at 0x7fbb7584ea70> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (12): ==================== <function
sort_stages at 0x7fbb7584ecb0> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (13): ==================== <function
add_impulse_to_dangling_transforms at 0x7fbb7584edd0> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (14): ==================== <function
setup_timer_mapping at 0x7fbb7584ec20> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (15): ==================== <function
populate_data_channel_coders at 0x7fbb7584ed40> ====================
2023/01/13 23:29:52 2023-01-13 23:29:52. (16): starting control server on port
37473
2023/01/13 23:29:52 2023-01-13 23:29:52. (17): starting data server on port
44737
2023/01/13 23:29:52 2023-01-13 23:29:52. (18): starting state server on port
36569
2023/01/13 23:29:52 2023-01-13 23:29:52. (19): starting logging server on port
34793
2023/01/13 23:29:52 2023-01-13 23:29:52. (20): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7fbb757b7e50> for environment go (beam:env:docker:v1,
b'\n\x16apache/beam_go_sdk:dev')
2023/01/13 23:29:55 2023-01-13 23:29:55. (21): Attempting to pull image
apache/beam_go_sdk:dev
2023/01/13 23:29:56 2023-01-13 23:29:56. (22): Unable to pull image
apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/01/13 23:29:57 2023-01-13 23:29:57. (23): Waiting for docker to start up.
Current status is running
2023/01/13 23:29:57 2023-01-13 23:29:57. (24): Docker container is running.
container_id =
b'2d01b34fca5cff5e703ec36fb84dd2ad6bca105b71204afd3f4093104177236b', worker_id
= worker_15
2023/01/13 23:29:58 2023-01-13 23:29:58. (25): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7fbb577dcbd0> for environment NQqRGIrDumbeam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
2023/01/13 23:30:01 2023-01-13 23:30:01. (26): Attempting to pull image
apache/beam_java8_sdk:2.45.0.dev
2023/01/13 23:30:02 2023-01-13 23:30:02. (27): Unable to pull image
apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
2023/01/13 23:30:05 2023-01-13 23:30:05. (28): Waiting for docker to start up.
Current status is running
2023/01/13 23:30:05 2023-01-13 23:30:05. (29): Docker container is running.
container_id =
b'037f20ba2517a2f1b21417f1601a3b8e99fd637b1f9c103f917b0a9cb5c8fd68', worker_id
= worker_17
2023/01/13 23:30:18 2023-01-13 23:30:18. (30): Completed job in
25.982025861740112 seconds with state DONE.
2023/01/13 23:30:18 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (66.01s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc
141.273s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered
for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
6.124s
$ cd ../..
$ exit
$ exit
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:apache_beam.runners.portability.stager:Executing command:
['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.44.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python',
'-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r',
'/tmp/tmpps2zfuxr/tmp_requirements.txt', '--exists-action', 'i', '--no-deps',
'--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:Default Python SDK image for environment is
apache/beam_python3.8_sdk:2.44.0
INFO:root:No image given, using default Python SDK image
INFO:root:Default Python SDK image for environment is
apache/beam_python3.8_sdk:2.44.0
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.44.0"
for Docker environment
INFO:__main__:Listening for expansion requests at 37527
INFO:root:Missing pipeline option (runner). Executing pipeline using the
default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest >
testRunInference FAILED
java.lang.RuntimeException at PortableRunner.java:205
Caused by: java.util.concurrent.ExecutionException at
CompletableFuture.java:357
Caused by:
org.apache.beam.vendor.grpc.v1p48p1.io.grpc.StatusRuntimeException at
Status.java:535
15 tests completed, 1 failed
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> FAILED
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner
>>> --job_endpoint=localhost:36937 --environment_cache_millis=10000
>>> --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=uses_java_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.2.0, pluggy-1.0.0
rootdir:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,>
configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0,
hypothesis-6.62.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
----------------------------- live log collection ------------------------------
WARNING
apache_beam.runners.interactive.interactive_environment:interactive_environment.py:191
Dependencies required for Interactive Beam PCollection visualization are not
available, please use: `pip install apache-beam[interactive]` to install
necessary dependencies to enable all data visualization features.
WARNING
apache_beam.runners.interactive.interactive_environment:interactive_environment.py:200
You cannot use Interactive Beam features when you are not in an interactive
environment such as a Jupyter notebook or ipython terminal.
WARNING root:avroio_test.py:54 python-snappy is not installed; some tests will
be skipped.
WARNING root:tfrecordio_test.py:55 Tensorflow is not installed, so skipping
some tests.
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.45.0.dev
WARNING root:github_issues_utils.py:32 A Github Personal Access token is
required to create Github Issues.
collected 6797 items / 6787 deselected / 6 skipped / 10 selected
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence
FAILED [ 10%]
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder
FAILED [ 20%]
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform
FAILED [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key
FAILED [ 40%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally
FAILED [ 50%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key
FAILED [ 60%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key
FAILED [ 70%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput
FAILED [ 80%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition
FAILED [ 90%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix
FAILED [100%]Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/bin/pytest";,>
line 8, in <module>
sys.exit(console_main())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 190, in console_main
code = main()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 168, in main
config=config
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_hooks.py";,>
line 265, in __call__
return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_manager.py";,>
line 80, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_callers.py";,>
line 60, in _multicall
return outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_result.py";,>
line 60, in get_result
raise ex[1].with_traceback(ex[2])
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_callers.py";,>
line 39, in _multicall
res = hook_impl.function(*args)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/main.py";,>
line 317, in pytest_cmdline_main
return wrap_session(config, _main)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/main.py";,>
line 306, in wrap_session
session=session, exitstatus=session.exitstatus
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_hooks.py";,>
line 265, in __call__
return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_manager.py";,>
line 80, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_callers.py";,>
line 55, in _multicall
gen.send(outcome)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/terminal.py";,>
line 808, in pytest_sessionfinish
outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_result.py";,>
line 60, in get_result
raise ex[1].with_traceback(ex[2])
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_callers.py";,>
line 39, in _multicall
res = hook_impl.function(*args)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/junitxml.py";,>
line 682, in pytest_sessionfinish
logfile.write(ET.tostring(testsuites, encoding="unicode"))
OSError: [Errno 28] No space left on device
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner
>>> --job_endpoint=localhost:36937 --environment_cache_millis=10000
>>> --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/bin/pytest";,>
line 8, in <module>
sys.exit(console_main())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 190, in console_main
code = main()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 148, in main
config = _prepareconfig(args, plugins)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 330, in _prepareconfig
pluginmanager=pluginmanager, args=args
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_hooks.py";,>
line 265, in __call__
return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_manager.py";,>
line 80, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_callers.py";,>
line 55, in _multicall
gen.send(outcome)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/helpconfig.py";,>
line 103, in pytest_cmdline_parse
config: Config = outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_result.py";,>
line 60, in get_result
raise ex[1].with_traceback(ex[2])
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_callers.py";,>
line 39, in _multicall
res = hook_impl.function(*args)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 1058, in pytest_cmdline_parse
self.parse(args)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 1346, in parse
self._preparse(args, addopts=addopts)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 1249, in _preparse
early_config=self, args=args, parser=self._parser
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_hooks.py";,>
line 265, in __call__
return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_manager.py";,>
line 80, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_callers.py";,>
line 60, in _multicall
return outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_result.py";,>
line 60, in get_result
raise ex[1].with_traceback(ex[2])
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/_callers.py";,>
line 34, in _multicall
next(gen) # first yield
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 141, in pytest_load_initial_conftests
capman.start_global_capturing()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 688, in start_global_capturing
self._global_capturing = _get_multicapture(self._method)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 630, in _get_multicapture
return MultiCapture(in_=FDCapture(0), out=FDCapture(1), err=FDCapture(2))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 388, in __init__
TemporaryFile(buffering=0),
File "/usr/lib/python3.7/tempfile.py", line 725, in TemporaryFile
prefix, suffix, dir, output_type = _sanitize_params(prefix, suffix, dir)
File "/usr/lib/python3.7/tempfile.py", line 265, in _sanitize_params
dir = gettempdir()
File "/usr/lib/python3.7/tempfile.py", line 433, in gettempdir
tempdir = _get_default_tempdir()
File "/usr/lib/python3.7/tempfile.py", line 368, in _get_default_tempdir
dirlist)
FileNotFoundError: [Errno 2] No usable temporary directory found in ['/tmp',
'/var/tmp', '/usr/tmp',
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python']>
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1241900
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1285944.
Stopping expansion service pid: 1285945.
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 48m 30s
248 actionable tasks: 168 executed, 68 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/i5kjmfahnm2h6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
