See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2628/display/redirect?page=changes>
Changes:
[andyye333] Add extra details to PubSub matcher errors
[noreply] Merge pull request #17559 from [BEAM-14423] Add exception injection
[noreply] [BEAM-11104] Allow self-checkpointing SDFs to return without finishing
[noreply] Merge pull request #17544 from [BEAM-14415] Exception handling tests
for
[noreply] Merge pull request #17565 from [BEAM-14413] add Kafka exception test
------------------------------------------
[...truncated 1.21 MB...]
role_payload: "\n5dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-LEVa8Zhi2xAWeaI6TF_TPAQr74MsIWCeVcRvn_SRML8.jar\022@2c455af19862db101679a23a4c5fd33c042bef832c21609e55c46f9ff49130bf"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload:
"\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-LEVa8Zhi2xAWeaI6TF_TPAQr74MsIWCeVcRvn_SRML8.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/09 17:25:38 Cross-compiling
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go>
as /tmp/worker-4-1652117138487658150
2022/05/09 17:25:40 Prepared job with id:
go-testjdbcio_postgresreadwrite-cfd720dc-4ddf-4c61-8be0-9a596fe7c3a2 and
staging token:
go-testjdbcio_postgresreadwrite-cfd720dc-4ddf-4c61-8be0-9a596fe7c3a2
2022/05/09 17:25:40 Staged binary artifact with token:
2022/05/09 17:25:40 Submitted job:
go-testjdbcio_postgresreadwrite-cfd720dc-4ddf-4c61-8be0-9a596fe7c3a2
2022/05/09 17:25:40 2022-05-09 17:25:40. (1): Make sure that locally built
Python SDK docker image has Python 3.7 interpreter.
2022/05/09 17:25:40 2022-05-09 17:25:40. (12): ==================== <function
impulse_to_input at 0x7f964bb6fb00> ====================
2022/05/09 17:25:40 2022-05-09 17:25:40. (13): ==================== <function
sort_stages at 0x7f964bb6fd40> ====================
2022/05/09 17:25:40 2022-05-09 17:25:40. (14): ==================== <function
add_impulse_to_dangling_transforms at 0x7f964bb6fe60> ====================
2022/05/09 17:25:40 2022-05-09 17:25:40. (15): ==================== <function
setup_timer_mapping at 0x7f964bb6fcb0> ====================
2022/05/09 17:25:40 2022-05-09 17:25:40. (16): ==================== <function
populate_data_channel_coders at 0x7f964bb6fdd0> ====================
2022/05/09 17:25:40 2022-05-09 17:25:40. (17): starting control server on port
42651
2022/05/09 17:25:40 2022-05-09 17:25:40. (18): starting data server on port
38767
2022/05/09 17:25:40 2022-05-09 17:25:40. (19): starting state server on port
41149
2022/05/09 17:25:40 2022-05-09 17:25:40. (20): starting logging server on port
38655
2022/05/09 17:25:40 Job state: STOPPED
2022/05/09 17:25:40 Job state: STARTING
2022/05/09 17:25:40 Job state: RUNNING
2022/05/09 17:25:40 2022-05-09 17:25:40. (21): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f9676a57250> for environment WGLQqHwfbXbeam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.40.0.dev')
2022/05/09 17:25:43 2022-05-09 17:25:43. (22): Attempting to pull image
apache/beam_java8_sdk:2.40.0.dev
2022/05/09 17:25:43 2022-05-09 17:25:43. (23): Unable to pull image
apache/beam_java8_sdk:2.40.0.dev, defaulting to local image if it exists
2022/05/09 17:25:44 2022-05-09 17:25:44. (24): Waiting for docker to start up.
Current status is running
2022/05/09 17:25:44 2022-05-09 17:25:44. (25): Docker container is running.
container_id =
b'aab0fb0b73ac6dfdca9f63ee70ea9af5aed25220d96acd7da11e359e45729f38', worker_id
= worker_16
2022/05/09 17:25:45 2022-05-09 17:25:45. (26): Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f9676a68650> for environment go (beam:env:docker:v1,
b'\n\x16apache/beam_go_sdk:dev')
2022/05/09 17:25:45 2022-05-09 17:25:45. (27): Attempting to pull image
apache/beam_go_sdk:dev
2022/05/09 17:25:46 2022-05-09 17:25:46. (28): Unable to pull image
apache/beam_go_sdk:dev, defaulting to local image if it exists
2022/05/09 17:25:47 2022-05-09 17:25:47. (29): Waiting for docker to start up.
Current status is running
2022/05/09 17:25:47 2022-05-09 17:25:47. (30): Docker container is running.
container_id =
b'8fd0457c90f1bf92af6df3c917a59e9132ccc88fe99bfee20b43914421ef654d', worker_id
= worker_17
2022/05/09 17:25:51 2022-05-09 17:25:51. (31): Completed job in
10.870282173156738 seconds with state DONE.
2022/05/09 17:25:51 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (33.78s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc
86.601s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:203: Test TestKafkaIO_BasicReadWrite is currently filtered
for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
6.035s
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/bin/pytest";,>
line 8, in <module>
sys.exit(main())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 84, in main
return config.hook.pytest_cmdline_main(config=config)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/hooks.py";,>
line 286, in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/manager.py";,>
line 93, in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/manager.py";,>
line 87, in <lambda>
firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 208, in _multicall
return outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 80, in get_result
raise ex[1].with_traceback(ex[2])
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 187, in _multicall
res = hook_impl.function(*args)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/main.py";,>
line 243, in pytest_cmdline_main
return wrap_session(config, _main)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/main.py";,>
line 236, in wrap_session
session=session, exitstatus=session.exitstatus
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/hooks.py";,>
line 286, in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/manager.py";,>
line 93, in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/manager.py";,>
line 87, in <lambda>
firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 203, in _multicall
gen.send(outcome)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/terminal.py";,>
line 669, in pytest_sessionfinish
outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 80, in get_result
raise ex[1].with_traceback(ex[2])
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 187, in _multicall
res = hook_impl.function(*args)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/junitxml.py";,>
line 686, in pytest_sessionfinish
logfile.write(Junit.testsuites([suite_node]).unicode(indent=0))
OSError: [Errno 28] No space left on device
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
> FAILED
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/bin/pytest";,>
line 8, in <module>
sys.exit(main())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 65, in main
config = _prepareconfig(args, plugins)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 214, in _prepareconfig
pluginmanager=pluginmanager, args=args
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/hooks.py";,>
line 286, in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/manager.py";,>
line 93, in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/manager.py";,>
line 87, in <lambda>
firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 203, in _multicall
gen.send(outcome)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/helpconfig.py";,>
line 94, in pytest_cmdline_parse
config = outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 80, in get_result
raise ex[1].with_traceback(ex[2])
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 187, in _multicall
res = hook_impl.function(*args)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 789, in pytest_cmdline_parse
self.parse(args)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 997, in parse
self._preparse(args, addopts=addopts)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/config/__init__.py";,>
line 953, in _preparse
early_config=self, args=args, parser=self._parser
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/hooks.py";,>
line 286, in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/manager.py";,>
line 93, in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/manager.py";,>
line 87, in <lambda>
firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 208, in _multicall
return outcome.get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 80, in get_result
raise ex[1].with_traceback(ex[2])
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pluggy/callers.py";,>
line 182, in _multicall
next(gen) # first yield
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 61, in pytest_load_initial_conftests
capman.start_global_capturing()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 121, in start_global_capturing
self._global_capturing = self._getcapture(self._method)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 97, in _getcapture
return MultiCapture(out=True, err=True, Capture=FDCapture)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 471, in __init__
self.out = Capture(1)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/capture.py";,>
line 570, in __init__
f = TemporaryFile()
File "/usr/lib/python3.7/tempfile.py", line 725, in TemporaryFile
prefix, suffix, dir, output_type = _sanitize_params(prefix, suffix, dir)
File "/usr/lib/python3.7/tempfile.py", line 265, in _sanitize_params
dir = gettempdir()
File "/usr/lib/python3.7/tempfile.py", line 433, in gettempdir
tempdir = _get_default_tempdir()
File "/usr/lib/python3.7/tempfile.py", line 368, in _get_default_tempdir
dirlist)
FileNotFoundError: [Errno 2] No usable temporary directory found in ['/tmp',
'/var/tmp', '/usr/tmp',
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python']>
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/scripts/run_expansion_services.sh>:
line 19: cannot create temp file for here-document: No space left on device
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 38m 43s
233 actionable tasks: 154 executed, 68 from cache, 11 up-to-date
A build scan cannot be produced as an error occurred spooling the build data.
Please report this problem via https://gradle.com/help/plugin and include the
following via copy/paste:
----------
Gradle version: 7.4
Plugin version: 3.4.1
java.lang.IllegalStateException: Could not close the event spooler due to
previous errors.
at com.gradle.scan.plugin.internal.f.c.c.a(SourceFile:128)
at com.gradle.scan.plugin.internal.q.a$a.a(SourceFile:31)
at com.gradle.scan.plugin.internal.q.a$a.a(SourceFile:20)
at com.gradle.scan.plugin.internal.q.a.c(SourceFile:67)
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
