See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/115/display/redirect>
------------------------------------------
[...truncated 1.11 MB...]
RuntimeError: Pipeline
test_multimap_side_input_1560470608.32_17155ca8-d274-4711-88b8-cb1d554e58be
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/0e/shuffle_17_0_0.index.c7a3379b-15b6-4215-a5a8-f8ebac2f478c
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in
test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_type_coercion_1560470609.75_fd693e03-208f-445e-8321-970876d3211f
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/33/temp_shuffle_6247c011-4dd5-4b78-b693-3eedaa5a0d54
(No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in
test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_no_subtransform_composite_1560470611.16_49639867-657d-4042-86d3-137a2bf1fcb4
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/3d/temp_shuffle_23aae812-3611-450e-88a5-ae3a74183148
(No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_1560470614.22_9e942844-feb2-4440-99ae-9ec64d87d1fa failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/11/shuffle_21_0_0.data.804377ea-0808-477f-9ce8-0de24c75b4f3
(No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1560470615.86_bba56223-344a-4df8-b114-bd8baed5cf00
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/0e/temp_shuffle_eab361e5-675b-4d3f-9786-66dfd3222111
(No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_inputs_1560470621.13_2d776dcb-fb2d-4aa1-aa36-f7018fde83fc
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/31/shuffle_25_0_0.index.4bfb06f6-625a-483a-aa83-cec5190be928
(No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_outputs_1560470622.55_d6621b29-8879-4f15-8536-8ca9d44ca07c
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/0b/shuffle_27_0_0.data.e13e2ab8-0968-4807-a39d-8d6039a96492
(No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in
test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_state_only_1560470624.0_c384fdf7-417b-41f3-b3a2-5e20a0fd38f6 failed
in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/2d/shuffle_29_0_0.index.4b34b6c9-a2b2-4d91-9bf0-8eb1bc910f9f
(No such file or directory)
======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in
test_pardo_state_timers
self._run_pardo_state_timers(False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in
_run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_state_timers_1560470626.51_59be3653-22f2-4dc8-bd57-6196b1980c69
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/24/temp_shuffle_a938710c-682a-4690-a4f9-22b827720abb
(No such file or directory)
======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in
test_pardo_timers
assert_that(actual, equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_timers_1560470628.11_816d7562-dcbd-42fc-bbc8-e0642b386988 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/0b/temp_shuffle_c727ef4a-6aa4-4e0d-b6ef-c9121cbff549
(No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1560470629.63_13877daa-09f4-4316-8640-e9145d83ac1e
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/3d/temp_shuffle_bf3f806d-63c1-4f5b-981a-fdcb701a1ba4
(No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1560470633.07_de4185fe-4eb5-48e4-b6be-fa8f8f5d77da
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/36/shuffle_39_0_0.data.5dbc2ac0-3423-403d-aa4c-96b6399d1601
(No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in
test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_read_1560470634.47_104eff0a-b03e-4fb9-8de4-7245863b2b5e failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/13/shuffle_41_0_0.data.42d575eb-a30d-48fd-81b6-d0245bc267ec
(No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in
test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_reshuffle_1560470635.82_0c315a21-f596-48a0-9437-b6c4cc181bf1 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/0e/temp_shuffle_4cc97d02-618a-4d3c-8a92-4c2f7ff18350
(No such file or directory)
======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in
test_sdf_wrap_range_source
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrap_range_source_1560470637.36_d125aa88-c873-467d-82fb-5824750626bd
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/33/shuffle_45_0_0.index.91a8f1c7-5b95-4dda-a30b-4e78577d4ac7
(No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py";,>
line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in
test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrapper_overrides_read_1560470638.68_ac937acf-71c0-4152-a224-f00ed9083591
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/0b/temp_shuffle_e84c9263-706b-49d6-a409-1d24e6a80b74
(No such file or directory)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in
test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in
_run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowed_pardo_state_timers_1560470639.8_8852fd7e-363f-418f-a41d-6f318d39f865
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/22/temp_shuffle_8789c05a-a0d7-414e-8a91-441392734dbd
(No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowing_1560470641.18_f08fe45b-0073-4751-ab6f-940bde756d02 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-eab6fb33-3ffa-4c60-ba6d-96a34936dab6/33/shuffle_52_0_0.data.13ac5202-691a-41a2-ae3d-7649e4d87cc8
(No such file or directory)
----------------------------------------------------------------------
Ran 38 tests in 80.273s
FAILED (errors=22, skipped=10)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'>
line: 251
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 54s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/w3puhvtqnxhac
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
