See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/137/display/redirect>
------------------------------------------
[...truncated 1.23 MB...]
RuntimeError: Pipeline
test_large_elements_1560600209.5_779274dd-4c48-4735-9e0e-8d3a8e5572fd failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/07/temp_shuffle_e0532702-c0f3-408b-b6e4-9842da8b1859
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 254, in
test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_1560600216.11_4bac33d3-0c85-4dc8-a3c8-136337122915
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/3b/temp_shuffle_21bfc38f-150c-4634-b430-474b5d5495fa
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in
test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_type_coercion_1560600219.27_0e99434d-2f09-4d3a-aff9-75c3cc32fad0
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/02/temp_shuffle_91cfa051-cf0c-429e-afd5-f43b699273d8
(No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in
test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_no_subtransform_composite_1560600220.63_7c8a9795-0631-4251-8db4-b6deaf60680c
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/09/temp_shuffle_3124fe8c-36fb-4044-8c0c-8324fcafceb0
(No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_1560600223.71_77702c2f-9279-48c3-b78d-4e2c9636b6a5 failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/0b/temp_shuffle_13a93b1c-df0e-4f07-8dae-576d0ac393f2
(No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1560600225.21_5abdce7c-ce96-434d-9a16-494e681c452a
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/0b/shuffle_27_0_0.data.51db745e-96b5-45fb-b6a3-aff236b6f47b
(No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_outputs_1560600236.38_79ae37d2-f5d8-4850-b44b-956949222394
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/3f/temp_shuffle_f0635afb-a0ef-4060-931a-f4015ef75ead
(No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in
test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_state_only_1560600237.75_7e37f765-5217-45ed-8c58-6cbad2bb4adb failed
in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/09/temp_shuffle_b896cf5f-f1e8-49f7-9c9c-cc206c5d3b15
(No such file or directory)
======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in
test_pardo_state_timers
self._run_pardo_state_timers(False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in
_run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_state_timers_1560600239.06_0a97956a-8c7a-4422-b00b-3ca899fc59d5
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/36/shuffle_39_0_0.data.bd0e6071-8ea5-4952-8871-29e6105fba59
(No such file or directory)
======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in
test_pardo_timers
assert_that(actual, equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_timers_1560600240.35_4b432b21-ce05-4415-9285-6bc0170c5a36 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/25/temp_shuffle_92c2d3ba-e3ae-4363-9721-dcd76ad501a9
(No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1560600241.66_e47745e9-4a82-41e8-98c4-189f732253b0
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/0b/shuffle_43_0_0.index.69cf0f9d-6f96-447c-9232-f59297ee1924
(No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1560600242.91_8c8f0229-24e2-44ea-9d8e-275b0bed04e5
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/09/temp_shuffle_4895627a-a86e-4f1b-83ee-625f969cebd1
(No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in
test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_read_1560600246.3_b7eb563c-9255-4aad-9e29-323515baedde failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/02/temp_shuffle_9022ad4f-53e6-4af3-8e07-56689f0e2249
(No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in
test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_reshuffle_1560600249.12_28d92aa2-e9d1-4fe4-b878-7d8ebc454a5b failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/27/temp_shuffle_e7a551bc-d702-45e4-bcde-11378e897100
(No such file or directory)
======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in
test_sdf_wrap_range_source
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrap_range_source_1560600250.86_9541b952-1f01-49fd-a531-88e547530ec8
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/22/temp_shuffle_5337d5f2-6166-4c7a-85d9-1bc643a5d054
(No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py";,>
line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in
test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrapper_overrides_read_1560600251.92_a6c54e5e-a766-4c30-bffb-6bc2a7b17491
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/26/temp_shuffle_e52b71c0-7e26-48a1-83a5-23fdf24db501
(No such file or directory)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in
test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in
_run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowed_pardo_state_timers_1560600253.04_c420d2ed-63d0-425b-8d82-5e4109bf3204
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/14/shuffle_55_0_0.index.ef28d127-f95c-4a15-b41e-2762be56dd5e
(No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowing_1560600254.3_24d0f5c9-294e-44dd-a174-833d73a79d7c failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-242c444c-f69d-439c-9013-a4895894a9cd/1e/temp_shuffle_4b1eeec8-7c62-4ed0-8e35-7dacd64b89bb
(No such file or directory)
----------------------------------------------------------------------
Ran 38 tests in 97.315s
FAILED (errors=20, skipped=10)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'>
line: 251
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 8s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/5mjwxl5my2y4k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
