See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/142/display/redirect>
------------------------------------------
[...truncated 1.12 MB...]
RuntimeError: Pipeline
test_multimap_side_input_1560708206.48_626413b2-2487-41e1-9a44-05de2fe83f3f
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/3c/temp_shuffle_eda8c496-3b98-43d1-968e-8b3a6b461fdd
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in
test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_type_coercion_1560708208.62_1a752151-d80c-46a8-b0bb-e2e6816974d8
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/24/temp_shuffle_ddae6ba0-4a20-4985-b77e-375c30393608
(No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 673, in
test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_no_subtransform_composite_1560708210.33_2be9a24d-5d7c-4262-8cde-beb12e0c618f
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/08/shuffle_19_0_0.data.4b9b8b4d-363d-4b99-aaa7-bb6ca57d9442
(No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_1560708212.43_baa74b7f-05ff-4fac-9a83-749d56e06157 failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/0b/shuffle_21_0_0.index.c5fefb9d-8bd4-40de-9c09-d03c11ff2fe4
(No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1560708214.6_3d92d7d4-59bf-4de2-9165-e39b9e9dc0a6
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/32/shuffle_24_0_0.index.4ef09553-9305-4dbd-835e-3c4786f7c62d
(No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_inputs_1560708217.53_923588fe-5ffc-42de-be56-16bdab60a94f
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/26/temp_shuffle_066659b9-2933-44aa-9a5c-513d8374a23b
(No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_outputs_1560708218.92_a609c426-f57d-4308-873b-cb097d9a2a13
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/37/temp_shuffle_9dd4187e-6496-4daf-9501-54801a70e927
(No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in
test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_state_only_1560708220.32_3648c39d-8784-4436-bf46-73531f9361d9 failed
in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/0d/shuffle_30_0_0.data.c5434ec7-bb6a-441d-a9a2-80bacd98e26a
(No such file or directory)
======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in
test_pardo_state_timers
self._run_pardo_state_timers(False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in
_run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_state_timers_1560708221.6_7801aeca-0818-4c80-ad56-a9da4a4a65ea
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/20/temp_shuffle_7d46ce36-9fd7-4777-8c5d-0018c40368d9
(No such file or directory)
======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in
test_pardo_timers
assert_that(actual, equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_timers_1560708223.86_b1050aa7-33b2-4b95-ba5d-c9d295aa42a6 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/3d/temp_shuffle_a829a173-46e4-4daa-847e-028b0c6a59dc
(No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1560708226.51_2cc60afc-c4fe-427c-9dd1-b6391fe66574
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/36/shuffle_38_1_0.data.a457b5a1-2272-4aaa-835a-060674cadbd2
(No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1560708230.73_9d9418d7-6166-4b67-b4af-c5f2ba8ede33
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/09/temp_shuffle_3c01e7ef-f636-429a-8833-00e9b31c30f3
(No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in
test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_read_1560708231.98_d2e281f7-61d1-4332-ac9c-f2939ab0f422 failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/36/temp_shuffle_0ec2a450-e087-4939-b8f9-294a637257d1
(No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in
test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_reshuffle_1560708233.21_695dcd80-84c4-49bb-9217-d0a3080b1b2d failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/26/temp_shuffle_b79a9f50-70a4-42e2-8d53-83d35f741ead
(No such file or directory)
======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in
test_sdf_wrap_range_source
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrap_range_source_1560708234.53_e6283f6e-c508-4ef2-8699-7d3f4f9e57c5
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/17/temp_shuffle_06a2be0c-818f-413d-9cb1-c9cb324e48ac
(No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py";,>
line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in
test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrapper_overrides_read_1560708235.79_b17d35f5-aea1-414d-b4c3-16fb189146e9
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/25/temp_shuffle_207b7c4c-eb12-4650-a7b5-1f59f33db4a2
(No such file or directory)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in
test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in
_run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowed_pardo_state_timers_1560708237.01_ff02ce6a-b6fe-4662-9c9e-43d471ba2f0c
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/0b/shuffle_49_0_0.data.3bb488a5-a3ce-49bc-8db8-772ac8adbc6b
(No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowing_1560708238.33_0a1f9105-272d-46d1-8e24-f9c22b852cee failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-32015828-0a69-49c7-a701-e4a62c2d9d26/36/temp_shuffle_f845e2aa-e324-42b2-b890-01e4c99888a0
(No such file or directory)
----------------------------------------------------------------------
Ran 38 tests in 79.468s
FAILED (errors=21, skipped=10)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'>
line: 251
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 51s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/sgih5gghkzlzo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
