See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/143/display/redirect>
------------------------------------------
[...truncated 1.10 MB...]
RuntimeError: Pipeline
test_large_elements_1560729804.48_beacfb4c-3ba9-4167-bd7e-c46bfb169c1a failed
in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/31/shuffle_16_0_0.index.7c9757e8-bd8d-4663-8953-320ae8b06c03
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 254, in
test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_1560729806.15_277ca84a-7ee6-4121-8d43-9fb1a46c6a44
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/0e/shuffle_17_0_0.index.7b5451b3-15af-4a34-be31-e4b20a6765d3
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 267, in
test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_type_coercion_1560729807.65_6a51db56-8324-413a-8379-f422e8130fb1
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/33/shuffle_18_0_0.index.c90e96fe-64f9-4a1e-84e9-ee939b31cb4f
(No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 104, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_1560729812.84_cd32e596-e73f-4863-a400-10387ee86d35 failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/24/temp_shuffle_120ed17e-08d1-4b8c-8988-ea924640ab9d
(No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 176, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1560729814.26_5ccb563d-f62f-43db-a7f1-28d909563780
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/25/temp_shuffle_00d76138-3363-4144-a86c-ae381c678add
(No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 187, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_inputs_1560729818.59_63382fbd-02ef-42f7-97ef-03dbc0ccf2d2
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/01/temp_shuffle_b141119d-2df4-48d5-9757-a49f1051a6c5
(No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 158, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_outputs_1560729820.0_fadb1194-c21c-4d10-94be-452fd4cd4c77
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/0b/shuffle_27_0_0.data.3acf8f8a-ace2-4115-826e-4e04b83e84c5
(No such file or directory)
======================================================================
ERROR: test_pardo_state_only (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 308, in
test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_state_only_1560729821.41_aa295188-cbba-45e5-aebb-8ca8a851de4e failed
in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/0b/temp_shuffle_fc435a97-a342-4f56-8852-e9cbaa8728aa
(No such file or directory)
======================================================================
ERROR: test_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 401, in
test_pardo_state_timers
self._run_pardo_state_timers(False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in
_run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_state_timers_1560729823.54_600a177b-1a5b-4e8e-b300-44f77401ddf8
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/0e/temp_shuffle_18e5e656-8f18-4371-a811-797b8265f81d
(No such file or directory)
======================================================================
ERROR: test_pardo_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 361, in
test_pardo_timers
assert_that(actual, equal_to(expected))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_timers_1560729824.81_98a06098-38ed-4a14-8a97-bf032963081c failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/13/shuffle_36_0_0.data.49f088ec-512c-4f9b-a5a0-7b8c43e7cb68
(No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 277, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1560729826.12_cf6cbccd-548c-4c73-9134-56bf847bfd2a
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/3d/temp_shuffle_73ce8827-9959-4dd2-a431-0896852d912f
(No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 214, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1560729829.34_f451786b-2b36-4216-9b9a-bbd20808dbdf
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/36/shuffle_39_0_0.data.5173ce70-fe5e-4169-a8a4-96073e0cd0e6
(No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in
test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_read_1560729830.68_75463dd2-f890-4975-b1c0-6092cdd39f1f failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/13/shuffle_41_0_0.data.06a9ecb9-2c8d-41aa-886a-65b535ad094a
(No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 562, in
test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_reshuffle_1560729831.93_d8a2aeb2-3ab5-4053-bfc7-34aa95c19a21 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/11/shuffle_43_0_0.data.82de5dc6-cceb-4639-91e2-f3c9e2dd887c
(No such file or directory)
======================================================================
ERROR: test_sdf_wrap_range_source (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 548, in
test_sdf_wrap_range_source
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), [0, 1, 2, 3])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrap_range_source_1560729834.08_f63dd0be-6efc-4ba0-971a-b42f4bb2c80e
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/33/shuffle_45_0_0.index.1d508dfd-ce75-4084-a012-0b5efd9e9fcc
(No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py";,>
line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 545, in
test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 534, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrapper_overrides_read_1560729835.15_e7b3c14f-8672-4ad5-a10e-7899e36496cf
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/0b/temp_shuffle_5994c0ce-d055-4e28-acc5-0d0da15ef08e
(No such file or directory)
======================================================================
ERROR: test_windowed_pardo_state_timers (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 404, in
test_windowed_pardo_state_timers
self._run_pardo_state_timers(True)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 461, in
_run_pardo_state_timers
assert_that(actual, is_buffered_correctly)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowed_pardo_state_timers_1560729836.3_cd136f92-64a2-4d7c-8d49-9ec40b15b7cd
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/0b/shuffle_49_0_0.data.46144837-70bc-4cdf-96af-f5d3287a6e3d
(No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 604, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 454, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowing_1560729837.6_f4e86237-05fe-4678-aa2f-6bbeba184062 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-7c2061a3-3d00-4a5a-9f98-e659b4ea11d6/33/shuffle_52_0_0.data.0a72eec0-130d-4e61-a68a-a17fcc233d2b
(No such file or directory)
----------------------------------------------------------------------
Ran 38 tests in 78.502s
FAILED (errors=21, skipped=10)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'>
line: 251
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/n3l4kad5w6yoa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
