See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/61/display/redirect>
------------------------------------------
[...truncated 1.03 MB...]
... 3 more
19/06/09 06:03:59 INFO BeamFileSystemArtifactRetrievalService: Manifest at
/tmp/sparktestvb12W9/job_062c926d-c7b8-4cc4-82b9-1748f7de6500/MANIFEST has 0
artifact locations
19/06/09 06:03:59 INFO BeamFileSystemArtifactStagingService: Removed dir
/tmp/sparktestvb12W9/job_062c926d-c7b8-4cc4-82b9-1748f7de6500/
ERROR:root:java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/36/shuffle_42_0_0.index.cffb5598-b90a-4557-a2ad-112f90a41069
(No such file or directory)
INFO:root:Job state changed to FAILED
E
======================================================================
ERROR: test_flattened_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/portability/spark_runner_test.py";,>
line 144, in test_flattened_side_input
with_transcoding=False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 234, in
test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_flattened_side_input_1560060195.51_25dd62a2-f669-4761-a89d-d766b5c0a278
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/11/shuffle_10_2_0.data.7cf49274-7986-484d-9c06-e7ef84b85a40
(No such file or directory)
======================================================================
ERROR: test_gbk_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 242, in
test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_gbk_side_input_1560060199.83_ca700ac1-94f3-4a8e-9bb0-2d37cfc77739 failed
in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/09/temp_shuffle_e3866631-9eb0-439b-8571-f9f78dd171e3
(No such file or directory)
======================================================================
ERROR: test_group_by_key (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 525, in
test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_group_by_key_1560060203.57_45fddde9-359d-4107-9ff9-9a42332d3e36 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/00/temp_shuffle_9aa30592-ca47-4c65-bfb8-aa37e7713e79
(No such file or directory)
======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in
test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_large_elements_1560060206.2_ad3645a1-9d24-4e5b-917c-64c233551723 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/33/shuffle_17_1_0.index.28e9e700-fed2-4b1b-9de7-b1200cb53dc5
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in
test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_1560060211.38_9d01d24b-8f4d-48b3-aff5-ea386c5695dc
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/33/shuffle_18_0_0.index.a731aadc-c2c1-4429-ae37-38b34299d77e
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 266, in
test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_type_coercion_1560060213.21_1ef6878d-c583-4394-acc5-effa54892763
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/11/shuffle_21_0_0.data.7acb69b2-ea68-4f9c-b8ce-21bb31faf2c9
(No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 642, in
test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_no_subtransform_composite_1560060216.42_84fea25c-5ebc-4f84-834c-8352a21d7f52
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/00/temp_shuffle_6aacab1f-2c2b-4823-a932-bb702320659a
(No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_1560060219.4_99c7973d-65b0-4353-9a5e-219da496c81c failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/00/temp_shuffle_d77090e9-dc70-4e9a-9be7-1b8fe870959d
(No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 175, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1560060221.92_cddaacc6-a217-4827-be3a-326f39a7754a
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/0b/shuffle_27_0_0.data.98d18ccb-c61d-4605-819a-f23c47e2a5bc
(No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 186, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_inputs_1560060224.42_02bc2f5c-99df-4da6-b05c-a81ee6e68e90
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/2a/shuffle_28_0_0.data.9aa5a7fa-d442-45eb-a731-6e9e973fcb1b
(No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 157, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_outputs_1560060226.34_a8f8201f-1ba7-448c-acaa-5a390542e259
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/33/temp_shuffle_81ba18c4-a399-4cfb-a555-649a6b75d1a1
(No such file or directory)
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 276, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1560060228.75_4ca61c94-dbf6-4947-98f4-a807446a9343
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/2a/shuffle_31_0_0.index.52308f5c-4f19-4d80-8da9-9410a3e3520d
(No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 213, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1560060230.57_504c2bc0-5684-4fac-b7fb-1e1f3be2ca4f
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/27/temp_shuffle_739555b2-25c7-4561-812c-bc440efc02db
(No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 561, in
test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_read_1560060231.87_87123a77-f1c2-44b7-83ef-f529a262b46b failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/11/shuffle_34_0_0.data.9fe5f6f8-61d6-49ec-9ea0-6f7076d69f75
(No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 531, in
test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_reshuffle_1560060233.21_9b5b0fa5-71b6-4c6d-8c09-b0b5b74b291a failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/13/shuffle_36_0_0.data.31fcfc0c-2ce6-4b41-a385-1a9ceb04dbda
(No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py";,>
line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 514, in
test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrapper_overrides_read_1560060237.53_bcca866e-607e-4d12-980e-087931df294a
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/36/shuffle_39_0_0.data.528b2ead-b473-4524-a13f-a58ae3244a84
(No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 573, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowing_1560060238.67_9185413a-5935-4d5a-a392-5a99ba2e4f4f failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-c6bd4d52-9b54-4c52-ad4d-4c3141aab1e9/36/shuffle_42_0_0.index.cffb5598-b90a-4557-a2ad-112f90a41069
(No such file or directory)
----------------------------------------------------------------------
Ran 37 tests in 74.373s
FAILED (errors=17, skipped=13)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'>
line: 284
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 45s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/gywnniamec3qu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
