See
<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/70/display/redirect?page=changes>
Changes:
[github] fix minor typo
------------------------------------------
[...truncated 1.07 MB...]
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_create_1560189796.37_7d7e458f-166b-4f51-a51a-13db2114b100 failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/0a/shuffle_6_0_0.index.f46a353b-3d1f-4d1e-9094-ca00400159d1
(No such file or directory)
======================================================================
ERROR: test_flatten (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 543, in
test_flatten
assert_that(res, equal_to(['a', 'b', 'c'] + additional))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_flatten_1560189801.14_a8ac68ef-5e7f-4485-ae0e-9f7884627525 failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/31/temp_shuffle_e338f2a4-e60f-4d4a-adbe-e58933ec7d79
(No such file or directory)
======================================================================
ERROR: test_flattened_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/portability/spark_runner_test.py";,>
line 144, in test_flattened_side_input
with_transcoding=False)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 234, in
test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_flattened_side_input_1560189802.81_805fbb0b-bfad-48d1-9b5a-6c7ca9af7882
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/11/shuffle_10_2_0.data.2faeab6b-92c4-43b6-af82-306d78a49da6
(No such file or directory)
======================================================================
ERROR: test_gbk_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 242, in
test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_gbk_side_input_1560189809.86_0af9e2ae-09ae-4897-9183-ae3f9ce875cd failed
in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/11/shuffle_12_0_0.data.4105f877-3211-41be-ae2c-f7ee41d95f37
(No such file or directory)
======================================================================
ERROR: test_group_by_key (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 525, in
test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_group_by_key_1560189814.17_4d05c2d9-1f30-4fe4-983d-b9114d0df0f6 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/09/temp_shuffle_0f78801c-d7bf-46ad-8553-fe3ad2558bba
(No such file or directory)
======================================================================
ERROR: test_large_elements (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 592, in
test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_large_elements_1560189816.15_e23957ea-7568-46a4-a104-c5185b815353 failed
in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/31/shuffle_16_0_0.index.3f5d6a12-bce2-4d1e-bf55-fa2d6c5dfffc
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in
test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_1560189817.7_943af81c-c174-42aa-9a57-30c9c464011f
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/0a/shuffle_17_0_0.data.0c0644d0-4e40-4194-a717-9d26a210fdfa
(No such file or directory)
======================================================================
ERROR: test_multimap_side_input_type_coercion (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 266, in
test_multimap_side_input_type_coercion
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_side_input_type_coercion_1560189819.17_bcb669a3-036a-4b06-a07d-e916b8f2a1bd
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/13/temp_shuffle_7098a8fe-5770-4286-8ad4-a06a82e74532
(No such file or directory)
======================================================================
ERROR: test_no_subtransform_composite (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 642, in
test_no_subtransform_composite
assert_that((pcoll_a, pcoll_b) | First(), equal_to(['a']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_no_subtransform_composite_1560189820.67_cb820a8a-28b7-4e20-9ceb-dc459f080faf
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/36/temp_shuffle_9fa2b51c-5c51-47ef-87c4-631eeaece882
(No such file or directory)
======================================================================
ERROR: test_pardo (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 103, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_1560189824.01_1817bc7b-1a85-42dc-a174-166c22b65079 failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/11/shuffle_21_0_0.data.63d89d24-50a4-48de-85c4-554505785fa6
(No such file or directory)
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 175, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1560189825.69_3264d346-ecf6-4dd3-8b5e-178f8f3d9283
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/0b/temp_shuffle_c1b94ced-546b-4f0d-873f-dbbaeafbbd1b
(No such file or directory)
======================================================================
ERROR: test_pardo_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 186, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_inputs_1560189829.98_ac14cde3-1471-4e7a-bee1-22c6734b0612
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/31/shuffle_25_0_0.index.f9af5d46-256d-4da0-8fa5-19c6fc0b3db0
(No such file or directory)
======================================================================
ERROR: test_pardo_side_outputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 157, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_side_outputs_1560189831.42_4929a1d8-7924-4725-a07d-664262f0fd9e
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/0b/shuffle_27_0_0.data.890ac327-2c3a-42a1-b6c4-68ae833cd3cd
(No such file or directory)
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 213, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1560189845.91_d6d480be-b125-440e-8c05-8c6baae75de5
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/0e/temp_shuffle_0e2a8400-c9e0-4d31-817a-c9a19358be0a
(No such file or directory)
======================================================================
ERROR: test_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 561, in
test_read
equal_to(['a', 'b', 'c']))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_read_1560189849.53_c65cd69b-bc61-4a7b-bd6a-d3c90f502cf5 failed in state
FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/13/shuffle_36_0_0.data.89cb26a9-42e8-40f9-9494-634667fd47f7
(No such file or directory)
======================================================================
ERROR: test_reshuffle (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 531, in
test_reshuffle
equal_to([1, 2, 3]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_reshuffle_1560189851.46_a550c33f-5a54-4b97-b734-eec1bda9479d failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/36/shuffle_39_0_0.data.173fd99b-b2b2-4a6d-be6d-3293c47a4d76
(No such file or directory)
======================================================================
ERROR: test_sdf_wrapper_overrides_read (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/mock-2.0.0-py2.7.egg/mock/mock.py";,>
line 1305, in patched
return func(*args, **keywargs)
File "apache_beam/runners/portability/fn_api_runner_test.py", line 514, in
test_sdf_wrapper_overrides_read
self._run_sdf_wrapper_pipeline(RangeSource(0, 4), ['1'])
File "apache_beam/runners/portability/fn_api_runner_test.py", line 503, in
_run_sdf_wrapper_pipeline
p | beam.io.Read(source)
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_sdf_wrapper_overrides_read_1560189855.08_f977b231-b95e-4e1a-9f11-6b2315ad1b72
failed in state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/36/temp_shuffle_bb61fdf1-0ee9-4e0e-9605-f06875287a6b
(No such file or directory)
======================================================================
ERROR: test_windowing (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 573, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 426, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 436, in
wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_windowing_1560189856.34_d26bd7ef-4804-4d8b-a22c-cef93a636d84 failed in
state FAILED: java.io.FileNotFoundException:
/tmp/blockmgr-89bf5fa4-abe7-4392-91cd-e22f2c1235a8/11/shuffle_43_0_0.data.3ea19299-9975-4c2d-95e9-6406141a3d69
(No such file or directory)
----------------------------------------------------------------------
Ran 37 tests in 79.720s
FAILED (errors=19, skipped=13)
> Task :sdks:python:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build.gradle'>
line: 284
* What went wrong:
Execution failed for task ':sdks:python:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 23s
60 actionable tasks: 47 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/rjuzsj562dcwi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
