See
<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/77/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-4594] Implement state over the FnAPI.
[robertwb] [BEAM-4655] Export state and timers in DoFn translation.
------------------------------------------
[...truncated 566.31 KB...]
File "apache_beam/runners/portability/fn_api_runner_test.py", line 275, in
test_combine_per_key
assert_that(res, equal_to([('a', 1.5), ('b', 3.0)]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_combine_per_key_1537432404.52_6f8341d0-23b6-43df-af36-2a0725b6e1de failed
in state FAILED.
======================================================================
ERROR: test_create (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 63, in
test_create
assert_that(p | beam.Create(['a', 'b']), equal_to(['a', 'b']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_create_1537432404.87_a6958512-ceec-4d66-8b08-500963376566 failed in state
FAILED.
======================================================================
ERROR: test_flatten (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 268, in
test_flatten
assert_that(res, equal_to(['a', 'b', 'c', 'd']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_flatten_1537432405.36_4de14550-e08b-4b01-9f15-205c360b09ec failed in state
FAILED.
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 191, in
test_flattened_side_input
equal_to([(None, {'a': 1, 'b': 2})]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_flattened_side_input_1537432405.86_f727d1ef-3602-45ef-a81e-7038d0e5f17e
failed in state FAILED.
======================================================================
ERROR: test_gbk_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 199, in
test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_gbk_side_input_1537432406.37_822375a7-0db2-4518-8ea6-dfc5d1e2720e failed
in state FAILED.
======================================================================
ERROR: test_group_by_key (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 261, in
test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_group_by_key_1537432406.85_8dfbd2db-f1ae-4dcf-a170-5478496c7913 failed in
state FAILED.
======================================================================
ERROR: test_large_elements (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 317, in
test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_large_elements_1537432407.21_0f0fc6d1-4805-463a-967d-6c8f5a69bcf3 failed
in state FAILED.
======================================================================
ERROR: test_multimap_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 210, in
test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_multimap_side_input_1537432407.77_9c13ebd3-b5f2-47ae-82ab-9ea9ea9c68c3
failed in state FAILED.
======================================================================
ERROR: test_pardo (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 71, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_1537432408.2_9367300b-dac3-4ce8-b9c5-6f9dd1aa87cf failed in state
FAILED.
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 143, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1537432408.68_f750afbc-5e49-435f-9925-3120c6514b25
failed in state FAILED.
======================================================================
ERROR: test_pardo_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 154, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_inputs_1537432409.99_455c6590-ac0c-4e5a-af26-acdc17f5cccd
failed in state FAILED.
======================================================================
ERROR: test_pardo_side_outputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 125, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_outputs_1537432410.4_2b73565c-19ff-45fb-82b5-4ed229d15de5
failed in state FAILED.
======================================================================
ERROR: test_pardo_state_only (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in
test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_state_only_1537432410.91_1e3913e9-a6f0-4f19-8f70-2479c38ea22c failed
in state FAILED.
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 220, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1537432411.24_c9074aa7-0ae8-4814-9ae5-0c0e0e760bfe
failed in state FAILED.
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 181, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1537432411.57_3bce6576-6631-4a32-9e42-d7ce8b4e25fe
failed in state FAILED.
======================================================================
ERROR: test_read (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py";,>
line 78, in test_read
assert_that(lines, lambda lines: len(lines) > 0)
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_read_1537432411.93_9035dece-ad65-47cd-80fe-f63132405db1 failed in state
FAILED.
======================================================================
ERROR: test_windowing (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 298, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_windowing_1537432412.24_4598dacb-3e3c-477f-892c-afe001a4e85b failed in
state FAILED.
----------------------------------------------------------------------
Ran 24 tests in 10.354s
FAILED (errors=17, skipped=5)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreaming FAILED
:beam-sdks-python:flinkCompatibilityMatrixStreaming (Thread[Daemon
worker,5,main]) completed. Took 12.121 secs.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 50s
59 actionable tasks: 54 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/4xtb7trita4gc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
