See
<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/66/display/redirect?page=changes>
Changes:
[mxm] [BEAM-3089] Use Flink cluster parallelism if no parallelism provided
[mxm] [flink] Revert default checkpointing mode to EXACTLY_ONCE
[mxm] [flink] Use default value for checkpoint timeout
[mxm] [flink] Set default master url to [auto]
[mxm] [BEAM-3089] Test default values of FlinkPipelineOptions
------------------------------------------
[...truncated 554.29 KB...]
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string =
"{"created":"@1537377970.066969223","description":"Error received from
peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Socket
closed","grpc_status":14}"
>
======================================================================
ERROR: test_combine_per_key (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 251, in
test_combine_per_key
assert_that(res, equal_to([('a', 1.5), ('b', 3.0)]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_combine_per_key_1537377962.55_9dc5c2c9-5a89-4d3a-afab-4abde7aff14b failed
in state FAILED.
======================================================================
ERROR: test_create (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 62, in
test_create
assert_that(p | beam.Create(['a', 'b']), equal_to(['a', 'b']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_create_1537377962.9_f44d3e9f-e0db-4303-9220-efc74eef530e failed in state
FAILED.
======================================================================
ERROR: test_flatten (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 244, in
test_flatten
assert_that(res, equal_to(['a', 'b', 'c', 'd']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_flatten_1537377963.37_5847e5e1-9dcb-4d98-b7e8-7c065f711fe4 failed in state
FAILED.
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 190, in
test_flattened_side_input
equal_to([(None, {'a': 1, 'b': 2})]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_flattened_side_input_1537377963.85_850b5b4c-7ffc-430c-b857-74997d7a0ece
failed in state FAILED.
======================================================================
ERROR: test_gbk_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 198, in
test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_gbk_side_input_1537377964.35_fa5b3274-b981-4be7-8a01-3dd928cbc7dc failed
in state FAILED.
======================================================================
ERROR: test_group_by_key (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 237, in
test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_group_by_key_1537377964.83_3075d79a-a475-4b1b-b860-516674de1e2c failed in
state FAILED.
======================================================================
ERROR: test_large_elements (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 293, in
test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_large_elements_1537377965.16_792bb0d4-423e-44d0-aaac-340e468ae97e failed
in state FAILED.
======================================================================
ERROR: test_multimap_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 209, in
test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_multimap_side_input_1537377965.71_54afc4ca-70b0-41c6-a833-f3deec94a0f5
failed in state FAILED.
======================================================================
ERROR: test_pardo (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 70, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_1537377966.12_5cc43359-61d5-42fb-9527-6ea32f8f170c failed in state
FAILED.
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 142, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1537377966.57_ab3b5fc0-6797-4d18-80a5-97fb0a709ca2
failed in state FAILED.
======================================================================
ERROR: test_pardo_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 153, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_inputs_1537377967.85_ba696465-f340-4ecb-b7c3-5f2c55394a2b
failed in state FAILED.
======================================================================
ERROR: test_pardo_side_outputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 124, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_outputs_1537377968.25_808e71f6-eaa5-4f02-852e-81bd0f97524b
failed in state FAILED.
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 219, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1537377968.76_abad78b6-f83f-4a19-822f-890e7d364895
failed in state FAILED.
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 180, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1537377969.07_26c0ddbb-09e0-47c2-8bbc-70c18ef97284
failed in state FAILED.
======================================================================
ERROR: test_read (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py";,>
line 78, in test_read
assert_that(lines, lambda lines: len(lines) > 0)
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_read_1537377969.4_8e50ca2b-432e-46a4-b058-0f51f3a9cacb failed in state
FAILED.
======================================================================
ERROR: test_windowing (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 274, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_windowing_1537377969.7_ff81949b-7319-46b1-90be-88c284dd5999 failed in
state FAILED.
----------------------------------------------------------------------
Ran 23 tests in 11.330s
FAILED (errors=16, skipped=5)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreaming FAILED
:beam-sdks-python:flinkCompatibilityMatrixStreaming (Thread[Task worker for ':'
Thread 9,5,main]) completed. Took 13.1 secs.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 59s
59 actionable tasks: 54 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/alyzebuxwbdhm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
