See
<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/60/display/redirect?page=changes>
Changes:
[ryan.blake.williams] specify localhost for portable flink VR tests
[ryan.blake.williams] enumerate primitive transforms in portable construction
[github] Update deprecation comment.
[github] Swap from READ_TRANSFORM to PAR_DO_TRANSFORM
[github] Update comment.
[lcwik] Fix tests expectations and minor code fix up.
[ryan.blake.williams] checkstyle nit
[ryan.blake.williams] use artificial subtransforms of primitives
[ryan.blake.williams] import URNs more directly in QueryablePipeline
[ryan.blake.williams] add splittable URNs as primitives
[lcwik] [BEAM-4176] Add the ability to allow for runners to register native
[ryan.blake.williams] add NativeTransform test assertions
------------------------------------------
[...truncated 554.22 KB...]
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string =
"{"created":"@1537309337.807160614","description":"Error received from
peer","file":"src/core/lib/surface/call.cc","file_line":1099,"grpc_message":"Socket
closed","grpc_status":14}"
>
======================================================================
ERROR: test_combine_per_key (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 251, in
test_combine_per_key
assert_that(res, equal_to([('a', 1.5), ('b', 3.0)]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_combine_per_key_1537309329.94_03fd97ca-dd5d-40ef-b6b1-96af9d01b3fc failed
in state FAILED.
======================================================================
ERROR: test_create (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 62, in
test_create
assert_that(p | beam.Create(['a', 'b']), equal_to(['a', 'b']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_create_1537309330.31_2db5da9e-488a-47b4-b65a-3332a66747a6 failed in state
FAILED.
======================================================================
ERROR: test_flatten (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 244, in
test_flatten
assert_that(res, equal_to(['a', 'b', 'c', 'd']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_flatten_1537309330.86_18aa7a9c-f600-4b3f-b908-d06aefaced35 failed in state
FAILED.
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 190, in
test_flattened_side_input
equal_to([(None, {'a': 1, 'b': 2})]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_flattened_side_input_1537309331.37_ec56a120-1c3d-4bec-84cf-35e6014da4a3
failed in state FAILED.
======================================================================
ERROR: test_gbk_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 198, in
test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_gbk_side_input_1537309331.93_b5634110-c0cb-4b05-8811-b6e86f8b423d failed
in state FAILED.
======================================================================
ERROR: test_group_by_key (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 237, in
test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_group_by_key_1537309332.44_93ccaf4d-8256-450e-b2b1-8b202a9c6ad5 failed in
state FAILED.
======================================================================
ERROR: test_large_elements (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 293, in
test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_large_elements_1537309332.78_b64f2730-a6b3-4ee3-bbed-89d18988b192 failed
in state FAILED.
======================================================================
ERROR: test_multimap_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 209, in
test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_multimap_side_input_1537309333.36_e7bb4df6-b093-4dd4-bac2-45b2088176db
failed in state FAILED.
======================================================================
ERROR: test_pardo (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 70, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_1537309333.8_70864512-a83b-4924-b17f-a9f357e29384 failed in state
FAILED.
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 142, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1537309334.28_2f0027f0-234c-4cb4-9402-15eea2b3db84
failed in state FAILED.
======================================================================
ERROR: test_pardo_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 153, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_inputs_1537309335.53_8a5a7406-39ec-457a-b5aa-7c8d39324b07
failed in state FAILED.
======================================================================
ERROR: test_pardo_side_outputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 124, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_outputs_1537309335.94_27876f18-a5e5-400a-a222-2b453d034c71
failed in state FAILED.
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 219, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1537309336.44_b0627c62-683e-4e70-8efb-284f9dcc6a60
failed in state FAILED.
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 180, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1537309336.77_b7edd4ad-bf7e-4349-a027-233397efcd18
failed in state FAILED.
======================================================================
ERROR: test_read (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py";,>
line 78, in test_read
assert_that(lines, lambda lines: len(lines) > 0)
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_read_1537309337.13_29ae7a9f-06c5-4142-8ac1-e37ad65b1f26 failed in state
FAILED.
======================================================================
ERROR: test_windowing (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 274, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_windowing_1537309337.43_7e7fbc97-98f6-4915-887d-776ede555955 failed in
state FAILED.
----------------------------------------------------------------------
Ran 23 tests in 11.535s
FAILED (errors=16, skipped=5)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreaming FAILED
:beam-sdks-python:flinkCompatibilityMatrixStreaming (Thread[Task worker for ':'
Thread 4,5,main]) completed. Took 13.683 secs.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 9s
59 actionable tasks: 54 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/fdbdx6dch63lu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
