See
<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/86/display/redirect?page=changes>
Changes:
[herohde] Add Go quickstart link to the footer
[xiliu] [BEAM-3079]: Samza Runner docs and capability matrix
[xiliu] Update the option docs
[xinyuliu.us] Add Samza to the runner list
[klk] Add a pull request template with staged URL
[apilloud] Add SQL Lexical Structure from BigQuery
[mergebot] Add Apache license headers
[apilloud] Update keywords from BeamSqlParserImplConstants
[apilloud] Update CREATE TABLE from doc
[apilloud] Move CREATE TABLE and SELECT up a level
[mergebot] Update contact-us.md
[mergebot] Spelling correction
[apilloud] Add redirect to new team page
[apilloud] Add SQL Set page
[boyuanz] Update release guide for download page changes
[klk] Make Samza icon a reasonable size
[klk] Alphabetize runners
[mergebot] New blog post about 2.5.0 release
[amaliujia] Update doc
[echauchot] [BEAM-4731] update flink submission port because flink 1.5 new
standard
[mergebot] Adding YouTube channel page
[mergebot] Processing feedback
[mergebot] YouTube url update
[lcwik] [BEAM-3940] Remove reference to updating container version in pom.xml
[lcwik] Fix typos in programming guide
[lcwik] Fix typos in mobile gaming example
[kirpichov] Updates SDF status in capability matrix
[mergebot] Added new design documents
[mergebot] [BEAM-4430] Improve Performance Testing Documentation
[mergebot] Rename RowType to Schema in SQL walkthrough
[mergebot] Minor tweak to Intellij instructions.
[mergebot] fixup
[melissapa] [BEAM-2977] Improve unbounded prose in wordcount example
[mergebot] [BEAM-4188] Fix 2.4.0 release notes link
[mergebot] Update code style section to mention Spotless.
[mergebot] Clarify that this is only for Java/Groovy and not Python/Go/...
[lcwik] [BEAM-4828] Updated documentation, added SQS BEAM-4828 to In-Progress
[github] Update Python quickstart with Windows instructions
[mergebot] Add courtesy unsubscribe links to mailing lists
[melissapa] Fix shell tabs, add new shell tab switcher
[mergebot] Add a page for release cadence
[mergebot] updated the language
[mergebot] fix the space
[mergebot] [BEAM-4827] Add Nexmark dashboards to nexmark page on the website
[mergebot] [BEAM-4827] Fix typos
[mergebot] Add Flink instructions to portability contrib page.
[mergebot] Add instructions for local Flink cluster.
[mergebot] Update Java Quickstart for Windows
[mergebot] Update quickstart-java.md
[github] Update quickstart-java.md
[mergebot] [BEAM-4802] Update the contribution guide (Dependency section)
[migryz] Add post-commit tests policies summary page.
[migryz] Fix links
[github] Remove [TOC]
[migryz] Update postcommits guides
[ehudm] Remove testing matrix and simplify intro.
[mergebot] Moves KuduIO from in progress to available
[timrobertson100] [BEAM-4260] Document HCatalogIO use with Hive 1.1
[mergebot] Remove old pydoc and javadoc for versions < 2.0.0.
[apilloud] [BEAM-4761] Add Dataflow Runner
[mergebot] Update beam-site for release 2.6.0
[mergebot] Update download page
[mergebot] Updating downloads page.
[melissapa] Fix broken 2.5.0 download links
[mergebot] go version
[mergebot] Add section for SQL shell
[mergebot] Adding 'editable mode' flag installation for Python.
[thw] fix job service startup instruction
[mergebot] Fix Apex Runner instructions for execution on YARN
[mergebot] Update SQL walkthrough for 2.6.0
[github] Adding Pablo Estrada as author for blog
[github] Blog post for Beam 2.6.0 release
[github] Added Rafael Fernandez as author.
[rfernand] Adds Jenkinns job pointer to #building--testing
[rfernand] Minor rewrite to help newcomers explore the project's building and
[thw] fixup
[mergebot] Add instructions of using automation scripts
[mergebot] Fix broken tests
[mergebot] Addressed Ahmet's comments
[mergebot] Fixing 2.6.0 blog post
[mergebot] Quick fixes to layout
[mergebot] Address readability reviews
[mergebot] Grammar pass + pretty print
[mergebot] All files have Apache License
[mergebot] Add instructions about how to build python wheels
[mergebot] Add long term support release concept
[mergebot] Edit suggestions
[mergebot] Add precommit policies and triage guide.
[mergebot] Add dashes to pre-commit and post-commit.
[mergebot] Update programming guide to suggest using NewDoFn approach to
[mergebot] Address comments.
[mergebot] Add compatibility warning.
[mergebot] Fix language tab tags
[mergebot] Add blog post "A review of input streaming connectors"
[mergebot] Add authors for blog post in
[mergebot] Fix typo for author's name in blog post
[mergebot] Fix other typo in author's name for blog post
[mergebot] Blog post updates based on @iemejia's feedback
[mergebot] Updates to streaming connectors blog post
[mergebot] Set publication date for streaming connectors blog post
[mergebot] Update doc links in blog post to point to latest release
[mergebot] Fix extraneous p tag and add table borders
[mergebot] Update streaming connectors blog post's publication date
[mergebot] Update to LTS wording to remove every Nth release clause.
[mergebot] Edit suggestions
[baetensmatthias] Beam Summit blogpost
[github] Update intellij.md
[mergebot] Update Portable Flink cluster run instructions
[mergebot] Update eclipse.md
[mergebot] Contribute: document how to find and add reviewers
[mergebot] Remove the [PROPOSAL] label of the @RequiresStableInput design doc
[mergebot] Fix portable Flink runner instructions.
[boyuanz] Add instructions about how to configure github https access
[boyuanz] Add instructions about how to close apache staging repo
[boyuanz] Add instructions about the permission of creating new version in JIRA
[amyrvold] Add details for getting the Jira contributor role
[github] Rephrasing a bit.
[mergebot] Remove outdated IntelliJ information
[mergebot] Add information on OutOfMemory errors during build
[mxm] [BEAM-5418] Add Flink version compatibility table to Runner page
[mxm] Add note about portability efforts to Flink Runner page
[mxm] Remove incorrect runtime scope from Maven configuration
[mxm] Use default Scala 2.11 syntax for artifact name
[scott] [BEAM-4568] Add Apache headers to new source pages.
[scott] Exclude website PULL_REQUEST_TEMPLATE from Rat.
------------------------------------------
[...truncated 566.89 KB...]
File "apache_beam/runners/portability/fn_api_runner_test.py", line 275, in
test_combine_per_key
assert_that(res, equal_to([('a', 1.5), ('b', 3.0)]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_combine_per_key_1537486008.79_672c9109-c6be-47c9-9bd7-e55cb8e80da2 failed
in state FAILED.
======================================================================
ERROR: test_create (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 63, in
test_create
assert_that(p | beam.Create(['a', 'b']), equal_to(['a', 'b']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_create_1537486009.14_f2fe9d40-33c0-448e-ad66-def34b964a6e failed in state
FAILED.
======================================================================
ERROR: test_flatten (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 268, in
test_flatten
assert_that(res, equal_to(['a', 'b', 'c', 'd']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_flatten_1537486009.66_4cf1df66-4385-4576-a98c-16d6618d02a7 failed in state
FAILED.
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 191, in
test_flattened_side_input
equal_to([(None, {'a': 1, 'b': 2})]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_flattened_side_input_1537486010.18_76528e80-4f56-4bc1-97fc-880780d8acb1
failed in state FAILED.
======================================================================
ERROR: test_gbk_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 199, in
test_gbk_side_input
equal_to([(None, {'a': [1]})]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_gbk_side_input_1537486010.72_9ffc1fa5-82b4-4c1c-8a67-8319928a218b failed
in state FAILED.
======================================================================
ERROR: test_group_by_key (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 261, in
test_group_by_key
assert_that(res, equal_to([('a', [1, 2]), ('b', [3])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_group_by_key_1537486011.24_2eef3cbf-7148-4b71-93fd-24f0f56b9e4f failed in
state FAILED.
======================================================================
ERROR: test_large_elements (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 317, in
test_large_elements
assert_that(gbk_res, equal_to(['a', 'b']), label='gbk')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_large_elements_1537486011.64_254c848e-2cfe-4291-bb34-ef7044b31b79 failed
in state FAILED.
======================================================================
ERROR: test_multimap_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 210, in
test_multimap_side_input
equal_to([('a', [1, 3]), ('b', [2])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_multimap_side_input_1537486012.22_4cd54bec-2d17-4c72-b35c-274d8681e800
failed in state FAILED.
======================================================================
ERROR: test_pardo (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 71, in
test_pardo
assert_that(res, equal_to(['aax', 'bcbcx']))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_1537486012.64_5384a668-9673-46c9-b12e-e1fc2f26284c failed in state
FAILED.
======================================================================
ERROR: test_pardo_side_and_main_outputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 143, in
test_pardo_side_and_main_outputs
assert_that(unnamed.odd, equal_to([1, 3]), label='unnamed.odd')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_and_main_outputs_1537486013.12_e7ec03de-3c57-4a35-afa7-6ded3cdd2c64
failed in state FAILED.
======================================================================
ERROR: test_pardo_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 154, in
test_pardo_side_inputs
('a', 'y'), ('b', 'y'), ('c', 'y')]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_inputs_1537486014.39_241f537d-96eb-4cf0-a979-e859dcb31cc7
failed in state FAILED.
======================================================================
ERROR: test_pardo_side_outputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 125, in
test_pardo_side_outputs
assert_that(xy.y, equal_to(['y', 'xy']), label='y')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_side_outputs_1537486014.79_cd2e3587-c394-4d77-b8ab-c7cf7146adc5
failed in state FAILED.
======================================================================
ERROR: test_pardo_state_only (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 253, in
test_pardo_state_only
equal_to(expected))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_state_only_1537486015.28_cd6292ca-ebd8-4351-9114-5dd3588786b4 failed
in state FAILED.
======================================================================
ERROR: test_pardo_unfusable_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 220, in
test_pardo_unfusable_side_inputs
equal_to([('a', 'a'), ('a', 'b'), ('b', 'a'), ('b', 'b')]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_unfusable_side_inputs_1537486015.61_a15ac6d0-a519-49b2-9535-1da746ea958a
failed in state FAILED.
======================================================================
ERROR: test_pardo_windowed_side_inputs (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 181, in
test_pardo_windowed_side_inputs
label='windowed')
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_pardo_windowed_side_inputs_1537486015.93_d9cc2450-1870-47f9-bc81-8c54e7455a04
failed in state FAILED.
======================================================================
ERROR: test_read (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",>
line 78, in test_read
assert_that(lines, lambda lines: len(lines) > 0)
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_read_1537486016.29_e3b1828c-5cfb-4b2a-a33c-342a6524d0cc failed in state
FAILED.
======================================================================
ERROR: test_windowing (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 298, in
test_windowing
assert_that(res, equal_to([('k', [1, 2]), ('k', [100, 101, 102])]))
File "apache_beam/pipeline.py", line 414, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 209, in
wait_until_finish
'Pipeline %s failed in state %s.' % (self._job_id, self._state))
RuntimeError: Pipeline
test_windowing_1537486016.6_5e61ac90-8972-4dd5-87ce-c5fc85e6c1f4 failed in
state FAILED.
----------------------------------------------------------------------
Ran 24 tests in 10.446s
FAILED (errors=17, skipped=5)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreaming FAILED
:beam-sdks-python:flinkCompatibilityMatrixStreaming (Thread[Task worker for ':'
Thread 10,5,main]) completed. Took 12.211 secs.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python_PVR_Flink_Gradle/ws/src/sdks/python/build.gradle'>
line: 340
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 49s
59 actionable tasks: 54 executed, 4 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/3f7difpqxdo3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure