GitHub user peihe opened a pull request:
https://github.com/apache/beam/pull/4091
Merge branch 'master' upto commit 269bf89 into mr-runner
Follow this checklist to help us incorporate your contribution quickly and
easily:
- [ ] Make sure there is a [JIRA
issue](https://issues.apache.org/jira/projects/BEAM/issues/) filed for the
change (usually before you start working on it). Trivial changes like typos do
not require a JIRA issue. Your pull request should address just this issue,
without pulling in other changes.
- [ ] Each commit in the pull request should have a meaningful subject
line and body.
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA
issue.
- [ ] Write a pull request description that is detailed enough to
understand what the pull request does, how, and why.
- [ ] Run `mvn clean verify` to make sure basic checks pass. A more
thorough check will be performed on your pull request automatically.
- [ ] If this contribution is large, please file an Apache [Individual
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/peihe/incubator-beam mr-runner
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/4091.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4091
----
commit 7165e55d624d41f29536286d7975fa78ab819f0d
Author: Kai Jiang <[email protected]>
Date: 2017-10-04T06:41:32Z
PipelineOptionsFactory should prevent non PipelineOptions interfaces from
being constructed
commit dc3e2f756caf29309bcfb54321f390d50787a49b
Author: Luke Cwik <[email protected]>
Date: 2017-10-11T23:10:12Z
[BEAM-2779] PipelineOptionsFactory should prevent non PipelineOptions
interfaces from being constructed
This closes #3949
commit b1a22a89bd0d66db2754ba86f85d418a8122f9ea
Author: Luke Cwik <[email protected]>
Date: 2017-10-06T16:09:17Z
[BEAM-3016] Fix blocking issue within run() when channel terminates while
blocking within DirectStreamObserver.
commit 6dd90d89d3d324c9f9f8cb2b1faf38fe525f0a10
Author: Luke Cwik <[email protected]>
Date: 2017-10-11T23:12:49Z
[BEAM-3016] Fix blocking issue within run() when channel terminates while
blocking within DirectStreamObserver.
This closes #3944
commit 5fba6326ecf49a197b1fb0f4402f05cdd64dc124
Author: Henning Rohde <[email protected]>
Date: 2017-10-12T00:44:50Z
[BEAM-2576] Reflect portability proto changes in Go
commit d22a33243b5979ddf8d00488960fc32939cdac8b
Author: Henning Rohde <[email protected]>
Date: 2017-10-12T01:01:01Z
Add licenses to generated code
commit 8e1caea64f3e303a5b711ba8f50952cb5af9253a
Author: Kenneth Knowles <[email protected]>
Date: 2017-10-12T01:39:37Z
This closes #3983: [BEAM-2576] Reflect portability proto changes in Go
Add licenses to generated code
[BEAM-2576] Reflect portability proto changes in Go
commit 7b6556c7f7914be108945c2f877fe7e84ec057ba
Author: Ahmet Altay <[email protected]>
Date: 2017-10-12T00:52:35Z
Improve the documentation for CombineFn
commit 655227ab0a077684735915fbdf7d0ada5cb5b3bf
Author: Ahmet Altay <[email protected]>
Date: 2017-10-12T16:55:09Z
This closes #3984
commit 22f9263e66aaf5ba1c591850f36e31a1481da6e4
Author: Holden Karau <[email protected]>
Date: 2017-09-02T02:43:06Z
Futurize stage 1 run (AUTOMATED futurize)
commit dd6a78992fb66e49ff53ae69114f0d682be0888f
Author: Holden Karau <[email protected]>
Date: 2017-09-02T02:53:42Z
Add futurize to pylint script
Break down futurize pylint
Fix the pylint script checking futurize
Consists of:
Quote the futurize options shell scripting
Jenkins seems to be having weird behaviour with futurize_filtered=,
temporary debugging commit
Try quoting the count line.
Do the style fixes from shellcheck on pylint, parallilize futurize command
& simplify the grep on output
Fall through on grep exit code of 1 which happens when everything is
filtered out & change count check to 0
Remove some debugging from pylint
commit 94739377e02e992d21f24257189acd1c4ece9d42
Author: Holden Karau <[email protected]>
Date: 2017-09-02T02:56:11Z
re-order imports (AUTOMATED isort)
commit 7d0040dbc680e4c144311303014c3feffdc90b60
Author: Holden Karau <[email protected]>
Date: 2017-09-02T02:57:19Z
Cleanup whitespace (AUTOMATED autopep8)
commit 5cc6b5f17e0e1e117a8cd237d4c7be8d7fce8a17
Author: Holden Karau <[email protected]>
Date: 2017-09-02T03:49:40Z
Change the ptransform_test to use assertEqual rather than assertTrue for
improved debugging, fix the error message we're looking for since we now throw
a tuple exception instead
commit f364248b984e8ff884a34b37d49a17fa1a50cc26
Author: Holden Karau <[email protected]>
Date: 2017-09-02T03:51:18Z
Add special work to handle indexable return types. Introduce a base
IndexableTypeConstraint.
commit cd702b3e7ea81fe41952066cfe9a1892d5433bd9
Author: Holden Karau <[email protected]>
Date: 2017-09-02T04:38:47Z
Fix remaining style issues from auto conversion, switch ref in pylint to
stage 1 (stages in futurize are apparently 1 indexed)
commit c0bc5840084e46e68d9fcff38aacf125f01a8613
Author: Holden Karau <[email protected]>
Date: 2017-09-02T04:43:35Z
Restore license position that got screwed up
commit fe0dc2e225a9fca16dbf6ccd77de36fcae4a2484
Author: Holden Karau <[email protected]>
Date: 2017-09-02T07:02:24Z
Add future to deps and explicitly set isort req and update pylint in tox ini
commit a795e545157d20099c82970e4e2c302aa151413b
Author: Holden Karau <[email protected]>
Date: 2017-09-06T23:15:10Z
Change the xxx_todo_changeme[x]s to reasonable values
commit 252c67982a036e5dee4518d96479622cea0d662b
Author: Holden Karau <[email protected]>
Date: 2017-09-07T00:10:00Z
Parallelize pylint
commit bf910c118b6940fef951d4441762b4c55b199ec1
Author: Holden Karau <[email protected]>
Date: 2017-09-08T04:26:51Z
Clarify docstring and update run_pylint to be more clear about what steps
the developer can take
commit 14cf6a13a3e3152ca8f168535500a95f16db07b2
Author: Holden Karau <[email protected]>
Date: 2017-09-08T06:38:37Z
Re-order comment (reviewer feedback)
commit cf2be415b9b407b2d3791310a74d76b3e46fc1fa
Author: Holden Karau <[email protected]>
Date: 2017-09-08T06:38:52Z
Break out the exclusion list for futurize
commit 3b0ad58cd68ee0790ac1f10ddffa96a866d85a0c
Author: Holden Karau <[email protected]>
Date: 2017-09-08T19:56:27Z
Change the examples with long-lambdas which were pulled out into defs to
use explicit tuple unpacking instead of indexing. Note: this still keeps the
lambdas which are short enough and those use indexing (as required).
commit 3a04dbe46debc2c4aa188b210870a24dc1408bf1
Author: Holden Karau <[email protected]>
Date: 2017-10-10T19:31:16Z
pr/cl-feedback from c-y-koo
commit 9de10e2d80ce15c5881b26f6436d28cccf60e18b
Author: Holden Karau <[email protected]>
Date: 2017-10-12T06:46:28Z
Fix snippets
commit 9c2a6e771d30e3e120b941bd2d450a00d8b7f091
Author: Robert Bradshaw <[email protected]>
Date: 2017-10-12T22:54:09Z
Closes #3804
commit b63a3eb082be24c74e1cb5f56b60c4c3dd38f728
Author: Scott Wegner <[email protected]>
Date: 2017-10-11T21:14:22Z
Increment dataflow client version
commit 6055d280a4ae1d9018e4644d671748341162af4b
Author: Thomas Groh <[email protected]>
Date: 2017-10-12T23:31:08Z
This closes #3980
commit 2d147eb21f98f5668ff5e2cc497b8d3e5fae9c20
Author: Luke Cwik <[email protected]>
Date: 2017-10-12T16:49:06Z
[BEAM-3048] Remove RAND_RANGE in WindowedWordCount
----
---
