[GitHub] beam pull request #1903: [BEAM-1378] Release-0.5.0 cherry pick: Drop late da...

2017-02-01 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1903 [BEAM-1378] Release-0.5.0 cherry pick: Drop late data in Flink runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #1925: Add git .mailmap file

2017-02-06 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/1925 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam-site pull request #149: [BEAM-25,BEAM-27] Update the capability matrix ...

2017-02-08 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam-site/pull/149 [BEAM-25,BEAM-27] Update the capability matrix for state and timers The clarity of the model spec for state and timers are at parity with other model features, and both state and timers

[GitHub] beam pull request #1940: [BEAM-1413] Fix some DoFn javadoc literals

2017-02-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1940 [BEAM-1413] Fix some DoFn javadoc literals Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted

[GitHub] beam pull request #1929: [BEAM-362] Move a few more remnants of internal sta...

2017-02-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1929 [BEAM-362] Move a few more remnants of internal state to runners/core-java Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #1946: [BEAM-115] Add proto definition for Runner API

2017-02-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1946 [BEAM-115] Add proto definition for Runner API Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title

[GitHub] beam pull request #1925: Add git .mailmap file

2017-02-05 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1925 Add git .mailmap file Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like: `[BEAM

[GitHub] beam pull request #1827: [BEAM-27] Allow absolute timers

2017-01-23 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1827 [BEAM-27] Allow absolute timers Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #1855: Add wrapping of lambda in a SimpleFunction

2017-01-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1855 Add wrapping of lambda in a SimpleFunction Here's a fun trick for getting a type descriptor attached to a lambda that seems nicer than `.withOutputType(...)`. For discussion. You can merge

[GitHub] beam pull request #1858: [BEAM-362] Move state-oriented remnants of OldDoFn ...

2017-01-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1858 [BEAM-362] Move state-oriented remnants of OldDoFn to runners/core-java Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #1856: [BEAM-1326] Add prefix and suffix to WindowedWordCo...

2017-01-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1856 [BEAM-1326] Add prefix and suffix to WindowedWordCountIT output location Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #2065: [BEAM-115,BEAM-1348] Unify Runner API and Fn API co...

2017-02-21 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2065 [BEAM-115,BEAM-1348] Unify Runner API and Fn API coders Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title

[GitHub] beam pull request #2011: [BEAM-115,BEAM-1348] Unify Fn API and Runner API UD...

2017-02-21 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/2011 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2030: [BEAM-115,BEAM-1328] Convert to/from WindowingStrat...

2017-02-16 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2030 [BEAM-115,BEAM-1328] Convert to/from WindowingStrategy proto in Java SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #1990: [BEAM-1347,BEAM-1348] Use strings for ids in Fn API

2017-02-23 Thread kennknowles
GitHub user kennknowles reopened a pull request: https://github.com/apache/beam/pull/1990 [BEAM-1347,BEAM-1348] Use strings for ids in Fn API Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title

[GitHub] beam pull request #2094: [BEAM-115] Concretize generic bits of the Runner AP...

2017-02-23 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2094 [BEAM-115] Concretize generic bits of the Runner API graph structure Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #2065: [BEAM-115,BEAM-1348] Unify Runner API and Fn API co...

2017-02-23 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/2065 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2103: [BEAM-1550] Ignore HBaseIOTest temporarily

2017-02-24 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2103 [BEAM-1550] Ignore HBaseIOTest temporarily Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted

[GitHub] beam pull request #662: [BEAM-115] WIP: JSON Schema definition of pipeline

2017-02-21 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/662 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2000: [BEAM-115] Unify Fn API and Runner API FunctionSpec

2017-02-13 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2000 [BEAM-115] Unify Fn API and Runner API FunctionSpec Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam-site pull request #152: Add blog post "Stateful Processing with Apache ...

2017-02-09 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam-site/pull/152 Add blog post "Stateful Processing with Apache Beam" This blog post introduces stateful processing in Beam, after a bit of a recap of the basics of the model. You can merge

[GitHub] beam pull request #2007: [BEAM-1113] Re-enable UsesTimersInParDo tests in Da...

2017-02-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2007 [BEAM-1113] Re-enable UsesTimersInParDo tests in Dataflow runner A rather vital commit left out of #1792. Do not review yet; utilizing Jenkins. You can merge this pull request into a Git

[GitHub] beam pull request #2011: [BEAM-115,BEAM-1348] Unify Fn API and Runner API co...

2017-02-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2011 [BEAM-115,BEAM-1348] Unify Fn API and Runner API coder specs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam-site pull request #154: Clarify state further in capability matrix

2017-02-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam-site/pull/154 Clarify state further in capability matrix Some feedback after the blog post was that the term "Keyed State" in the capability matrix is lacking a referent. Basically I got more qu

[GitHub] beam-site pull request #155: Fix typo in stateful processing post

2017-02-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam-site/pull/155 Fix typo in stateful processing post You can merge this pull request into a Git repository by running: $ git pull https://github.com/kennknowles/beam-site typo Alternatively you can

[GitHub] beam pull request #2000: [BEAM-115,BEAM-1348] Unify Fn API and Runner API Fu...

2017-02-14 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/2000 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #1988: [BEAM-1195, BEAM-115] Add full-fidelity conversion ...

2017-02-12 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1988 [BEAM-1195, BEAM-115] Add full-fidelity conversion to/from Java SDK triggers and Runner API protos Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] beam pull request #1792: [BEAM-1113] Set USES_KEYED_STATE for timers in Data...

2017-01-18 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1792 [BEAM-1113] Set USES_KEYED_STATE for timers in Dataflow runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #1752: Make DataflowPipelineTranslator public

2017-01-09 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1752 Make DataflowPipelineTranslator public There are a couple places outside the Beam codebase that still refer to this, and no great reason to break them. Be sure to do all

[GitHub] beam pull request #1742: [BEAM-1038] Rollforwards "Allow stateful DoFn in Da...

2017-01-05 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1742 [BEAM-1038] Rollforwards "Allow stateful DoFn in DataflowRunner"" This rolls forward 42bb15d, allowing stateful DoFn in DataflowRunner. Be sure to do all of the follo

[GitHub] beam pull request #1748: [BEAM-25] Some more RunnableOnService tests for sta...

2017-01-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1748 [BEAM-25] Some more RunnableOnService tests for stateful ParDo Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #1645: Add properties to skip tests for particular modules

2016-12-30 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/1645 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2335: Fix checkArgument error message args

2017-03-27 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2335 Fix checkArgument error message args Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like

[GitHub] beam-site pull request #194: [BEAM-1622] Reword RunnableOnService to Validat...

2017-03-27 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam-site/pull/194 [BEAM-1622] Reword RunnableOnService to ValidatesRunner This is merged to master of the SDK now. It looks to me like a simple grep leaves some confusing wording - mostly wording

[GitHub] beam pull request #1647: [BEAM-1089] Replace "--none--" with a message in Je...

2017-03-30 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/1647 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2189: [BEAM-1645] Populate display data on Window.Assign

2017-03-22 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/2189 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2299: [BEAM-115] Make distinguished URNs public

2017-03-22 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2299 [BEAM-115] Make distinguished URNs public These URNs are in flux and will be relocated to some final good location as the Runner API and Fn API develop. For now, this change just makes them

[GitHub] beam pull request #2359: Needs runner

2017-03-29 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2359 Needs runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM

[GitHub] beam pull request #2353: [BEAM-41,BEAM-42] Revise MapState and SetState APIs...

2017-03-28 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2353 [BEAM-41,BEAM-42] Revise MapState and SetState APIs to leverage ReadableState Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x

[GitHub] beam pull request #2340: [BEAM-1328] DataflowRunner: Send WindowingStrategy ...

2017-03-27 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2340 [BEAM-1328] DataflowRunner: Send WindowingStrategy as proto Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #2301: [BEAM-1770] Remove false disclaimers about state/ti...

2017-03-22 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2301 [BEAM-1770] Remove false disclaimers about state/timers from javadoc Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #2425: Rename filePath to filePattern in NumbedShardedFile

2017-04-04 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2425 Rename filePath to filePattern in NumbedShardedFile R: @reuvenlax @tgroh You can merge this pull request into a Git repository by running: $ git pull https://github.com/kennknowles/beam

[GitHub] beam pull request #2618: [BEAM-1867] Use step-derived PCollection names in D...

2017-04-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2618 [BEAM-1867] Use step-derived PCollection names in Dataflow Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #2623: [BEAM-1871] Inline and remove POutputValueBase

2017-04-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2623 [BEAM-1871] Inline and remove POutputValueBase Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title

[GitHub] beam pull request #2636: [BEAM-2049] Remove KeyedCombineFn

2017-04-21 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2636 [BEAM-2049] Remove KeyedCombineFn Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2215: [BEAM-1674] Exclude UsesTimersInParDo from Flink va...

2017-03-09 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2215 [BEAM-1674] Exclude UsesTimersInParDo from Flink validation test suite Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #2154: [BEAM-1620] WIP: maven config for streaming RoS in ...

2017-03-03 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2154 [BEAM-1620] WIP: maven config for streaming RoS in Dataflow Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #2155: [BEAM-1621] Add streaming executions to examples/ja...

2017-03-03 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2155 [BEAM-1621] Add streaming executions to examples/java integration tests Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #2197: [BEAM-1647] Bump Dataflow ROS timeout to 120 minute...

2017-03-08 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2197 [BEAM-1647] Bump Dataflow ROS timeout to 120 minutes Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title

[GitHub] beam pull request #2221: Remove duplicated dependency from Dataflow runner p...

2017-03-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2221 Remove duplicated dependency from Dataflow runner pom.xml Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #2226: [BEAM-1690] Revert BigQueryIO bit of 'Make all uses...

2017-03-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2226 [BEAM-1690] Revert BigQueryIO bit of 'Make all uses of CountingOutputStream close their resources' This reverts the portion of commit 3115dbdca1858511e98476b5c79e6cca98782b0b that touches

[GitHub] beam pull request #2201: [BEAM-1328] Fixup typo in WindowingStrategies

2017-03-08 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2201 [BEAM-1328] Fixup typo in WindowingStrategies Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title

[GitHub] beam pull request #2198: [BEAM-1611] Explicitly GBK before stateful ParDo in...

2017-03-08 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2198 [BEAM-1611] Explicitly GBK before stateful ParDo in Dataflow batch Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2198: [BEAM-1611] Release 0.6.0 cherry-pick: Explicitly G...

2017-03-08 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/2198 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2207: [BEAM-1663] Use stable naming strategy for ByteBudd...

2017-03-08 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2207 [BEAM-1663] Use stable naming strategy for ByteBuddy invokers This helps to coalesce related failures across multiple JVM instances, over time, across machines, etc. Be sure to do

[GitHub] beam pull request #2172: Revert "DataflowRunner: experimental support for is...

2017-03-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2172 Revert "DataflowRunner: experimental support for issuing FnAPI based jobs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[GitHub] beam pull request #2173: [BEAM-1624] Add tests for serialization of BigQuery...

2017-03-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2173 [BEAM-1624] Add tests for serialization of BigQueryIO.TableRowInfoCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #2147: [BEAM-1611] Explicitly GBK before stateful ParDo in...

2017-03-02 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/2147 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2189: [BEAM-1645] Populate display data on Window.Assign

2017-03-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2189 [BEAM-1645] Populate display data on Window.Assign Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2185: [BEAM-1645] Populate display data on Window.Assign

2017-03-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2185 [BEAM-1645] Populate display data on Window.Assign Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2188: Enable WindowedWordCountIT on Flink runner in presu...

2017-03-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2188 Enable WindowedWordCountIT on Flink runner in presubmit Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2413: [BEAM-1864] Rename CombiningState and friends to be...

2017-04-03 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2413 [BEAM-1864] Rename CombiningState and friends to be more user-friendly Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #2340: [BEAM-1328] DataflowRunner: Send WindowingStrategy ...

2017-04-18 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/2340 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3516: [BEAM-2557] Move DirectRunner knob for suppressing ...

2017-07-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3516 [BEAM-2557] Move DirectRunner knob for suppressing runner-determined sharding out… … of core SDK Be sure to do all of the following to help us incorporate your contribution

[GitHub] beam pull request #3519: [BEAM-2486] Cherry pick for 2.1.0: Reject stateful ...

2017-07-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3519 [BEAM-2486] Cherry pick for 2.1.0: Reject stateful ParDo if coder not deterministic KvCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3518: [BEAM-2557] Move DirectRunner knob out of core SDK ...

2017-07-07 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3518 [BEAM-2557] Move DirectRunner knob out of core SDK (Cherry pick for 2.1.0) … of core SDK Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] beam pull request #3575: [BEAM-2625] Update pull request template

2017-07-17 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3575 [BEAM-2625] Update pull request template Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #3577: [BEAM-2626] Fix split package in SDK harness

2017-07-17 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3577 [BEAM-2626] Fix split package in SDK harness Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3542: Remove dead (and wrong) viewFromProto overload

2017-07-11 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3542 Remove dead (and wrong) viewFromProto overload Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3536: [BEAM-2371] Use URNs, not Java classes, in immutabi...

2017-07-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3536 [BEAM-2371] Use URNs, not Java classes, in immutability enforcements Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3518: [BEAM-2557] Move DirectRunner knob out of core SDK ...

2017-07-09 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3518 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3509: [BEAM-2371] Port DirectRunner overrides to SDK-agno...

2017-07-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3509 [BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3511: [BEAM-2505, BEAM-2502] Fixes to ReduceFnRunner.onTi...

2017-07-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3511 [BEAM-2505, BEAM-2502] Fixes to ReduceFnRunner.onTimers (cherry pick to release-2.1.0) Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3564: Update Dataflow container to 20170714

2017-07-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3564 Update Dataflow container to 20170714 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3566: (WIP) Display data translation

2017-07-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3566 (WIP) Display data translation Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3562: Test GBK immediately followed by stateful ParDo

2017-07-14 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3562 Test GBK immediately followed by stateful ParDo Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3601: [BEAM-2333] Use RehydratedComponents for memoized r...

2017-07-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3601 [BEAM-2333] Use RehydratedComponents for memoized rehydration Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA issue

[GitHub] beam pull request #3609: [BEAM-2371] Use dehydration-insensitive APIs in Win...

2017-07-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3609 [BEAM-2371] Use dehydration-insensitive APIs in WindowEvaluatorFactory R: @tgroh Peeled off #3334 so it can be a trivial review. Ignore the base commit, which is #3601. You can merge

[GitHub] beam pull request #3608: Uniquify application nodes in TextIOReadTest (HACK)

2017-07-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3608 Uniquify application nodes in TextIOReadTest (HACK) These nodes have never had stable unique names in the original pipeline. - We have always mutated the pipeline before adding

[GitHub] beam pull request #3610: [BEAM-2371] Use dehydration-insensitive APIs in Par...

2017-07-20 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3610 [BEAM-2371] Use dehydration-insensitive APIs in ParDoEvaluatorFactory R: @tgroh Peeled off #3334 so it can be a trivial review. Ignore the base commit, which is #3601. You can merge

[GitHub] beam pull request #3599: ReduceFnRunner: test when watermark leapfrogs EOW a...

2017-07-19 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3599 ReduceFnRunner: test when watermark leapfrogs EOW and GC This is known to fail in older versions; forward porting regression test. You can merge this pull request into a Git repository

[GitHub] beam pull request #3476: [BEAM-2529] Fix dependency scope error in GCP IO mo...

2017-06-29 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3476 [BEAM-2529] Fix dependency scope error in GCP IO module Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3476: [BEAM-2529] Fix dependency scope error in GCP IO mo...

2017-06-29 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3476 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3487: [BEAM-2272] Enforce dependency convergence

2017-06-30 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3487 [BEAM-2272] Enforce dependency convergence Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #3488: [BEAM-2272] Run dependency analysis on all maven li...

2017-06-30 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3488 [BEAM-2272] Run dependency analysis on all maven lifecycle phases In this way, tests can also have IWYU enforced. The number of runtime-only and provided dependencies should be very small so

[GitHub] beam pull request #3489: [BEAM-2508] Fix DoFn javadoc: StateSpec does not re...

2017-06-30 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3489 [BEAM-2508] Fix DoFn javadoc: StateSpec does not require a key Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3505: [BEAM-2508] Fix DoFn javadoc: StateSpec does not re...

2017-07-05 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3505 [BEAM-2508] Fix DoFn javadoc: StateSpec does not require a key Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #3488: [BEAM-1984] Run dependency analysis on all maven li...

2017-07-05 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3502: [BEAM-2486] Reject stateful ParDo if coder not dete...

2017-07-05 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3502 [BEAM-2486] Reject stateful ParDo if coder not deterministic KvCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #3330: [BEAM-2371] Port DirectRunner overrides to SDK-agno...

2017-07-05 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/3330 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3459: [BEAM-2529] Only use letters to generate Spanner da...

2017-06-28 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3459 [BEAM-2529] Only use letters to generate Spanner database names Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3510: Update Dataflow container version to 20170706

2017-07-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3510 Update Dataflow container version to 20170706 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2741: [BEAM-1327] Rollforwards "Replace OutputTimeFn UDF ...

2017-04-27 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2741 [BEAM-1327] Rollforwards "Replace OutputTimeFn UDF with TimestampCombiner enum"" Be sure to do all of the following to help us incorporate your contribution qui

[GitHub] beam pull request #2721: [BEAM-2086] Remove TestDataflowRunner reliance on m...

2017-04-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2721 [BEAM-2086] Remove TestDataflowRunner reliance on metrics in streaming Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #2731: [BEAM-2086] Remove TestDataflowRunner reliance on m...

2017-04-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2731 [BEAM-2086] Remove TestDataflowRunner reliance on metrics in streaming Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #2732: Simplify Travis CI config for quick lightweight sig...

2017-04-26 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2732 Simplify Travis CI config for quick lightweight signal Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2683: [BEAM-1327] Replace OutputTimeFn UDF with Timestamp...

2017-04-25 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2683 [BEAM-1327] Replace OutputTimeFn UDF with TimestampCombiner enum Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2732: Remove Travis CI configuration

2017-04-28 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/beam/pull/2732 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2662: [BEAM-720] Re-enable WindowedWordCountIT on Flink r...

2017-04-24 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2662 [BEAM-720] Re-enable WindowedWordCountIT on Flink runner in precommit Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2745: [BEAM-2105] Move TestCredential out of test suite a...

2017-04-27 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2745 [BEAM-2105] Move TestCredential out of test suite artifact Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

  1   2   3   >