[2/4] beam git commit: Remove SingletonCombine

2017-03-03 Thread tgroh
Remove SingletonCombine It is unused with the update to Streaming View Overrides. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/079966ca Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/079966ca Diff:

[3/4] beam git commit: Add a Test for windowed CombineGloballyAsSingletonView

2017-03-03 Thread tgroh
Add a Test for windowed CombineGloballyAsSingletonView Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3de44a34 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3de44a34 Diff:

[1/4] beam git commit: This closes #2152

2017-03-03 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 178381992 -> 7e9233bbd This closes #2152 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7e9233bb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7e9233bb Diff:

[4/4] beam git commit: Only Override CreatePCollectionView in Streaming

2017-03-03 Thread tgroh
Only Override CreatePCollectionView in Streaming This permits us to use the appropriate view token for the StreamingPCollectionViewWriterFn. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7b94c99b Tree:

[GitHub] beam pull request #2152: [BEAM-1619] Write to the existing View in Dataflow ...

2017-03-03 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2152 [BEAM-1619] Write to the existing View in Dataflow Streaming Side Inputs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2145: [BEAM-1495] Implement Single-Output ParDo as a comp...

2017-03-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2145 [BEAM-1495] Implement Single-Output ParDo as a composite Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2144: [BEAM-1593] Remove Pipeline.getRunner

2017-03-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2144 [BEAM-1593] Remove Pipeline.getRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2142: [BEAM-818] Deprecate Pipeline.getOptions

2017-03-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2142 [BEAM-818] Deprecate Pipeline.getOptions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[1/2] beam git commit: This closes #2101

2017-03-01 Thread tgroh
Repository: beam Updated Branches: refs/heads/master ca678d887 -> 599a8ed65 This closes #2101 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/599a8ed6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/599a8ed6 Diff:

[2/2] beam git commit: This closes #2138

2017-03-01 Thread tgroh
This closes #2138 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ca678d88 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ca678d88 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ca678d88 Branch:

[1/2] beam git commit: Fix DataflowRunner message about uploaded vs cached files

2017-03-01 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 7d22dbcab -> ca678d887 Fix DataflowRunner message about uploaded vs cached files Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/05a006a1 Tree:

[1/2] beam git commit: This closes #2119

2017-03-01 Thread tgroh
Repository: beam Updated Branches: refs/heads/master a81c45781 -> b2428ea60 This closes #2119 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b2428ea6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b2428ea6 Diff:

[2/2] beam git commit: This closes #2125

2017-02-28 Thread tgroh
This closes #2125 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8998cb90 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8998cb90 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/8998cb90 Branch:

[GitHub] beam pull request #2120: [BEAM-1571] Add a test for FlattenPCollectionList o...

2017-02-27 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2120 [BEAM-1571] Add a test for FlattenPCollectionList on a singleton list Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2119: [BEAM-646] Remove PipelineRunner#apply

2017-02-27 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2119 [BEAM-646] Remove PipelineRunner#apply All existing Pipeline Runners that use the Java SDK modify Pipeline graphs with the Pipeline Surgery APIs. Apply is now superflous. Be sure to do all

[2/2] beam git commit: Get ApexRunner out of the #apply()

2017-02-27 Thread tgroh
Get ApexRunner out of the #apply() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/47333b0e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/47333b0e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/47333b0e

[1/2] beam git commit: This closes #2063

2017-02-27 Thread tgroh
Repository: beam Updated Branches: refs/heads/master eeed30b6e -> c8dfb851c This closes #2063 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c8dfb851 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c8dfb851 Diff:

[1/2] beam git commit: Inject Sharding Strategy in the Direct Runner

2017-02-27 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 063fbd4ed -> 932bb823f Inject Sharding Strategy in the Direct Runner This removes the need to have WriteBundles be a very implementation-dependent override based on both the behavior of the Write transform and the behavior of the

[2/2] beam git commit: This closes #2040

2017-02-27 Thread tgroh
This closes #2040 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/932bb823 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/932bb823 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/932bb823 Branch:

[1/2] beam git commit: Add Create#withTypeDescriptor

2017-02-27 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 0b7515e5e -> 063fbd4ed Add Create#withTypeDescriptor This permits creates that cannot infer a coder based on the input elements to pass a Type Descriptor and use Coder Inference, rather than requiring a coder be provided. Project:

[3/3] beam git commit: Update Dataflow Container Version

2017-02-27 Thread tgroh
Update Dataflow Container Version Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f5c04e15 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f5c04e15 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f5c04e15 Branch:

[2/3] beam git commit: Get DataflowRunner out of the #apply()

2017-02-27 Thread tgroh
Get DataflowRunner out of the #apply() Use Pipeline Surgery in the Dataflow Runner Add additional override factories for Dataflow overrides. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a6cd8c38 Tree:

[GitHub] beam pull request #2101: [BEAM-1548] Do not Reassign Windows when WindowFn i...

2017-02-24 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2101 [BEAM-1548] Do not Reassign Windows when WindowFn is null Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[1/2] beam git commit: This closes #1930

2017-02-24 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 25a014f40 -> 5ae1a00a7 This closes #1930 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5ae1a00a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5ae1a00a Diff:

[GitHub] beam pull request #2078: [BEAM-646] Specialize ISM View Translations

2017-02-23 Thread tgroh
Github user tgroh closed the pull request at: https://github.com/apache/beam/pull/2078 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2078: [BEAM-646] Specialize ISM View Translations

2017-02-22 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2078 [BEAM-646] Specialize ISM View Translations Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[2/2] beam git commit: This closes #2061

2017-02-22 Thread tgroh
This closes #2061 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b65db428 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b65db428 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b65db428 Branch:

[1/2] beam git commit: Remove uses of CreatePCollectionView#getView

2017-02-22 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 41de9301a -> b65db428a Remove uses of CreatePCollectionView#getView Views output by this transform should be obtained by inspecting the graph node, not by interrogating the PTransform. Doing otherwise may use incorrect views after Graph

[3/3] beam git commit: This closes #2055

2017-02-22 Thread tgroh
This closes #2055 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fbaac0fc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fbaac0fc Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/fbaac0fc Branch:

[2/3] beam git commit: Add a Base OverrideFactory class for 1-to-1 overrides

2017-02-22 Thread tgroh
Add a Base OverrideFactory class for 1-to-1 overrides These overrides are relatively common, and this reduces the reimplementation of mapping singletons and casting them. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[1/2] beam git commit: Obtain Flink Views from the Context Output

2017-02-22 Thread tgroh
Repository: beam Updated Branches: refs/heads/master d7ed2e23a -> 88e842534 Obtain Flink Views from the Context Output Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/810a5b4b Tree:

[GitHub] beam pull request #2063: [BEAM-646] Get Apex Runner out of the #apply()

2017-02-21 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2063 [BEAM-646] Get Apex Runner out of the #apply() Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #2061: [BEAM-646] Remove View.CreatePCollectionView.getVie...

2017-02-21 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2061 [BEAM-646] Remove View.CreatePCollectionView.getView() Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2060: [BEAM-1526] Suppress Spark WatermarkTest#testInDoFn...

2017-02-21 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2060 [BEAM-1526] Suppress Spark WatermarkTest#testInDoFn due to flakes Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[1/2] beam git commit: This closes #2058

2017-02-21 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 154c54305 -> 2982238f7 This closes #2058 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2982238f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2982238f Diff:

[2/2] beam git commit: Remove PValue.getProducingTransformInternal

2017-02-21 Thread tgroh
Remove PValue.getProducingTransformInternal This exposes too much information on the structure of the Graph to be appropriate for non-graph related APIs. It also is not stable, and subject to change at any point due to Pipeline Surgery APIs. Update DataflowRunner to use the visited

[GitHub] beam pull request #2058: [BEAM-1523] Remove PValue.getProducingTransformInte...

2017-02-21 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2058 [BEAM-1523] Remove PValue.getProducingTransformInternal Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[2/2] beam git commit: Rename invalid Loggers to be consistent with the project standard (LOG)

2017-02-21 Thread tgroh
Rename invalid Loggers to be consistent with the project standard (LOG) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9088a5e4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9088a5e4 Diff:

[1/2] beam git commit: This closes #2054

2017-02-21 Thread tgroh
Repository: beam Updated Branches: refs/heads/master e70e608da -> 5d6dafa26 This closes #2054 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5d6dafa2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5d6dafa2 Diff:

[5/5] beam git commit: Move Batch View Overrides out of DataflowRunner

2017-02-21 Thread tgroh
Move Batch View Overrides out of DataflowRunner Although these are runner specific, they don't need to be in the runner shim class. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f7dc6160 Tree:

[1/5] beam git commit: This closes #2025

2017-02-21 Thread tgroh
Repository: beam Updated Branches: refs/heads/master a991c9d85 -> e70e608da This closes #2025 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e70e608d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e70e608d Diff:

[3/5] beam git commit: Move Batch View Overrides out of DataflowRunner

2017-02-21 Thread tgroh
http://git-wip-us.apache.org/repos/asf/beam/blob/f7dc6160/runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow/BatchViewOverridesTest.java -- diff --git

[4/5] beam git commit: Move Batch View Overrides out of DataflowRunner

2017-02-21 Thread tgroh
http://git-wip-us.apache.org/repos/asf/beam/blob/f7dc6160/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowRunner.java -- diff --git

[1/2] beam git commit: Improve check around accumulation mode

2017-02-17 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 918c7fa36 -> 01de25575 Improve check around accumulation mode If multiple panes can ever be produced, accumulation mode must be explicitly set, as there is currently no default accumulation mode. A pipeline with allowed lateness and the

[2/2] beam git commit: This closes #2038

2017-02-17 Thread tgroh
This closes #2038 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/01de2557 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/01de2557 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/01de2557 Branch:

[GitHub] beam pull request #2040: Inject Sharding Strategy in the Direct Runner

2017-02-17 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2040 Inject Sharding Strategy in the Direct Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[2/2] beam git commit: Inject number of Shards as a Side Input to Write

2017-02-17 Thread tgroh
Inject number of Shards as a Side Input to Write This permits users to pass a PTransform from the input elements to the number of shards instead of requiring a constant amount. This enables sharding to be determined based on the input data rather than a constant value. Project:

[1/2] beam git commit: This closes #1941

2017-02-17 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 9335738f0 -> 918c7fa36 This closes #1941 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/918c7fa3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/918c7fa3 Diff:

[GitHub] beam pull request #2039: [BEAM-646] Use Surgery in the Dataflow Runner

2017-02-17 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2039 [BEAM-646] Use Surgery in the Dataflow Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[1/4] beam git commit: Add PTransformMatchers#emptyFlatten

2017-02-17 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 36ed3f6c5 -> 236a3cd96 Add PTransformMatchers#emptyFlatten This matches a Flatten that consumes no inputs. It can be replaced (approximately) with Create.empty(), as it will never produce output. Project:

[4/4] beam git commit: Add UnsupportedOverrideFactory to core-construction

2017-02-17 Thread tgroh
Add UnsupportedOverrideFactory to core-construction This factory throws with a specified message for all of its methods. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f29e4c36 Tree:

[2/4] beam git commit: Add ParDoWithType PTransform Matcher

2017-02-17 Thread tgroh
Add ParDoWithType PTransform Matcher This matcher matches a ParDo where the contained DoFn matches a provided type. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e75fbe70 Tree:

[3/4] beam git commit: This closes #2029

2017-02-17 Thread tgroh
This closes #2029 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/236a3cd9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/236a3cd9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/236a3cd9 Branch:

[GitHub] beam pull request #2038: Improve check around accumulation mode

2017-02-17 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2038 Improve check around accumulation mode Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2035: Obtain Flink Views from the Context Output

2017-02-17 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2035 Obtain Flink Views from the Context Output Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[2/3] beam git commit: Use Graph Surgery in the DirectRunner

2017-02-16 Thread tgroh
Use Graph Surgery in the DirectRunner Remove DirectRunner#apply(). This migrates the DirectRunner to work on a runner-agnostic graph. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/77a1afb2 Tree:

[3/3] beam git commit: This closes #2006

2017-02-16 Thread tgroh
This closes #2006 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2ca3bf66 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2ca3bf66 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2ca3bf66 Branch:

[1/3] beam git commit: Clean up TransformHierarchy#replace

2017-02-16 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 41b24090f -> 2ca3bf669 Clean up TransformHierarchy#replace Remove Existing Outputs from Producer Map in replace. This permits replacements to produce the same PValue as the transform they are replacing, for example in CreatePCollectionView.

[GitHub] beam pull request #2029: Override prep

2017-02-16 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2029 Override prep Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description

[2/2] beam git commit: Bring common_job_properties closer to Groovy style

2017-02-16 Thread tgroh
Bring common_job_properties closer to Groovy style Fix "RunnableOnService" typo Signed-off-by: Jason Kuster Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3c22a842 Tree:

[1/2] beam git commit: This closes #2020

2017-02-16 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 9151676a5 -> 41b24090f This closes #2020 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/41b24090 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/41b24090 Diff:

[GitHub] beam pull request #2025: Move View Overrides out of the Dataflow Runner

2017-02-16 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2025 Move View Overrides out of the Dataflow Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[2/2] beam git commit: This closes #2019

2017-02-16 Thread tgroh
This closes #2019 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/817688aa Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/817688aa Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/817688aa Branch:

[GitHub] beam pull request #2019: Remove Unneccessary DataflowRunner Overrides

2017-02-16 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2019 Remove Unneccessary DataflowRunner Overrides Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[1/2] beam git commit: This closes #2013

2017-02-15 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 013f11885 -> 18f3767e3 This closes #2013 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/18f3767e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/18f3767e Diff:

[2/2] beam git commit: Add runners/core-construction-java

2017-02-15 Thread tgroh
Add runners/core-construction-java This module contains pre-execution PipelineRunner utilities. Move PTransformMatchers to core-construction-java Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1ffbc689 Tree:

[3/3] beam git commit: This closes #2008

2017-02-14 Thread tgroh
This closes #2008 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9061c65e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9061c65e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9061c65e Branch:

[2/3] beam git commit: Propagate Pane in WindowEvaluatorFactory

2017-02-14 Thread tgroh
Propagate Pane in WindowEvaluatorFactory Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/29fc84b2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/29fc84b2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/29fc84b2

[1/3] beam git commit: Match Pane in WindowedValueMatcher

2017-02-14 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 2685ba528 -> 9061c65e3 Match Pane in WindowedValueMatcher Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4e69a797 Tree:

[GitHub] beam pull request #2008: [BEAM-1489] Propagate Pane in WindowEvaluatorFactor...

2017-02-14 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2008 [BEAM-1489] Propagate Pane in WindowEvaluatorFactory Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2006: [BEAM-646] Get the #apply out of the DirectRunner

2017-02-14 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2006 [BEAM-646] Get the #apply out of the DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[1/2] beam git commit: This closes #2005

2017-02-14 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 345c2acca -> ed3ef11fa This closes #2005 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ed3ef11f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ed3ef11f Diff:

[2/2] beam git commit: Suppress two Flaky Harness Tests

2017-02-14 Thread tgroh
Suppress two Flaky Harness Tests These tests are hanging forever in Jenkins Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/13e09151 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/13e09151 Diff:

[1/2] beam git commit: Add Pipeline#replaceTransform

2017-02-14 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 938a66ec3 -> 345c2acca Add Pipeline#replaceTransform This is the base method for Pipeline Surgery. It takes a PTransformMatcher and a PTransformOverrideFactory, and replaces all matching PTransforms with the result of the Override Factory.

[2/2] beam git commit: This closes #1998

2017-02-14 Thread tgroh
This closes #1998 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/345c2acc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/345c2acc Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/345c2acc Branch:

[1/2] beam git commit: This closes #1973

2017-02-14 Thread tgroh
Repository: beam Updated Branches: refs/heads/master bea101a44 -> 938a66ec3 This closes #1973 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/938a66ec Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/938a66ec Diff:

[2/2] beam git commit: Add ParDo Matchers to PTransformMatchers

2017-02-14 Thread tgroh
Add ParDo Matchers to PTransformMatchers These match Splittable ParDos and ParDos that use State and Timers. Update tests to remove excess generic args. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4bd6d833 Tree:

[GitHub] beam pull request #2005: [BEAM-1487] Suppress flaky harness tests

2017-02-14 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2005 [BEAM-1487] Suppress flaky harness tests Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[2/2] beam git commit: This closes #1841

2017-02-13 Thread tgroh
This closes #1841 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4018c835 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4018c835 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4018c835 Branch:

[1/2] beam git commit: Add JDBC postgres IT, load script and k8 script

2017-02-13 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 8e0573ba5 -> 4018c835c Add JDBC postgres IT, load script and k8 script Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b284fb4d Tree:

[1/2] beam git commit: Add ReplaceOutputs to PTransformOverrideFactory

2017-02-13 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 30cb93ced -> 2c0cffaf7 Add ReplaceOutputs to PTransformOverrideFactory This maps the outputs produced by applying a Replacement PTransform to the outputs produced by the original PTransform. Project:

[2/2] beam git commit: This closes #1995

2017-02-13 Thread tgroh
This closes #1995 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2c0cffaf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2c0cffaf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2c0cffaf Branch:

[GitHub] beam pull request #1995: [BEAM-646] Add ReplaceOutputs to PTransformOverride...

2017-02-13 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1995 [BEAM-646] Add ReplaceOutputs to PTransformOverrideFactory Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[1/2] beam git commit: This closes #1993

2017-02-13 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 982ea7af7 -> 30cb93ced This closes #1993 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/30cb93ce Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/30cb93ce Diff:

[GitHub] beam pull request #1993: [BEAM-1461] Make PrepareForProcessing Final, Deprec...

2017-02-13 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1993 [BEAM-1461] Make PrepareForProcessing Final, Deprecated Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[2/2] beam git commit: Construct Pipeline Nodes after Pipeline#run

2017-02-10 Thread tgroh
Construct Pipeline Nodes after Pipeline#run Before-run is not compatible with Pipeline Surgery Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7ba6a147 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7ba6a147 Diff:

[GitHub] beam pull request #1973: [BEAM-646] Add ParDo Matchers to PTransformMatchers

2017-02-10 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1973 [BEAM-646] Add ParDo Matchers to PTransformMatchers Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[2/2] beam git commit: This closes #1939

2017-02-10 Thread tgroh
This closes #1939 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/effca63f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/effca63f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/effca63f Branch:

[1/2] beam git commit: Add ReplacementOutput

2017-02-10 Thread tgroh
Repository: beam Updated Branches: refs/heads/master caaa64dc6 -> effca63f9 Add ReplacementOutput This is used to construct mappings between the original and replacement PValues in an output, in order to permit the Pipeline to replace all of the outputs generated by replacement transforms

[GitHub] beam pull request #1971: [BEAM-646] Construct Pipeline Nodes after Pipeline#...

2017-02-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1971 [BEAM-646] Construct Pipeline Nodes after Pipeline#run Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[1/2] beam git commit: This closes #1967

2017-02-09 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 6ab60d890 -> b2895217e This closes #1967 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b2895217 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b2895217 Diff:

[2/2] beam git commit: Explicitly pass Pipeline in AppliedPTransform

2017-02-09 Thread tgroh
Explicitly pass Pipeline in AppliedPTransform Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/74d977a7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/74d977a7 Diff:

[GitHub] beam pull request #1963: [BEAM-646] Explicitly pass Pipeline in AppliedPTran...

2017-02-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1963 [BEAM-646] Explicitly pass Pipeline in AppliedPTransform Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1957: [BEAM-440] Add Create#empty

2017-02-08 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1957 [BEAM-440] Add Create#empty Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM

[2/2] beam git commit: This closes #1953

2017-02-08 Thread tgroh
This closes #1953 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/64102943 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/64102943 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/64102943 Branch:

[1/2] beam git commit: Add Input Reconstruction to PTransformOverrideFactory

2017-02-08 Thread tgroh
Repository: beam Updated Branches: refs/heads/master cf9d2211f -> 64102943f Add Input Reconstruction to PTransformOverrideFactory Inputs are only ever provided as expanded representations. Overrides, however, may be applied to compressed inputs. Add a method to reconstruct the

[GitHub] beam pull request #1953: [BEAM-646] Add Input Reconstruction to PTransformOv...

2017-02-08 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1953 [BEAM-646] Add Input Reconstruction to PTransformOverrideFactory Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[1/2] beam git commit: Add PTransformMatcher

2017-02-08 Thread tgroh
Repository: beam Updated Branches: refs/heads/master cf1925fba -> bdcd26c33 Add PTransformMatcher This interface is used to identify PTransforms to replace during Pipeline Surgery. Add ClassPTransformMatcher as the initial simple matcher. Project:

[GitHub] beam pull request #1941: Inject number of Shards as a Side Input to Write

2017-02-07 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1941 Inject number of Shards as a Side Input to Write Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1938: [BEAM-646] Add PTransformMatcher

2017-02-07 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1938 [BEAM-646] Add PTransformMatcher Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

<    5   6   7   8   9   10   11   >