[1/2] incubator-beam git commit: Remove Spark(Streaming)PipelineOptionsFactory

2016-04-14 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 96765f19b -> 6511ba28e Remove Spark(Streaming)PipelineOptionsFactory Pipeline authors should generally not use any runner-specific classes, but instead should select the runner and appropriate configurations through the

[2/2] incubator-beam git commit: [BEAM-22] This closes #167

2016-04-14 Thread lcwik
[BEAM-22] This closes #167 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6511ba28 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6511ba28 Diff:

[2/2] incubator-beam git commit: This closes #175

2016-04-13 Thread lcwik
This closes #175 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/920f14db Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/920f14db Diff:

[1/2] incubator-beam git commit: Fix third checkbox in Github PR template

2016-04-13 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master d597389f9 -> 920f14dbe Fix third checkbox in Github PR template Currently "" doesn't display in the rendered markdown. Using backticks allows it to. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: [BEAM-22] This closes #169

2016-04-12 Thread lcwik
[BEAM-22] This closes #169 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f41ddbb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9f41ddbb Diff:

[17/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
[BEAM-151] Move a large portion of the Dataflow runner to separate maven module Note that Flink runner and Java examples both depend on the Dataflow runner still. So I needed to make the Dataflow runner a top level component to satisfy these dependencies. Project:

[15/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineRunner.java -- diff --git

[13/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java -- diff --git

[06/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineRunnerHooks.java -- diff --git

[10/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/test/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineTranslatorTest.java -- diff --git

[09/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/test/java/com/google/cloud/dataflow/sdk/util/PackageUtilTest.java -- diff --git

[14/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineRunnerHooks.java -- diff --git

[08/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowJobExecutionException.java -- diff --git

[04/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineJobTest.java -- diff --git

[07/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineRunner.java -- diff --git

[18/18] incubator-beam git commit: [BEAM-151] This closes #165

2016-04-11 Thread lcwik
[BEAM-151] This closes #165 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/af1e5755 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/af1e5755 Diff:

[05/18] incubator-beam git commit: [BEAM-151] Move a large portion of the Dataflow runner to separate maven module

2016-04-11 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java -- diff --git

[1/2] incubator-beam git commit: Add ShardControlledWrite override

2016-04-11 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master cd2a3a18f -> e1a471176 Add ShardControlledWrite override This is used for TextIO and AvroIO, which provide withNumOutputShards methods to control the number of output files. Apply this override in the InProcessPipelineRunner.

[1/2] incubator-beam git commit: Enforce non-null preconditions

2016-04-11 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 43ef9fe5b -> cd2a3a18f Enforce non-null preconditions The InProcessPipelineRunner expects some result values to be non-null. Enforce those early. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: [BEAM-22] This closes #153

2016-04-11 Thread lcwik
[BEAM-22] This closes #153 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cd2a3a18 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cd2a3a18 Diff:

[1/2] incubator-beam git commit: Fix multithreaded visibility issue with TransformExecutor

2016-04-11 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master ab7bca7d0 -> 43ef9fe5b Fix multithreaded visibility issue with TransformExecutor Use an AtomicReference to ensure the thread the Executor is being run on will be visible to other threads. Add a checkState to ensure that the

[1/2] incubator-beam git commit: [BEAM-151] Move maven archetypes build order to be after runners

2016-04-10 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 6ab4c -> d42a07086 [BEAM-151] Move maven archetypes build order to be after runners Currently sdks/java/maven-archetypes has several dependencies on the DataflowPipelineRunner. This is mainly throw the utility class called

[2/2] incubator-beam git commit: [BEAM-151] This closes #158

2016-04-10 Thread lcwik
[BEAM-151] This closes #158 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d42a0708 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d42a0708 Diff:

[1/3] incubator-beam git commit: [BEAM-151] Update Dataflow worker container label

2016-04-08 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 5d78420bf -> a43f9b820 [BEAM-151] Update Dataflow worker container label This new worker container label includes the change required to decouple the worker from depending on the deleted code in PipelineOptionsFactory. Project:

[2/3] incubator-beam git commit: [BEAM-151] Clean up reference to DataflowWorkerHarnessOptions

2016-04-08 Thread lcwik
[BEAM-151] Clean up reference to DataflowWorkerHarnessOptions This prevents moving DataflowWorkerHarnessOptions to Dataflow Runner maven module. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/02ee7457

[3/3] incubator-beam git commit: [BEAM-22] This closes #143

2016-04-08 Thread lcwik
[BEAM-22] This closes #143 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5d78420b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5d78420b Diff:

[1/3] incubator-beam git commit: Use a weakValues LoadingCache for serial TransformExecutorServices

2016-04-08 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 529bcdf56 -> 5d78420bf Use a weakValues LoadingCache for serial TransformExecutorServices This allows the garbage collector to clean up references to TransformExecutorServices which are not currently in use. Project:

[06/12] incubator-beam git commit: [BEAM-151] Fixup of comment in test file

2016-04-07 Thread lcwik
[BEAM-151] Fixup of comment in test file Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a502baa9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a502baa9 Diff:

[12/12] incubator-beam git commit: [BEAM-151] This closes #87

2016-04-07 Thread lcwik
[BEAM-151] This closes #87 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6467afb7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6467afb7 Diff:

[04/12] incubator-beam git commit: [BEAM-151] Break out Dataflow transport creation to another file

2016-04-07 Thread lcwik
[BEAM-151] Break out Dataflow transport creation to another file This prevents moving DataflowPipelineOptions into a Dataflow runner maven module. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d0db477a

[03/12] incubator-beam git commit: [BEAM-151] Break out Dataflow runner specific tests to separate file

2016-04-07 Thread lcwik
[BEAM-151] Break out Dataflow runner specific tests to separate file This prevents moving the Dataflow runner code to its own separate maven module. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/22fd1206

[02/12] incubator-beam git commit: [BEAM-151] Break out Dataflow runner dependency to separate test file

2016-04-07 Thread lcwik
[BEAM-151] Break out Dataflow runner dependency to separate test file This allows for moving the Dataflow specific portion of the test to the Dataflow runner maven module. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[11/12] incubator-beam git commit: [BEAM-151] Update ASF license at top of new files.

2016-04-07 Thread lcwik
[BEAM-151] Update ASF license at top of new files. Also fix minor comment. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ac1dd437 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ac1dd437

[09/12] incubator-beam git commit: [BEAM-151] Migrate options relevant to pubsub to its own options interface

2016-04-07 Thread lcwik
[BEAM-151] Migrate options relevant to pubsub to its own options interface This prevents moving DataflowPipelineOptions to the Dataflow runner maven module. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/2] incubator-beam git commit: Improve TestPipeline AppName detection

2016-04-07 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master d2b46936f -> 7f0a2f78a Improve TestPipeline AppName detection After encountering the TestPipeline portion of the stack, try to find a method annotated with the org.junit.Test annotation. If such a method is found, return it as the

[2/2] incubator-beam git commit: This closes #134

2016-04-07 Thread lcwik
This closes #134 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7f0a2f78 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7f0a2f78 Diff:

[2/3] incubator-beam git commit: Re-interrupt thread when handling InterruptedException

2016-03-31 Thread lcwik
Re-interrupt thread when handling InterruptedException Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8b31c530 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8b31c530 Diff:

[1/3] incubator-beam git commit: Replace unambiguous of `throw Throwables.propagate` with definition

2016-03-31 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master cab0c57c0 -> 061e6b5d8 Replace unambiguous of `throw Throwables.propagate` with definition In the SDK the path taken by Throwables.propagate is always statically known, and the inlined logic is more explicit and readable: - If

[3/3] incubator-beam git commit: This closes #70

2016-03-31 Thread lcwik
This closes #70 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/061e6b5d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/061e6b5d Diff:

[2/2] incubator-beam git commit: This closes #45

2016-03-30 Thread lcwik
This closes #45 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c6aac3b2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c6aac3b2 Diff:

[1/2] incubator-beam git commit: Re-interrupt current thread when ignoring InterruptedException

2016-03-30 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 78abd964a -> c6aac3b26 Re-interrupt current thread when ignoring InterruptedException Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: This closes #41

2016-03-19 Thread lcwik
This closes #41 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f7aaee2e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f7aaee2e Diff:

[1/2] incubator-beam git commit: Look up a runner if it is not registered

2016-03-18 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 81d5ff5a5 -> a461e006a Look up a runner if it is not registered If a fully qualified runner is passed as the value of --runner, and it is not present within the map of registered runners, attempts to look up the runner using

[2/3] incubator-beam git commit: Move 'update' pipeline option to correct interface

2016-03-02 Thread lcwik
Move 'update' pipeline option to correct interface Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1f31d4d5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1f31d4d5 Diff:

[3/3] incubator-beam git commit: This closes #5

2016-03-02 Thread lcwik
This closes #5 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f87f35b7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f87f35b7 Diff:

[1/3] incubator-beam git commit: Remove JsonIgnore attribute

2016-03-02 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master c9e552531 -> f87f35b70 Remove JsonIgnore attribute Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fa429b44 Tree:

[3/3] incubator-beam git commit: This closes #2

2016-03-01 Thread lcwik
This closes #2 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c9e55253 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c9e55253 Diff:

[1/3] incubator-beam git commit: Delete windmill_service.proto (not part of Beam)

2016-03-01 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master a2d86775f -> c9e552531 Delete windmill_service.proto (not part of Beam) Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c4954179 Tree:

[2/2] incubator-beam git commit: This closes #7

2016-03-01 Thread lcwik
This closes #7 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a2d86775 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a2d86775 Diff:

[incubator-beam] Git Push Summary

2016-03-01 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/apache/master [deleted] a2d86775f

<    1   2   3   4