Repository: incubator-beam
Updated Branches:
refs/heads/master 96765f19b -> 6511ba28e
Remove Spark(Streaming)PipelineOptionsFactory
Pipeline authors should generally not use any runner-specific classes,
but instead should select the runner and appropriate configurations
through the
[BEAM-22] This closes #167
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6511ba28
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6511ba28
Diff:
This closes #175
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/920f14db
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/920f14db
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master d597389f9 -> 920f14dbe
Fix third checkbox in Github PR template
Currently "" doesn't display in the rendered markdown.
Using backticks allows it to.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
[BEAM-22] This closes #169
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f41ddbb
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9f41ddbb
Diff:
[BEAM-151] Move a large portion of the Dataflow runner to separate maven module
Note that Flink runner and Java examples both depend on the Dataflow runner
still. So I needed to make the Dataflow runner a top level component to
satisfy these dependencies.
Project:
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineRunner.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineRunnerHooks.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/test/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineTranslatorTest.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/test/java/com/google/cloud/dataflow/sdk/util/PackageUtilTest.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/runners/google-cloud-dataflow-java/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineRunnerHooks.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowJobExecutionException.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineJobTest.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/DataflowPipelineRunner.java
--
diff --git
[BEAM-151] This closes #165
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/af1e5755
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/af1e5755
Diff:
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/6b4857cc/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java
--
diff --git
Repository: incubator-beam
Updated Branches:
refs/heads/master cd2a3a18f -> e1a471176
Add ShardControlledWrite override
This is used for TextIO and AvroIO, which provide withNumOutputShards
methods to control the number of output files. Apply this override in
the InProcessPipelineRunner.
Repository: incubator-beam
Updated Branches:
refs/heads/master 43ef9fe5b -> cd2a3a18f
Enforce non-null preconditions
The InProcessPipelineRunner expects some result values to be non-null.
Enforce those early.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
[BEAM-22] This closes #153
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cd2a3a18
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cd2a3a18
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master ab7bca7d0 -> 43ef9fe5b
Fix multithreaded visibility issue with TransformExecutor
Use an AtomicReference to ensure the thread the Executor is being run on
will be visible to other threads.
Add a checkState to ensure that the
Repository: incubator-beam
Updated Branches:
refs/heads/master 6ab4c -> d42a07086
[BEAM-151] Move maven archetypes build order to be after runners
Currently sdks/java/maven-archetypes has several dependencies
on the DataflowPipelineRunner. This is mainly throw the utility
class called
[BEAM-151] This closes #158
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d42a0708
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d42a0708
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 5d78420bf -> a43f9b820
[BEAM-151] Update Dataflow worker container label
This new worker container label includes the change required
to decouple the worker from depending on the deleted code
in PipelineOptionsFactory.
Project:
[BEAM-151] Clean up reference to DataflowWorkerHarnessOptions
This prevents moving DataflowWorkerHarnessOptions to Dataflow Runner maven
module.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/02ee7457
[BEAM-22] This closes #143
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5d78420b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5d78420b
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 529bcdf56 -> 5d78420bf
Use a weakValues LoadingCache for serial TransformExecutorServices
This allows the garbage collector to clean up references to
TransformExecutorServices which are not currently in use.
Project:
[BEAM-151] Fixup of comment in test file
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a502baa9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a502baa9
Diff:
[BEAM-151] This closes #87
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6467afb7
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6467afb7
Diff:
[BEAM-151] Break out Dataflow transport creation to another file
This prevents moving DataflowPipelineOptions into a Dataflow runner maven
module.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d0db477a
[BEAM-151] Break out Dataflow runner specific tests to separate file
This prevents moving the Dataflow runner code to its own separate maven module.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/22fd1206
[BEAM-151] Break out Dataflow runner dependency to separate test file
This allows for moving the Dataflow specific portion of the test to the
Dataflow runner maven module.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
[BEAM-151] Update ASF license at top of new files.
Also fix minor comment.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ac1dd437
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ac1dd437
[BEAM-151] Migrate options relevant to pubsub to its own options interface
This prevents moving DataflowPipelineOptions to the Dataflow runner maven
module.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Repository: incubator-beam
Updated Branches:
refs/heads/master d2b46936f -> 7f0a2f78a
Improve TestPipeline AppName detection
After encountering the TestPipeline portion of the stack, try to find
a method annotated with the org.junit.Test annotation. If such a method
is found, return it as the
This closes #134
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7f0a2f78
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7f0a2f78
Diff:
Re-interrupt thread when handling InterruptedException
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8b31c530
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8b31c530
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master cab0c57c0 -> 061e6b5d8
Replace unambiguous of `throw Throwables.propagate` with definition
In the SDK the path taken by Throwables.propagate is always statically
known, and the inlined logic is more explicit and readable:
- If
This closes #70
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/061e6b5d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/061e6b5d
Diff:
This closes #45
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c6aac3b2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c6aac3b2
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 78abd964a -> c6aac3b26
Re-interrupt current thread when ignoring InterruptedException
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
This closes #41
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f7aaee2e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f7aaee2e
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 81d5ff5a5 -> a461e006a
Look up a runner if it is not registered
If a fully qualified runner is passed as the value of --runner, and it
is not present within the map of registered runners, attempts to look
up the runner using
Move 'update' pipeline option to correct interface
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1f31d4d5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1f31d4d5
Diff:
This closes #5
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f87f35b7
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f87f35b7
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master c9e552531 -> f87f35b70
Remove JsonIgnore attribute
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fa429b44
Tree:
This closes #2
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c9e55253
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c9e55253
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master a2d86775f -> c9e552531
Delete windmill_service.proto (not part of Beam)
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c4954179
Tree:
This closes #7
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a2d86775
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a2d86775
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/apache/master [deleted] a2d86775f
301 - 350 of 350 matches
Mail list logo