This closes #1614: Spark runner: Force streaming execution on batch pipelines for testing
[BEAM-853] Force streaming execution on batch pipelines for testing. Expose the adapted source. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4206408b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4206408b Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/4206408b Branch: refs/heads/gearpump-runner Commit: 4206408bf98898be3c37c1d9f518de8ea9acd170 Parents: ffe3ab3 5f41ded Author: Kenneth Knowles <k...@google.com> Authored: Fri Dec 16 22:03:59 2016 -0800 Committer: Kenneth Knowles <k...@google.com> Committed: Fri Dec 16 22:03:59 2016 -0800 ---------------------------------------------------------------------- .../runners/spark/SparkPipelineOptions.java | 5 + .../beam/runners/spark/TestSparkRunner.java | 80 +++++++++++- .../beam/runners/spark/ForceStreamingTest.java | 123 +++++++++++++++++++ .../sdk/io/BoundedReadFromUnboundedSource.java | 14 ++- 4 files changed, 217 insertions(+), 5 deletions(-) ----------------------------------------------------------------------
