[BEAM-542] Spark batch interval should be a configuration instead of an interpretation of the Pipeline's windows
This closes #808 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fc87a0ca Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fc87a0ca Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/fc87a0ca Branch: refs/heads/gearpump-runner Commit: fc87a0ca73598bf2e9021697425bcff52d962f10 Parents: 0ab9495 08dca30 Author: Sela <[email protected]> Authored: Wed Aug 10 20:50:15 2016 +0300 Committer: Sela <[email protected]> Committed: Wed Aug 10 20:50:15 2016 +0300 ---------------------------------------------------------------------- runners/spark/README.md | 3 +- .../runners/spark/SparkPipelineOptions.java | 5 + .../apache/beam/runners/spark/SparkRunner.java | 19 +--- .../streaming/StreamingTransformTranslator.java | 10 +- .../StreamingWindowPipelineDetector.java | 102 ------------------- .../streaming/FlattenStreamingTest.java | 1 + .../streaming/KafkaStreamingTest.java | 2 + .../streaming/SimpleStreamingWordCountTest.java | 2 + 8 files changed, 18 insertions(+), 126 deletions(-) ----------------------------------------------------------------------
