[BEAM-310] Perform initial splitting in the DirectRunner

This closes #1063


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0a413e78
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0a413e78
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/0a413e78

Branch: refs/heads/master
Commit: 0a413e78e8f937ab3c221b78be25037021685e0d
Parents: 86d222a f68fea0
Author: Luke Cwik <lc...@google.com>
Authored: Fri Oct 14 13:55:24 2016 -0700
Committer: Luke Cwik <lc...@google.com>
Committed: Fri Oct 14 13:55:24 2016 -0700

----------------------------------------------------------------------
 .../direct/BoundedReadEvaluatorFactory.java     |  40 ++-
 .../beam/runners/direct/DirectOptions.java      |  23 ++
 .../beam/runners/direct/DirectRunner.java       |  11 +-
 .../beam/runners/direct/EmptyInputProvider.java |  12 +-
 .../direct/ExecutorServiceParallelExecutor.java |  15 +-
 .../beam/runners/direct/RootInputProvider.java  |   7 +-
 .../runners/direct/RootProviderRegistry.java    |   5 +-
 .../direct/TestStreamEvaluatorFactory.java      |   4 +-
 .../direct/TransformEvaluatorRegistry.java      |  10 +-
 .../direct/UnboundedReadEvaluatorFactory.java   |  35 ++-
 .../beam/runners/direct/WatermarkManager.java   |   1 +
 .../direct/BoundedReadEvaluatorFactoryTest.java |  41 ++-
 .../direct/FlattenEvaluatorFactoryTest.java     |   9 +-
 .../direct/TestStreamEvaluatorFactoryTest.java  |   2 +-
 .../UnboundedReadEvaluatorFactoryTest.java      |  55 +++-
 .../sdk/io/gcp/bigquery/BigQueryAvroUtils.java  |  69 ++++-
 .../io/gcp/bigquery/BigQueryAvroUtilsTest.java  | 132 +++++++--
 .../sdk/io/gcp/bigquery/BigQueryIOTest.java     | 292 ++++++++++++++++++-
 .../sdk/io/gcp/bigtable/BigtableIOTest.java     |   9 +-
 19 files changed, 662 insertions(+), 110 deletions(-)
----------------------------------------------------------------------


Reply via email to