This closes #3509: [BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs
Fix null checks in TransformHierarchy Fix misleading comment in TransformHierarchy Port DirectRunner ParDo overrides to SDK-agnostic APIs Enable SplittableParDo on rehydrated ParDo transform Include PCollection in rehydrated PCollectionView Add more utilities to ParDoTranslation Rehydrate PCollections Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b6b1c8b7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b6b1c8b7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b6b1c8b7 Branch: refs/heads/master Commit: b6b1c8b7c495df7e9c57a4757b91e4bb2ea82a7c Parents: c14a318 1518d73 Author: Kenneth Knowles <k...@google.com> Authored: Mon Jul 10 20:21:36 2017 -0700 Committer: Kenneth Knowles <k...@google.com> Committed: Mon Jul 10 20:21:36 2017 -0700 ---------------------------------------------------------------------- .../construction/PCollectionTranslation.java | 16 +++ .../core/construction/ParDoTranslation.java | 103 ++++++++++++++++++- .../construction/RunnerPCollectionView.java | 23 ++++- .../core/construction/SplittableParDo.java | 25 +++++ .../PCollectionTranslationTest.java | 22 ++++ .../core/construction/ParDoTranslationTest.java | 28 +++-- .../direct/ParDoMultiOverrideFactory.java | 47 +++++---- .../flink/FlinkStreamingPipelineTranslator.java | 2 +- .../beam/sdk/runners/TransformHierarchy.java | 12 +-- 9 files changed, 232 insertions(+), 46 deletions(-) ----------------------------------------------------------------------