This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from ef267d9 [BEAM-9701] Increments fastavro version range upper bound to
0.24. (#11506)
new 93b3a0f [BEAM-2939] Expose HasProgress interface for restriction
trackers and use the progress value during splitting
new 7568b06 [BEAM-2939] Add the ability for SDK harness runners to
provide additional monitoring infos.
new 7ac97ea [BEAM-2939] Integrate progress reporting for splittable dofns.
new a02eb60 [BEAM-2939] Fold Sizes sub-interfaces into RestrictionTracker
new cfa6692 [BEAM-2939] Drop HasSize in favor of using
HasProgress#getProgress#getWorkRemaining as the default if the DoFn doesn't
override GetSize.
new 0291976 Merge pull request #11472 from lukecwik/splittabledofn
The 26679 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../core/metrics/MonitoringInfoConstants.java | 2 +
.../src/main/java/org/apache/beam/sdk/io/Read.java | 77 ++++++-----
.../java/org/apache/beam/sdk/transforms/DoFn.java | 27 ++--
.../reflect/ByteBuddyDoFnInvokerFactory.java | 13 +-
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 12 +-
.../splittabledofn/ByteKeyRangeTracker.java | 20 +--
.../splittabledofn/OffsetRangeTracker.java | 15 ++-
.../splittabledofn/RestrictionTracker.java | 68 ++++++++++
.../beam/sdk/transforms/splittabledofn/Sizes.java | 54 --------
.../splittabledofn/ByteKeyRangeTrackerTest.java | 31 +++--
.../splittabledofn/OffsetRangeTrackerTest.java | 25 +++-
.../sdk/fn/splittabledofn/RestrictionTrackers.java | 18 +--
.../fn/splittabledofn/RestrictionTrackersTest.java | 14 +-
.../beam/fn/harness/BeamFnDataReadRunner.java | 1 +
.../beam/fn/harness/BeamFnDataWriteRunner.java | 1 +
.../beam/fn/harness/BoundedSourceRunner.java | 1 +
.../org/apache/beam/fn/harness/CombineRunners.java | 1 +
.../org/apache/beam/fn/harness/FlattenRunner.java | 1 +
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 144 +++++++++++++++------
.../org/apache/beam/fn/harness/HandlesSplits.java | 2 +-
.../org/apache/beam/fn/harness/MapFnRunners.java | 1 +
.../beam/fn/harness/PTransformRunnerFactory.java | 14 ++
.../fn/harness/control/ProcessBundleHandler.java | 27 +++-
.../beam/fn/harness/AssignWindowsRunnerTest.java | 1 +
.../beam/fn/harness/BeamFnDataReadRunnerTest.java | 2 +
.../beam/fn/harness/BeamFnDataWriteRunnerTest.java | 1 +
.../beam/fn/harness/BoundedSourceRunnerTest.java | 1 +
.../apache/beam/fn/harness/CombineRunnersTest.java | 35 ++---
.../apache/beam/fn/harness/FlattenRunnerTest.java | 2 +
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 58 ++++++++-
.../apache/beam/fn/harness/MapFnRunnersTest.java | 3 +
.../harness/control/ProcessBundleHandlerTest.java | 17 +++
32 files changed, 469 insertions(+), 220 deletions(-)
delete mode 100644
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/splittabledofn/Sizes.java
