This is an automated email from the ASF dual-hosted git repository.
boyuanz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from c8d2162 Merge pull request #12256 from ibzib/BEAM-10487
new 698401c Insert TruncateSizedRestriction when pipeline starts to drain.
new 0240471 Address latest comments.
new 047bed7 SpotlessApply
new 280e33d Fix java build.
new cf02dad spotlessApply
new 9b66b72 Only forward split/progress when the only consumer is
splittable.
new ed39236 Merge pull request #12287 from boyuanzz/drain_java
The 27905 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../pipeline/src/main/proto/beam_runner_api.proto | 10 +
.../runners/core/construction/Environments.java | 2 +
.../core/construction/PTransformTranslation.java | 5 +
.../core/construction/ParDoTranslation.java | 3 +
.../graph/SplittableParDoExpander.java | 232 +++++++++
.../core/construction/EnvironmentsTest.java | 7 +
.../core/construction/SplittableParDoTest.java | 5 +
.../graph/SplittableParDoExpanderTest.java | 56 ++
.../runners/core/SplittableParDoProcessFnTest.java | 5 +
.../fnexecution/control/RemoteExecutionTest.java | 5 +
.../src/main/java/org/apache/beam/sdk/io/Read.java | 15 +-
.../java/org/apache/beam/sdk/transforms/DoFn.java | 57 +++
.../beam/sdk/transforms/PeriodicSequence.java | 5 +
.../java/org/apache/beam/sdk/transforms/Watch.java | 8 +
.../reflect/ByteBuddyDoFnInvokerFactory.java | 30 +-
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 6 +
.../beam/sdk/transforms/reflect/DoFnSignature.java | 32 ++
.../sdk/transforms/reflect/DoFnSignatures.java | 82 +++
.../splittabledofn/ByteKeyRangeTracker.java | 5 +
.../splittabledofn/GrowableOffsetRangeTracker.java | 9 +
.../splittabledofn/OffsetRangeTracker.java | 5 +
.../splittabledofn/RestrictionTracker.java | 30 ++
.../sdk/transforms/reflect/DoFnInvokersTest.java | 240 ++++++++-
.../reflect/DoFnSignaturesSplittableDoFnTest.java | 131 +++++
.../GrowableOffsetRangeTrackerTest.java | 20 +
.../sdk/fn/splittabledofn/RestrictionTrackers.java | 5 +
.../fn/splittabledofn/RestrictionTrackersTest.java | 10 +
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 353 +++++++++----
.../beam/fn/harness/FnApiDoFnRunnerTest.java | 570 +++++++++++++++++++++
29 files changed, 1828 insertions(+), 115 deletions(-)
