This is an automated email from the ASF dual-hosted git repository.
jkff pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from a67262f Merge pull request #4538: [BEAM-3527] Adding a comment for
ZERO element of DistributionResult.
add e003431 Adds PositionT and claim callback to RestrictionTracker
add eca41b9 Changes OutputAndTimeBounded invoker to start checkpoint
timer after first claim, and verifies more invariants
add 0371848 Compresses encoded GrowthState with Snappy - about 2x-3x more
compact
add 32a427c InMemoryStateInternals.copy clones the values using the coder
add 8151d82 Final fixups
add 6857cb9 Bump worker to 20180205
new 2826362 Merge pull request #4483: [BEAM-3499, BEAM-2607] Gives the
runner access to positions of SDF claimed blocks
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../runners/apex/translation/ParDoTranslator.java | 2 +-
.../translation/operators/ApexParDoOperator.java | 2 +-
.../core/construction/PTransformMatchersTest.java | 2 +-
.../core/construction/ParDoTranslationTest.java | 4 +-
.../core/construction/SplittableParDoTest.java | 7 +-
.../beam/runners/core/InMemoryStateInternals.java | 77 ++++++++--
...TimeBoundedSplittableProcessElementInvoker.java | 100 +++++++++---
.../apache/beam/runners/core/SimpleDoFnRunner.java | 8 +-
.../core/SplittableParDoViaKeyedWorkItems.java | 4 +-
.../core/SplittableProcessElementInvoker.java | 2 +-
...BoundedSplittableProcessElementInvokerTest.java | 111 +++++++++++---
.../runners/core/SplittableParDoProcessFnTest.java | 34 +++--
.../direct/CopyOnAccessInMemoryStateInternals.java | 10 +-
.../SplittableProcessElementsEvaluatorFactory.java | 6 +-
.../flink/FlinkStreamingTransformTranslators.java | 2 +-
.../wrappers/streaming/SplittableDoFnOperator.java | 2 +-
runners/google-cloud-dataflow-java/pom.xml | 2 +-
.../{ShardedKeyCoder.java => SnappyCoder.java} | 49 +++---
.../org/apache/beam/sdk/transforms/DoFnTester.java | 2 +-
.../java/org/apache/beam/sdk/transforms/Watch.java | 167 ++++++++++++++-------
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 6 +-
.../sdk/transforms/reflect/DoFnSignatures.java | 6 +-
.../splittabledofn/HasDefaultTracker.java | 2 +-
.../splittabledofn/OffsetRangeTracker.java | 12 +-
.../splittabledofn/RestrictionTracker.java | 76 +++++++++-
.../beam/sdk/transforms/SplittableDoFnTest.java | 6 +-
.../org/apache/beam/sdk/transforms/WatchTest.java | 126 ++++++----------
.../sdk/transforms/reflect/DoFnInvokersTest.java | 14 +-
.../reflect/DoFnSignaturesProcessElementTest.java | 2 +-
.../reflect/DoFnSignaturesSplittableDoFnTest.java | 11 +-
.../splittabledofn/OffsetRangeTrackerTest.java | 73 +++++----
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 6 +-
32 files changed, 613 insertions(+), 320 deletions(-)
copy
sdks/java/core/src/main/java/org/apache/beam/sdk/coders/{ShardedKeyCoder.java
=> SnappyCoder.java} (51%)
--
To stop receiving notification emails like this one, please contact
[email protected].
