This is an automated email from the ASF dual-hosted git repository.
echauchot pushed a change to branch spark-runner_structured-streaming
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 728aa1f Consider null object case on RowHelpers, fixes empty side
inputs tests.
new 6ae2056 Put back batch/simpleSourceTest.testBoundedSource
new 982197c Update windowAssignTest
new 6ba3d1c Add comment about checkpoint mark
new 89df2bf Re-code GroupByKeyTranslatorBatch to conserve windowing
instead of unwindowing/windowing(GlobalWindow): simplify code, use
ReduceFnRunner to merge the windows
new c947455 re-enable reduceFnRunner timers for output
new 09e6207 Improve visibility of debug messages
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../translation/TranslationContext.java | 2 +-
.../batch/GroupByKeyTranslatorBatch.java | 74 ++++++++++++++--------
.../GroupAlsoByWindowViaOutputBufferFn.java} | 21 +++---
.../streaming/DatasetSourceStreaming.java | 1 +
.../translation/batch/SimpleSourceTest.java | 11 +++-
.../translation/batch/WindowAssignTest.java | 19 +++---
6 files changed, 78 insertions(+), 50 deletions(-)
copy
runners/spark/src/main/java/org/apache/beam/runners/spark/{translation/SparkGroupAlsoByWindowViaOutputBufferFn.java
=>
structuredstreaming/translation/batch/functions/GroupAlsoByWindowViaOutputBufferFn.java}
(88%)
