This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 90393fc Merge pull request #5241: Fixes mapping outputs in Dataflow
streaming WriteFiles override
add e596850 Rename Window to WindowingStrategy
add 41bbc16 Add WindowInto and window representations
add 0c86434 Update EventTime to match Beam spec
add 5323ddf Simplify Combine code
add 6ee6d36 Support windowing in Go direct runner
add 81c235c Support Go windowing on Dataflow
add e36cb9b CR: addressed reviewer comments
add 4a146c6 CR: simplify Dataflow encoding and comment fixes
new d56db36 Merge pull request #5179 from [BEAM-3303] Add Go Windowing
support
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
sdks/go/examples/build.gradle | 1 +
.../windowed_wordcount/windowed_wordcount.go | 131 ++
.../windowed_wordcount/wordcount/wordcount.go | 59 +
sdks/go/pkg/beam/coder.go | 6 +-
sdks/go/pkg/beam/combine.go | 3 -
sdks/go/pkg/beam/core/funcx/fn.go | 40 +-
sdks/go/pkg/beam/core/funcx/fn_test.go | 23 +-
sdks/go/pkg/beam/core/graph/bind_test.go | 3 +-
sdks/go/pkg/beam/core/graph/coder/coder.go | 9 +-
sdks/go/pkg/beam/core/graph/coder/time.go | 15 +-
sdks/go/pkg/beam/core/graph/coder/time_test.go | 27 +-
.../distinct.go => core/graph/coder/windows.go} | 39 +-
sdks/go/pkg/beam/core/graph/edge.go | 132 +-
sdks/go/pkg/beam/core/graph/graph.go | 4 +-
sdks/go/pkg/beam/core/graph/mtime/time.go | 124 ++
sdks/go/pkg/beam/core/graph/node.go | 23 +-
sdks/go/pkg/beam/core/graph/window/fn.go | 111 ++
.../distinct.go => core/graph/window/strategy.go} | 34 +-
sdks/go/pkg/beam/core/graph/window/window.go | 71 -
sdks/go/pkg/beam/core/graph/window/windows.go | 78 +
sdks/go/pkg/beam/core/runtime/exec/coder.go | 128 +-
sdks/go/pkg/beam/core/runtime/exec/cogbk.go | 3 +-
sdks/go/pkg/beam/core/runtime/exec/combine.go | 96 +-
sdks/go/pkg/beam/core/runtime/exec/combine_test.go | 9 +-
sdks/go/pkg/beam/core/runtime/exec/datasink.go | 8 +-
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 10 +-
sdks/go/pkg/beam/core/runtime/exec/emit.go | 8 +-
sdks/go/pkg/beam/core/runtime/exec/flatten_test.go | 6 +-
sdks/go/pkg/beam/core/runtime/exec/fn.go | 27 +-
sdks/go/pkg/beam/core/runtime/exec/fn_test.go | 24 +-
sdks/go/pkg/beam/core/runtime/exec/fullvalue.go | 8 +-
.../pkg/beam/core/runtime/exec/fullvalue_test.go | 54 +-
.../pkg/beam/core/runtime/exec/multiplex_test.go | 2 +-
.../beam/core/runtime/exec/optimized/emitters.go | 2028 ++++++++++----------
.../beam/core/runtime/exec/optimized/emitters.tmpl | 12 +-
sdks/go/pkg/beam/core/runtime/exec/pardo.go | 61 +-
sdks/go/pkg/beam/core/runtime/exec/pardo_test.go | 12 +-
sdks/go/pkg/beam/core/runtime/exec/translate.go | 126 +-
sdks/go/pkg/beam/core/runtime/exec/unit_test.go | 4 +-
sdks/go/pkg/beam/core/runtime/exec/window.go | 92 +
sdks/go/pkg/beam/core/runtime/exec/window_test.go | 115 ++
sdks/go/pkg/beam/core/runtime/graphx/coder.go | 52 +-
sdks/go/pkg/beam/core/runtime/graphx/coder_test.go | 3 +-
sdks/go/pkg/beam/core/runtime/graphx/serialize.go | 86 +-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 208 +-
.../pkg/beam/core/runtime/graphx/translate_test.go | 2 +-
sdks/go/pkg/beam/core/runtime/graphx/v1/v1.pb.go | 213 +-
sdks/go/pkg/beam/core/runtime/graphx/v1/v1.proto | 10 +
sdks/go/pkg/beam/core/typex/class.go | 2 +-
sdks/go/pkg/beam/core/typex/class_test.go | 14 +
sdks/go/pkg/beam/core/typex/special.go | 35 +-
sdks/go/pkg/beam/core/util/protox/query.go | 45 -
sdks/go/pkg/beam/external.go | 8 +-
sdks/go/pkg/beam/forward.go | 1 +
sdks/go/pkg/beam/gbk.go | 2 -
sdks/go/pkg/beam/io/pubsubio/pubsubio.go | 4 +-
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 9 +-
sdks/go/pkg/beam/runners/dataflow/messages.go | 6 +-
sdks/go/pkg/beam/runners/dataflow/translate.go | 133 +-
sdks/go/pkg/beam/runners/direct/direct.go | 7 +-
sdks/go/pkg/beam/runners/direct/gbk.go | 40 +-
sdks/go/pkg/beam/runners/direct/impulse.go | 10 +-
sdks/go/pkg/beam/{impulse.go => windowing.go} | 29 +-
63 files changed, 2918 insertions(+), 1767 deletions(-)
create mode 100644 sdks/go/examples/windowed_wordcount/windowed_wordcount.go
create mode 100644 sdks/go/examples/windowed_wordcount/wordcount/wordcount.go
copy sdks/go/pkg/beam/{transforms/filter/distinct.go =>
core/graph/coder/windows.go} (54%)
create mode 100644 sdks/go/pkg/beam/core/graph/mtime/time.go
create mode 100644 sdks/go/pkg/beam/core/graph/window/fn.go
copy sdks/go/pkg/beam/{transforms/filter/distinct.go =>
core/graph/window/strategy.go} (55%)
delete mode 100644 sdks/go/pkg/beam/core/graph/window/window.go
create mode 100644 sdks/go/pkg/beam/core/graph/window/windows.go
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/window.go
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/window_test.go
delete mode 100644 sdks/go/pkg/beam/core/util/protox/query.go
copy sdks/go/pkg/beam/{impulse.go => windowing.go} (60%)
--
To stop receiving notification emails like this one, please contact
[email protected].
