This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from dea440f46d5 Merge pull request #31764 from liferoad/polish-dofn
add a1a22835710 Fix CHANGES.md from #31769 which incorrectly added to a
released version (#31770)
add 0c89a0edb9c Fix playground snippets (#31778)
add a5eee589697 Fix flaky StreamingDataflowWorkerTest which wasn't waiting
for enough commits. (#31781)
add c08afeae60d Enable MapState and SetState for dataflow streaming engine
pipelines with legacy runner by building on top of MultimapState. (#31453)
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 3 +-
.../org/apache/beam/runners/core/StateTags.java | 8 +
.../beam/runners/dataflow/DataflowRunner.java | 35 +---
.../beam/runners/dataflow/DataflowRunnerTest.java | 59 ------
.../dataflow/worker/StreamingDataflowWorker.java | 11 +-
.../worker/windmill/state/AbstractWindmillMap.java | 12 +-
.../worker/windmill/state/CachingStateTable.java | 53 +++--
.../worker/windmill/state/WindmillMap.java | 24 +--
.../windmill/state/WindmillMapViaMultimap.java | 164 +++++++++++++++
.../worker/windmill/state/WindmillMultimap.java | 4 +-
.../worker/windmill/state/WindmillSet.java | 36 +---
.../worker/windmill/state/WindmillStateCache.java | 46 +++--
.../windmill/state/WindmillStateInternals.java | 14 +-
.../worker/StreamingDataflowWorkerTest.java | 2 +-
.../worker/StreamingModeExecutionContextTest.java | 5 +-
.../dataflow/worker/WindmillStateTestUtils.java | 2 +-
.../dataflow/worker/WorkerCustomSourcesTest.java | 5 +-
.../windmill/state/WindmillStateCacheTest.java | 2 +-
.../windmill/state/WindmillStateInternalsTest.java | 225 ++++++++++++++++++++-
.../refresh/DispatchedActiveWorkRefresherTest.java | 2 +-
.../java/org/apache/beam/sdk/state/StateSpecs.java | 23 +++
.../org/apache/beam/sdk/transforms/ParDoTest.java | 28 ++-
.../transforms/python/elementwise/flatmap.md | 2 +-
.../transforms/python/elementwise/map.md | 4 +-
24 files changed, 559 insertions(+), 210 deletions(-)
copy
.test-infra/pipelines/infrastructure/03.io/api-overuse-study/02.redis/provider.tf
=>
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/state/AbstractWindmillMap.java
(78%)
create mode 100644
runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/windmill/state/WindmillMapViaMultimap.java
