This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 9de4bd9 Merge pull request #15915: [beam-12737] add API to handle
failed rows in the collection due to sql query runtime error
add 42e1ae8 [BEAM-3293] Finish E2E implementation of MultiMap side
inputs, add integration test (#15981)
add cb0ccf6 [BEAM-13178][Playground] moving setup methods to a new
module; moving processing methods to a new module; generating pb files;
add 722dc87 Merge branch 'master' into BEAM-13178-controller-refactoring
add e2b3196 Merge pull request #15958 from [BEAM-13178][Playground]
Refactoring for controller
add 1e99e0e Merge pull request #15740 from [BEAM-12936][Playground] Code
editor - Docker container
add 8fdf630 Merge pull request #15976 from
[Playground][BEAM-12941][Bugfix] Fix workflows for playground applications
add 4b85a11 Merge pull request #15991 [BEAM-13251][Playground] [Bugfix]
Lint Fails on Playground Backend
add de1ce00 Merge pull request #15990 from [BEAM-13177][Playground]
Change using of MustParse with Parse for all API methods
add a67c133 [BEAM-13262] Forward for metrics.SingleResult (#15993)
add fdedc78 Generate Python container dependencies in an automated way.
(#15927)
add 2e8fe3e [BEAM-13264] Allow pyarrow up to 6.x (#15995)
add 412a593 [BEAM-8033] Throwing an error if a dataSourceProviderFn is
defined twice in a transform
add 54f02d8 Merge pull request #15963 from [BEAM-8033] Throwing an error
if a dataSourceProviderFn is defined twice
add 85eb331 fix: update dlp dependency version range
add 6d5e3af update dlp dependency version range #15988
add 8d0ef53 Update the go get command with v2 (#15945)
add ca71208 Go Quickstart: switch to Spark 3 JobServer for better
out-of-box experience using embedded Spark cluster (#15985)
add 072fcae Golint fixes for recent Go SDK import (#15999)
add 6dc1b6f Merge pull request #15997: [BEAM-8688] Upgrading gcsio
library to latest along with flogger
No new revisions were added by this update.
Summary of changes:
.github/workflows/build_playground_backend.yml | 14 +-
.github/workflows/build_playground_frontend.yml | 20 +-
CHANGES.md | 1 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 4 +-
playground/backend/cmd/server/controller.go | 419 +++----------------
playground/backend/cmd/server/controller_test.go | 328 +++++----------
playground/backend/cmd/server/http.go | 6 +-
playground/backend/cmd/server/tcp.go | 6 +-
playground/backend/containers/java/Dockerfile | 2 +-
.../backend/internal/cache/redis/redis_cache.go | 4 +-
.../internal/code_processing/code_processing.go | 285 +++++++++++++
.../code_processing/code_processing_test.go | 447 +++++++++++++++++++++
.../environment/environment_service_test.go | 4 +-
playground/backend/internal/executors/executor.go | 2 -
.../compile_builder/compile_builder_setuper.go} | 42 +-
.../compile_builder_setuper_test.go | 107 +++++
.../setup_tools/life_cycle/life_cycle_setuper.go | 49 +++
.../life_cycle/life_cycle_setuper_test.go | 116 ++++++
.../setup_tools/run_builder/run_builder_setuper.go | 50 +++
.../run_builder/run_builder_setuper_test.go | 144 +++++++
.../http.go => internal/utils/cache_utils.go} | 26 +-
.../backend/internal/utils/cache_utils_test.go | 80 ++++
.../backend/internal/utils/validators_utils.go | 32 +-
.../internal/utils/validators_utils_test.go | 79 ++++
playground/frontend/Dockerfile | 38 ++
playground/frontend/app.yaml | 21 +
.../frontend/{build.gradle.kts => build.gradle} | 61 ++-
playground/frontend/nginx_default.conf | 33 ++
playground/frontend/settings.gradle | 19 +
sdks/go/examples/snippets/10metrics.go | 4 +-
.../pkg/beam/core/graph/window/trigger/trigger.go | 28 +-
sdks/go/pkg/beam/core/metrics/metrics.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/fn.go | 27 +-
sdks/go/pkg/beam/core/runtime/exec/fn_test.go | 13 +
sdks/go/pkg/beam/core/runtime/exec/input.go | 6 +-
sdks/go/pkg/beam/forward.go | 4 +
sdks/go/pkg/beam/util/harnessopts/sampler.go | 3 -
sdks/go/test/integration/integration.go | 2 +
sdks/go/test/integration/primitives/pardo.go | 75 ++++
sdks/go/test/integration/primitives/pardo_test.go | 5 +
.../test/integration/wordcount/wordcount_test.go | 8 +-
.../java/org/apache/beam/sdk/io/jdbc/JdbcIO.java | 5 +
sdks/python/container/Dockerfile | 65 +--
sdks/python/container/base_image_requirements.txt | 90 -----
.../container/base_image_requirements_manual.txt | 43 ++
sdks/python/container/build.gradle | 6 +
sdks/python/container/common.gradle | 15 +-
.../container/py36/base_image_requirements.txt | 152 +++++++
.../container/py37/base_image_requirements.txt | 152 +++++++
.../container/py38/base_image_requirements.txt | 149 +++++++
sdks/python/container/run_generate_requirements.sh | 90 +++++
sdks/python/setup.py | 6 +-
sdks/python/test-suites/tox/py38/build.gradle | 4 +
sdks/python/tox.ini | 3 +-
.../site/content/en/contribute/release-guide.md | 33 +-
.../site/content/en/get-started/quickstart-go.md | 4 +-
56 files changed, 2573 insertions(+), 860 deletions(-)
create mode 100644
playground/backend/internal/code_processing/code_processing.go
create mode 100644
playground/backend/internal/code_processing/code_processing_test.go
copy playground/backend/{cmd/server/tcp.go =>
internal/setup_tools/compile_builder/compile_builder_setuper.go} (53%)
create mode 100644
playground/backend/internal/setup_tools/compile_builder/compile_builder_setuper_test.go
create mode 100644
playground/backend/internal/setup_tools/life_cycle/life_cycle_setuper.go
create mode 100644
playground/backend/internal/setup_tools/life_cycle/life_cycle_setuper_test.go
create mode 100644
playground/backend/internal/setup_tools/run_builder/run_builder_setuper.go
create mode 100644
playground/backend/internal/setup_tools/run_builder/run_builder_setuper_test.go
copy playground/backend/{cmd/server/http.go => internal/utils/cache_utils.go}
(64%)
create mode 100644 playground/backend/internal/utils/cache_utils_test.go
copy sdks/go/test/integration/primitives/pardo_test.go =>
playground/backend/internal/utils/validators_utils.go (62%)
create mode 100644 playground/backend/internal/utils/validators_utils_test.go
create mode 100644 playground/frontend/Dockerfile
create mode 100644 playground/frontend/app.yaml
rename playground/frontend/{build.gradle.kts => build.gradle} (53%)
create mode 100644 playground/frontend/nginx_default.conf
create mode 100644 playground/frontend/settings.gradle
delete mode 100644 sdks/python/container/base_image_requirements.txt
create mode 100644 sdks/python/container/base_image_requirements_manual.txt
create mode 100644 sdks/python/container/py36/base_image_requirements.txt
create mode 100644 sdks/python/container/py37/base_image_requirements.txt
create mode 100644 sdks/python/container/py38/base_image_requirements.txt
create mode 100755 sdks/python/container/run_generate_requirements.sh
