This is an automated email from the ASF dual-hosted git repository.
aglinxinyuan pushed a change to branch xinyuan-region-restart
in repository https://gitbox.apache.org/repos/asf/texera.git
discard 20d4bb8bef Add region restart tests
discard dae72b0ba8 Ignore duplicate result URI inserts
discard 4c446c9e8b Add support for restarting regions
omit e5d8e50222 Merge branch 'xiaozhen-sync-region-kill' into
xinyuan-state-only
omit 3c7f46be49 Merge branch 'main' into xiaozhen-sync-region-kill
omit 2540c8a8fc test: add multiple state processing regression
omit e294684efd Merge branch 'xiaozhen-sync-region-kill' into
xinyuan-state-only
omit 6be98d57d7 Merge branch 'main' into xiaozhen-sync-region-kill
omit 92905d89ad fix fmt
omit b6d14ee05d fix fmt
omit 345fa41c78 fix fmt
omit 94b874c53b fix fmt
omit 42201cba49 fix fmt
omit 907dd10a4d fix fmt
omit 1173dd4599 fix fmt
omit 5cd9657696 fix fmt
omit 67c4e24f54 fix fmt
omit 808a5e7ca2 fix fmt
omit b313e16f3c fix: update if operator state access
omit be81f7d231 fix: persist state in scala data processor
omit d21a25271f refactor: isolate state serialization and materialization
changes
omit 00e78f88e7 Merge branch 'main' into xiaozhen-sync-region-kill
omit 2bc211f727 Merge branch 'main' into xiaozhen-sync-region-kill
omit 42befa9ebc Merge branch 'main' into xiaozhen-sync-region-kill
omit c134106199 Merge branch 'main' into xiaozhen-sync-region-kill
omit 4504e281c2 Merge branch 'main' into xiaozhen-sync-region-kill
omit 4fbb195aba Merge branch 'main' into xiaozhen-sync-region-kill
omit 4063cefa8b Merge branch 'main' into xiaozhen-sync-region-kill
omit e18c7a831a Merge branch 'main' into xiaozhen-sync-region-kill
omit 30f47b0347 Merge branch 'main' into xiaozhen-sync-region-kill
omit fb1471e8d3 Merge branch 'refs/heads/main' into
xiaozhen-sync-region-kill
omit e0a28667ce fix(amber): improve region kill behavior error handling and
add synchronous kill logic.
add dec8c4a3b9 feat(docker-compose): use Lakekeeper as the Iceberg Catalog
when launching via `docker compose` (#4274)
add 318812c5f1 chore(deps): upgrade frontend to Angular 18 (#4434)
add ef663648de chore(deps): upgrade Arrow Flight to 15 (#4439)
add 4e05685bac Add support for restarting regions
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (20d4bb8bef)
\
N -- N -- N refs/heads/xinyuan-region-restart (4e05685bac)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../core/architecture/packaging/output_manager.py | 38 +-
amber/src/main/python/core/models/operator.py | 6 +-
amber/src/main/python/core/models/state.py | 97 +-
.../main/python/core/runnables/network_receiver.py | 15 +-
.../main/python/core/runnables/network_sender.py | 23 +-
.../main/python/core/runnables/test_main_loop.py | 59 -
.../main/python/core/storage/document_factory.py | 107 +-
.../input_port_materialization_reader_runnable.py | 29 +-
.../main/python/core/storage/vfs_uri_factory.py | 1 -
.../controller/WorkflowScheduler.scala | 2 -
.../WorkerExecutionCompletedHandler.scala | 6 +-
.../messaginglayer/OutputManager.scala | 20 -
.../pythonworker/PythonProxyClient.scala | 3 +-
.../pythonworker/PythonProxyServer.scala | 2 +-
.../scheduling/RegionExecutionCoordinator.scala | 58 +-
.../scheduling/WorkflowExecutionCoordinator.scala | 45 +-
.../engine/architecture/worker/DataProcessor.scala | 1 -
.../InputPortMaterializationReaderThread.scala | 26 +-
.../worker/promisehandlers/EndHandler.scala | 2 +-
bin/single-node/.env | 40 +-
bin/single-node/docker-compose.yml | 193 +
common/workflow-core/build.sbt | 2 +-
.../amber/core/executor/OperatorExecutor.scala | 8 +-
.../org/apache/texera/amber/core/state/State.scala | 83 +-
.../apache/texera/amber/core/state/package.scala | 24 -
.../amber/core/storage/DocumentFactory.scala | 2 -
.../texera/amber/core/storage/VFSURIFactory.scala | 1 -
.../amber/operator/ifStatement/IfOpExec.scala | 2 +-
frontend/package.json | 52 +-
.../operator-menu/operator-menu.component.html | 2 +-
.../result-panel/result-panel.component.spec.ts | 4 +-
frontend/yarn.lock | 4436 ++++++++++++--------
32 files changed, 3191 insertions(+), 2198 deletions(-)
delete mode 100644
common/workflow-core/src/main/scala/org/apache/texera/amber/core/state/package.scala
