TheR1sing3un opened a new pull request, #10431:
URL: https://github.com/apache/paimon/pull/10431

   ### Purpose
   
   Add opt-in `maintain_global_indexes` / multimodal `maintain_indexes` for 
configured global indexes. Each pass plans one snapshot, fills uncovered 
ranges, and publishes all requested definitions in one commit. Repeated 
catch-up is a no-op; keeping explicit definitions lets scheduled 
ingestion/backfill jobs rebuild coverage removed by `DROP_PARTITION_INDEX` 
updates.
   
   `rebuild=True` atomically replaces matching index entries, optionally for 
selected partitions, without removing files retained by older snapshots. A 
strict Python-committer snapshot guard rejects publication after any concurrent 
commit. Failed builds preserve existing coverage and clean completed 
uncommitted outputs; ambiguous commit failures leave files for orphan 
maintenance. The API does not create a background service: callers own 
scheduling, backoff and retries. `IGNORE` updates require explicit rebuild.
   
   ### Tests
   
   83 targeted maintenance/build/conflict tests passed across the initial 
81-test run and the final expanded 10-test maintenance run. Coverage includes 
idempotence, append catch-up, rebuilding update-invalidated partitions, 
one-commit publication of multiple definitions, partition-scoped replacement, 
historical index retention, concurrent-commit rejection, failed-build cleanup, 
ignored-update repair and validation. Flake8 and `git diff --check` passed. No 
benchmark code included.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to