lszskye opened a new pull request, #11248:
URL: https://github.com/apache/paimon/pull/11248
### Purpose
Allow `global-index.external-path` to configure multiple root directories,
for example `s3://bucket-a/index,s3://bucket-b/index`. New index files are
distributed across these directories in round-robin order.
- Separate new-file path allocation from existing-file path resolution.
- Allocate each file's full path once and carry it through writing,
`ResultEntry`, and commit metadata generation.
- Preserve round-robin state across file rotation and synchronize shared
path allocation.
- Update index implementations, adapters, tests, and documentation to use
the full-path contract consistently.
### Tests
- Configuration parsing, round-robin distribution, and concurrent allocation.
- Allocated-path preservation through writing and commit metadata generation,
including reads after external-path configuration changes.
- Targeted Bitmap, BTree, FMIndex, primary-key index, Spark, and ES index
tests.
- Multiple external-directory cleanup in `FileSystemCatalogTest` and
`CachingCatalogTest`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]