lszskye opened a new pull request, #11248:
URL: https://github.com/apache/paimon/pull/11248

   ### Purpose
   
   Allow `global-index.external-path` to configure multiple root directories,
   for example `s3://bucket-a/index,s3://bucket-b/index`. New index files are
   distributed across these directories in round-robin order.
   
   - Separate new-file path allocation from existing-file path resolution.
   - Allocate each file's full path once and carry it through writing,
     `ResultEntry`, and commit metadata generation.
   - Preserve round-robin state across file rotation and synchronize shared
     path allocation.
   - Update index implementations, adapters, tests, and documentation to use
     the full-path contract consistently.
   
   
   ### Tests
   - Configuration parsing, round-robin distribution, and concurrent allocation.
   - Allocated-path preservation through writing and commit metadata generation,
     including reads after external-path configuration changes.
   - Targeted Bitmap, BTree, FMIndex, primary-key index, Spark, and ES index 
tests.
   - Multiple external-directory cleanup in `FileSystemCatalogTest` and
     `CachingCatalogTest`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to