lxy-9602 opened a new pull request, #582:
URL: https://github.com/apache/paimon-cpp/pull/582

   <!-- PR titles must follow Conventional Commits: <type>(<optional-scope>): 
<description> -->
   
   ### Purpose
   
   <!-- Linking this pull request to the issue -->
   Linked issue: close #581 
   
   Add `FileIndexWrite::PrepareCommit` to attach caller-provided serialized 
index payloads to existing data files without rewriting the data.
   
   The API resolves target files from a specified snapshot, merges supplied 
field/type pairs with existing indexes, writes one external index container per 
data file, and returns commit messages grouped by partition and bucket.
   
   - Support fixed-bucket append tables and V1/V2 index containers.
   - Preserve unrelated indexes, auxiliary files, and historical index files.
   - Follow Java's index filename generation rules.
   - Include index metadata in manifest entry identifiers so metadata-only 
rewrites survive merging and stale metadata is detected.
   - Preserve reused physical paths during abort, including compaction level 
upgrades.
   
   Backfill commits must be serialized with compaction/overwrite per partition 
and bucket.
   
   <!-- What is the purpose of the change -->
   
   ### Tests
   Added coverage for:
   - Index merging, replacement, empty payloads, and embedded/external source 
containers.
   - Direct commits, snapshot selection, branch isolation, original field names 
after schema changes, and deletion vectors.
   - Optional dependencies, invalid inputs, short reads, failure cleanup, and 
repeated backfills.
   - Manifest identifiers, metadata rewrite conflicts, and abort cleanup of 
reused paths.
   
   <!--
   Describe tests added or updated and what they cover; explain if no test 
changes are needed.
   Omit execution commands, results, and reasons tests were not run locally.
   -->
   
   ### API and Format
   Add the public `FileIndexInput`, `DataFileIndexInput`, and `FileIndexWrite` 
APIs.
   
   Inputs use original data-file field names and physical row positions, 
including DV-deleted rows. Null filesystem, memory pool, and executor arguments 
select internal defaults.
   
   Reuse existing index container and commit message formats; no storage format 
or protocol changes.
   
   <!-- Does this change affect API in include dir or storage format or 
protocol -->
   
   ### Documentation
   Add API references and a user-guide example covering payload inputs, commit 
usage, and concurrency assumptions.
   
   <!-- Does this change introduce a new feature -->
   
   ### Generative AI tooling
   Generated-by: OpenAI Codex (GPT-6)
   <!--
   If generative AI tooling has been used in the process of authoring this 
patch, please include the
   phrase: 'Generated-by: ' followed by the name of the tool and its version.
   If no, write 'No'.
   Please refer to the [ASF Generative Tooling 
Guidance](https://www.apache.org/legal/generative-tooling.html) for details.
   -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to