lxy-9602 opened a new pull request, #582: URL: https://github.com/apache/paimon-cpp/pull/582
<!-- PR titles must follow Conventional Commits: <type>(<optional-scope>): <description> --> ### Purpose <!-- Linking this pull request to the issue --> Linked issue: close #581 Add `FileIndexWrite::PrepareCommit` to attach caller-provided serialized index payloads to existing data files without rewriting the data. The API resolves target files from a specified snapshot, merges supplied field/type pairs with existing indexes, writes one external index container per data file, and returns commit messages grouped by partition and bucket. - Support fixed-bucket append tables and V1/V2 index containers. - Preserve unrelated indexes, auxiliary files, and historical index files. - Follow Java's index filename generation rules. - Include index metadata in manifest entry identifiers so metadata-only rewrites survive merging and stale metadata is detected. - Preserve reused physical paths during abort, including compaction level upgrades. Backfill commits must be serialized with compaction/overwrite per partition and bucket. <!-- What is the purpose of the change --> ### Tests Added coverage for: - Index merging, replacement, empty payloads, and embedded/external source containers. - Direct commits, snapshot selection, branch isolation, original field names after schema changes, and deletion vectors. - Optional dependencies, invalid inputs, short reads, failure cleanup, and repeated backfills. - Manifest identifiers, metadata rewrite conflicts, and abort cleanup of reused paths. <!-- Describe tests added or updated and what they cover; explain if no test changes are needed. Omit execution commands, results, and reasons tests were not run locally. --> ### API and Format Add the public `FileIndexInput`, `DataFileIndexInput`, and `FileIndexWrite` APIs. Inputs use original data-file field names and physical row positions, including DV-deleted rows. Null filesystem, memory pool, and executor arguments select internal defaults. Reuse existing index container and commit message formats; no storage format or protocol changes. <!-- Does this change affect API in include dir or storage format or protocol --> ### Documentation Add API references and a user-guide example covering payload inputs, commit usage, and concurrency assumptions. <!-- Does this change introduce a new feature --> ### Generative AI tooling Generated-by: OpenAI Codex (GPT-6) <!-- If generative AI tooling has been used in the process of authoring this patch, please include the phrase: 'Generated-by: ' followed by the name of the tool and its version. If no, write 'No'. Please refer to the [ASF Generative Tooling Guidance](https://www.apache.org/legal/generative-tooling.html) for details. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
