HaHaJeff opened a new pull request, #525:
URL: https://github.com/apache/paimon-cpp/pull/525

   ### Purpose
   
   Enable partial-update for primary-key realtime writes by reusing the 
existing merge functions and options used by the ordinary Writer.
   
   Related issue (tracked separately): 
https://github.com/apache/paimon-cpp/issues/524
   
   - Allow `PARTIAL_UPDATE` alongside `DEDUPLICATE`, preserving the existing 
deduplicate ignore-delete restrictions. Standalone aggregation and first-row 
engines remain unsupported.
   - Reuse framework merge logic for prepared readers, sequence groups, field 
aggregation, and configured delete handling. The store only stores, sorts, and 
spills; merging remains the framework's responsibility.
   - Pass full table primary keys to the merge factory; retain trimmed keys for 
physical keys and sorting.
   - Keep realtime Noop compaction unchanged.
   - Preserve non-realtime merge/read behavior; the merge-factory change is 
limited to the realtime creation call.
   
   #### Known Issues
   
   This PR aligns realtime partial-update merging with the existing ordinary 
Writer behavior by reusing the same merge functions. It does not fix the 
existing staged-merge defects or change non-realtime merge/read behavior. The 
ordinary Writer reproductions are tracked separately in #524 and will be 
addressed independently. Realtime may inherit these limitations; this PR does 
not establish correctness for all affected combinations.
   
   ### Tests
   
   Previously completed validation for feature commit 
`2e2f194ccdab76831b2988a9b749f5d8c299d8f7`: 9 realtime integration tests and 20 
core tests passed (29 total). These tests were not rerun when publishing this 
PR.
   
   The four new integration tests are:
   
   - `RealtimeWriteInteTest.TestPkPartialUpdateDeleteAcrossCommits`
   - `RealtimeWriteInteTest.TestPkPartialUpdateSequenceGroups`
   - `RealtimeWriteInteTest.TestPkPartialUpdateAggregationSpillAndRecovery`
   - 
`RealtimeWriteInteTest.TestPkPartialUpdatePartitionedDefaultAggregationRetract`
   
   The other five integration tests cover existing primary-key reads, recovery, 
writer handoff, and multiple batches. Core coverage includes 
`KeyValueFileStoreWriteTest.*` and `FileStoreWriteTest.*`.
   
   Coverage exercises real memory queries, prepare/commit and normal disk 
reads, spill, reopen, and replay. This is focused validation, not exhaustive 
partial-update semantics, full CI, Java interoperability, or all repository 
tests.
   
   ### API and Format
   
   No public `include/paimon/` API, storage format, or protocol changes.
   
   ### Documentation
   
   Updated the realtime user guide to document partial-update support and its 
scope.
   
   ### Generative AI tooling
   
   Generated-by: OpenAI Codex (CLI 0.160.0)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to