PyRSA opened a new pull request, #1401:
URL: https://github.com/apache/paimon-rust/pull/1401

   ## Summary
   
   Add record-level expiration support for Primary Key table compaction, 
allowing expired records to be filtered during compaction and fully expired 
files to be removed through max-level rewrite.
   
   ## Changes
   
   - Add `RecordLevelExpire` to validate expiration configuration and filter 
expired records during compaction.
   - Support INT, BIGINT, TIMESTAMP, and TIMESTAMP_LTZ expiration fields.
   - Apply consistent expiration filtering to regular merge and Lookup 
compaction paths, avoiding expiration-only DELETE events.
   - Select fully expired max-level files for expire-only rewrite when regular 
compaction has no pending tasks.
   - Allow empty compaction output so fully expired input files can be retired.
   - Add unit and integration tests covering expiration boundaries, Lookup 
behavior, file selection, and fully expired max-level rewrite.
   
   ## Compatibility
   
   - Expiration is applied during compaction; ordinary query results are not 
filtered.
   - Append tables and Data Evolution compaction continue to reject 
record-level expiration.
   - Files with historical Schema IDs remain conservatively ineligible for 
expire-only rewrite when their Stats cannot be resolved. Schema Evolution Stats 
compatibility is deferred to a follow-up PR.
   - No expiration-only DELETE events are generated by Lookup compaction.
   
   ## Testing
   
   - Added `expire_only_max_level_rewrite_retires_fully_expired_files` to 
verify zero data-file output, input-file retirement, and no residual expired 
records.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to