lyne7-sc opened a new issue, #1365:
URL: https://github.com/apache/paimon-rust/issues/1365

   ### Search before asking
   
   - [x] I searched in the 
[issues](https://github.com/apache/paimon-rust/issues) and found nothing 
similar.
   
   
   ### Please describe the bug 🐞
   
   Key-value buffer flushes split output by `target-file-row-num`, but do not 
use `target-file-size` to roll files. The same problem affects input changelog 
files, so a large flush can produce files far above the configured size target.
   
   A focused reproduction is to write 8,193 distinct keys with 
`target-file-size = 1b`, leave the row limit unset, enable input changelog, and 
flush the buffer. The old path writes one data file and one changelog file for 
the entire flush instead of rolling between output chunks.
   
   Expected: use the existing rolling policy for both data and changelog 
output. The size target is a rolling threshold, not a strict file-size cap.
   
   
   ### Solution
   
   Route buffer flush output through `KeyValueRollingWriter`, preserving file 
numbering across flushes and the existing row limit.
   
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to