lyne7-sc opened a new issue, #1365: URL: https://github.com/apache/paimon-rust/issues/1365
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon-rust/issues) and found nothing similar. ### Please describe the bug 🐞 Key-value buffer flushes split output by `target-file-row-num`, but do not use `target-file-size` to roll files. The same problem affects input changelog files, so a large flush can produce files far above the configured size target. A focused reproduction is to write 8,193 distinct keys with `target-file-size = 1b`, leave the row limit unset, enable input changelog, and flush the buffer. The old path writes one data file and one changelog file for the entire flush instead of rolling between output chunks. Expected: use the existing rolling policy for both data and changelog output. The size target is a rolling threshold, not a strict file-size cap. ### Solution Route buffer flush output through `KeyValueRollingWriter`, preserving file numbering across flushes and the existing row limit. ### Are you willing to submit a PR? - [x] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
