LadyForest commented on PR #182:
URL:
https://github.com/apache/flink-table-store/pull/182#issuecomment-1173746816
**Update**
After discussion with @JingsongLi, the implementation details have the
following changes.
- **On how to define the compaction trigger moment**
If there exist **adjacent small files** whose size exceeds a
threshold(configured by the option key), then the compaction is triggered.
- **On how to rewrite files**
Reuse `RollingFileWriter` instead of manually grouping and calculating
the sum of file size.
- **On auto-compaction under streaming mode**
New files are continuously added to `toCompact`, `toCompact` is cleared
iff after a **truly triggered** compaction. If the last generated compacted
file is still smaller than the target file size, it will be added back to
`toCompact`(on the top)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
