LadyForest commented on PR #119: URL: https://github.com/apache/flink-table-store/pull/119#issuecomment-1136842074
> As discussed, The JSON serilization of `PartitionedManifestMeta` skips (file size, row count, min/max seq number, key/value stats, nullable count, level) of `DataFileMeta` to simplify the json. > > Because for compaction situations, only the data file name and min/max key are needed to create the merge tree reader. I rethink it. In the future, if we want to avoid source-sink shuffle by introducing a dedicated new source to perform compact, we do need the entire meta to restore LSM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
