sundapeng commented on PR #82: URL: https://github.com/apache/paimon-mosaic/pull/82#issuecomment-5514657197
Closing this. On closer review this isn't a defect in mosaic — the 256 MB `row_group_max_size` default is intentional (large row groups maximize compression ratio and amortize seek cost for batch/server wide-table workloads), and the in-memory buffering it implies is by design. The customer report traced to using that batch-tuned default for a long-lived streaming/mobile writer without overriding it, i.e. a usage/tuning issue on the app side, not a core bug. Apologies for the noise; no upstream change is warranted here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
