JingsongLi commented on code in PR #1570: URL: https://github.com/apache/incubator-paimon/pull/1570#discussion_r1264879817
########## docs/content/maintenance/write-performance.md: ########## @@ -183,7 +183,7 @@ There are three main places in Paimon writer that takes up memory: * Writer's memory buffer, shared and preempted by all writers of a single task. This memory value can be adjusted by the `write-buffer-size` table property. * Memory consumed when merging several sorted runs for compaction. Can be adjusted by the `num-sorted-run.compaction-trigger` option to change the number of sorted runs to be merged. * If the row is very large, reading too many lines of data at once can consume a lot of memory when making a compaction. Reducing the `read.batch-size` option can alleviate the impact of this case. -* The memory consumed by writing columnar (ORC, Parquet, etc.) file, which is not adjustable. +* The memory consumed by writing columnar (ORC, Parquet, etc.) file. Decreasing the `orc.write.batch-size` can improve the consume of memory for ORC format. Review Comment: `improve the consume of memory`? Just say reduce memory? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
