nihal0107 commented on a change in pull request #3737:
URL: https://github.com/apache/carbondata/pull/3737#discussion_r419375968
##########
File path: docs/performance-tuning.md
##########
@@ -141,12 +144,12 @@
| Parameter | Default Value | Description/Tuning |
|-----------|-------------|--------|
|carbon.number.of.cores.while.loading|Default: 2. This value should be >=
2|Specifies the number of cores used for data processing during data loading in
CarbonData. |
-|carbon.sort.size|Default: 100000. The value should be >= 100.|Threshold to
write local file in sort step when loading data|
-|carbon.sort.file.write.buffer.size|Default: 16384.|CarbonData sorts and
writes data to intermediate files to limit the memory usage. This configuration
determines the buffer size to be used for reading and writing such files. |
+|carbon.sort.size|Default: 100000. The value should be >= 1000.|Threshold to
write local file in sort step when loading data|
+|carbon.sort.file.write.buffer.size|Default: 16384. The value should be >=
10240 and <= 10485760.|CarbonData sorts and writes data to intermediate files
to limit the memory usage. This configuration determines the buffer size to be
used for reading and writing such files. |
|carbon.merge.sort.reader.thread|Default: 3 |Specifies the number of cores
used for temp file merging during data loading in CarbonData.|
|carbon.merge.sort.prefetch|Default: true | You may want set this value to
false if you have not enough memory|
- For example, if there are 10 million records, and i have only 16 cores, 64GB
memory, will be loaded to CarbonData table.
+ For example, if there are 10 million records, and I have only 16 cores, 64
GB memory, will be loaded to CarbonData table.
Review comment:
done
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
