This is an automated email from the ASF dual-hosted git repository.
agrove pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/main by this push:
new d808d36c chore: Update config document (#586)
d808d36c is described below
commit d808d36c9de023b820cf37f0ac2584be8bb09eb3
Author: Liang-Chi Hsieh <[email protected]>
AuthorDate: Tue Jun 18 15:29:40 2024 -0700
chore: Update config document (#586)
---
docs/source/user-guide/configs.md | 1 -
1 file changed, 1 deletion(-)
diff --git a/docs/source/user-guide/configs.md
b/docs/source/user-guide/configs.md
index f232dc8b..104f29ce 100644
--- a/docs/source/user-guide/configs.md
+++ b/docs/source/user-guide/configs.md
@@ -48,4 +48,3 @@ Comet provides the following configuration settings.
| spark.comet.scan.preFetch.enabled | Whether to enable pre-fetching feature
of CometScan. By default is disabled. | false |
| spark.comet.scan.preFetch.threadNum | The number of threads running
pre-fetching for CometScan. Effective if spark.comet.scan.preFetch.enabled is
enabled. By default it is 2. Note that more pre-fetching threads means more
memory requirement to store pre-fetched row groups. | 2 |
| spark.comet.shuffle.preferDictionary.ratio | The ratio of total values to
distinct values in a string column to decide whether to prefer dictionary
encoding when shuffling the column. If the ratio is higher than this config,
dictionary encoding will be used on shuffling string column. This config is
effective if it is higher than 1.0. By default, this config is 10.0. Note that
this config is only used when 'spark.comet.columnar.shuffle.enabled' is true. |
10.0 |
-| spark.comet.xxhash64.enabled | The xxhash64 implementation is not optimized
yet and may cause performance issues. | false |
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
