This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push: new 4ef9569c9 Publish built docs triggered by 7620ebca489f22921033e0c20fbcc5bfad0a13c0 4ef9569c9 is described below commit 4ef9569c97b5c60ea4282e5d224a50950b4310ef Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com> AuthorDate: Mon Sep 8 23:11:49 2025 +0000 Publish built docs triggered by 7620ebca489f22921033e0c20fbcc5bfad0a13c0 --- _sources/user-guide/latest/configs.md.txt | 1 + searchindex.js | 2 +- user-guide/latest/configs.html | 4 ++++ 3 files changed, 6 insertions(+), 1 deletion(-) diff --git a/_sources/user-guide/latest/configs.md.txt b/_sources/user-guide/latest/configs.md.txt index bbfdf2984..0582c2902 100644 --- a/_sources/user-guide/latest/configs.md.txt +++ b/_sources/user-guide/latest/configs.md.txt @@ -90,4 +90,5 @@ Comet provides the following configuration settings. | spark.comet.shuffle.preferDictionary.ratio | The ratio of total values to distinct values in a string column to decide whether to prefer dictionary encoding when shuffling the column. If the ratio is higher than this config, dictionary encoding will be used on shuffling string column. This config is effective if it is higher than 1.0. Note that this config is only used when `spark.comet.exec.shuffle.mode` is `jvm`. | 10.0 | | spark.comet.shuffle.sizeInBytesMultiplier | Comet reports smaller sizes for shuffle due to using Arrow's columnar memory format and this can result in Spark choosing a different join strategy due to the estimated size of the exchange being smaller. Comet will multiple sizeInBytes by this amount to avoid regressions in join strategy. | 1.0 | | spark.comet.sparkToColumnar.supportedOperatorList | A comma-separated list of operators that will be converted to Arrow columnar format when 'spark.comet.sparkToColumnar.enabled' is true | Range,InMemoryTableScan | +| spark.hadoop.fs.comet.libhdfs.schemes | Defines filesystem schemes (e.g., hdfs, webhdfs) that the native side accesses via libhdfs, separated by commas. Valid only when built with hdfs feature enabled. | | <!--END:CONFIG_TABLE--> diff --git a/searchindex.js b/searchindex.js index 921dede3b..c6b73ff6d 100644 --- a/searchindex.js +++ b/searchindex.js @@ -1 +1 @@ -Search.setIndex({"alltitles": {"1. Install Comet": [[12, "install-comet"]], "2. Clone Spark and Apply Diff": [[12, "clone-spark-and-apply-diff"]], "3. Run Spark SQL Tests": [[12, "run-spark-sql-tests"]], "ANSI Mode": [[43, "ansi-mode"]], "ANSI mode": [[17, "ansi-mode"], [30, "ansi-mode"]], "API Differences Between Spark Versions": [[0, "api-differences-between-spark-versions"]], "Accelerating Apache Iceberg Parquet Scans using Comet (Experimental)": [[22, null], [35, null], [48, null]], [...] \ No newline at end of file +Search.setIndex({"alltitles": {"1. Install Comet": [[12, "install-comet"]], "2. Clone Spark and Apply Diff": [[12, "clone-spark-and-apply-diff"]], "3. Run Spark SQL Tests": [[12, "run-spark-sql-tests"]], "ANSI Mode": [[43, "ansi-mode"]], "ANSI mode": [[17, "ansi-mode"], [30, "ansi-mode"]], "API Differences Between Spark Versions": [[0, "api-differences-between-spark-versions"]], "Accelerating Apache Iceberg Parquet Scans using Comet (Experimental)": [[22, null], [35, null], [48, null]], [...] \ No newline at end of file diff --git a/user-guide/latest/configs.html b/user-guide/latest/configs.html index 1c16f4e6b..2d47a8459 100644 --- a/user-guide/latest/configs.html +++ b/user-guide/latest/configs.html @@ -779,6 +779,10 @@ under the License. <td><p>A comma-separated list of operators that will be converted to Arrow columnar format when ‘spark.comet.sparkToColumnar.enabled’ is true</p></td> <td><p>Range,InMemoryTableScan</p></td> </tr> +<tr class="row-even"><td><p>spark.hadoop.fs.comet.libhdfs.schemes</p></td> +<td><p>Defines filesystem schemes (e.g., hdfs, webhdfs) that the native side accesses via libhdfs, separated by commas. Valid only when built with hdfs feature enabled.</p></td> +<td><p></p></td> +</tr> </tbody> </table> <!--END:CONFIG_TABLE--> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@datafusion.apache.org For additional commands, e-mail: commits-h...@datafusion.apache.org