This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push: new 96653b859 Publish built docs triggered by 5ac7d9272d7f5e516b092a5fe1d5a3f09f69e2e5 96653b859 is described below commit 96653b8596d869f0de24c0967e19a4167521d12d Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com> AuthorDate: Thu May 29 16:53:28 2025 +0000 Publish built docs triggered by 5ac7d9272d7f5e516b092a5fe1d5a3f09f69e2e5 --- _sources/user-guide/compatibility.md.txt | 1 + searchindex.js | 2 +- user-guide/compatibility.html | 1 + 3 files changed, 3 insertions(+), 1 deletion(-) diff --git a/_sources/user-guide/compatibility.md.txt b/_sources/user-guide/compatibility.md.txt index b76e2616c..212dc0dc3 100644 --- a/_sources/user-guide/compatibility.md.txt +++ b/_sources/user-guide/compatibility.md.txt @@ -66,6 +66,7 @@ types (regardless of the logical type). This behavior can be disabled by setting information. - There are failures in the Spark SQL test suite when enabling these new scans (tracking issues: [#1542] and [#1545]). - No support for default values that are nested types (e.g., maps, arrays, structs). Literal default values are supported. +- Setting Spark configs `ignoreMissingFiles` or `ignoreCorruptFiles` to `true` is not compatible with `native_datafusion` scan. [#1545]: https://github.com/apache/datafusion-comet/issues/1545 [#1542]: https://github.com/apache/datafusion-comet/issues/1542 diff --git a/searchindex.js b/searchindex.js index 8b488d8a5..880ef53ac 100644 --- a/searchindex.js +++ b/searchindex.js @@ -1 +1 @@ -Search.setIndex({"alltitles": {"1. Install Comet": [[11, "install-comet"]], "2. Clone Spark and Apply Diff": [[11, "clone-spark-and-apply-diff"]], "3. Run Spark SQL Tests": [[11, "run-spark-sql-tests"]], "ANSI mode": [[14, "ansi-mode"]], "API Differences Between Spark Versions": [[0, "api-differences-between-spark-versions"]], "ASF Links": [[13, null]], "Accelerating Apache Iceberg Parquet Scans using Comet (Experimental)": [[19, null]], "Adding Spark-side Tests for the New Expression": [...] \ No newline at end of file +Search.setIndex({"alltitles": {"1. Install Comet": [[11, "install-comet"]], "2. Clone Spark and Apply Diff": [[11, "clone-spark-and-apply-diff"]], "3. Run Spark SQL Tests": [[11, "run-spark-sql-tests"]], "ANSI mode": [[14, "ansi-mode"]], "API Differences Between Spark Versions": [[0, "api-differences-between-spark-versions"]], "ASF Links": [[13, null]], "Accelerating Apache Iceberg Parquet Scans using Comet (Experimental)": [[19, null]], "Adding Spark-side Tests for the New Expression": [...] \ No newline at end of file diff --git a/user-guide/compatibility.html b/user-guide/compatibility.html index 90aec5298..86bd22dff 100644 --- a/user-guide/compatibility.html +++ b/user-guide/compatibility.html @@ -457,6 +457,7 @@ types (regardless of the logical type). This behavior can be disabled by setting information.</p></li> <li><p>There are failures in the Spark SQL test suite when enabling these new scans (tracking issues: <a class="reference external" href="https://github.com/apache/datafusion-comet/issues/1542">#1542</a> and <a class="reference external" href="https://github.com/apache/datafusion-comet/issues/1545">#1545</a>).</p></li> <li><p>No support for default values that are nested types (e.g., maps, arrays, structs). Literal default values are supported.</p></li> +<li><p>Setting Spark configs <code class="docutils literal notranslate"><span class="pre">ignoreMissingFiles</span></code> or <code class="docutils literal notranslate"><span class="pre">ignoreCorruptFiles</span></code> to <code class="docutils literal notranslate"><span class="pre">true</span></code> is not compatible with <code class="docutils literal notranslate"><span class="pre">native_datafusion</span></code> scan.</p></li> </ul> </section> <section id="ansi-mode"> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@datafusion.apache.org For additional commands, e-mail: commits-h...@datafusion.apache.org