This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 86fab5df97 Publish built docs triggered by
7979527bee394ee2bda24fb20b12b57408387a93
86fab5df97 is described below
commit 86fab5df97be8551a5ab47a11068de41f75c70e7
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Wed Jul 22 17:53:59 2026 +0000
Publish built docs triggered by 7979527bee394ee2bda24fb20b12b57408387a93
---
_sources/contributor-guide/expression-audits/array_funcs.md.txt | 6 +++---
contributor-guide/expression-audits/array_funcs.html | 6 +++---
searchindex.js | 2 +-
3 files changed, 7 insertions(+), 7 deletions(-)
diff --git a/_sources/contributor-guide/expression-audits/array_funcs.md.txt
b/_sources/contributor-guide/expression-audits/array_funcs.md.txt
index a4c0741a6a..bd10f55c23 100644
--- a/_sources/contributor-guide/expression-audits/array_funcs.md.txt
+++ b/_sources/contributor-guide/expression-audits/array_funcs.md.txt
@@ -37,9 +37,9 @@
## array_compact
-- Spark 3.4.3 (audited 2026-05-27): `RuntimeReplaceable` -> `ArrayFilter(arr,
IsNotNull(lambda))`. Comet receives the rewritten form, dispatches through
`CometArrayFilter`, which delegates back to `CometArrayCompact.convert` for the
actual proto emission. The native path uses Comet's `spark_array_compact` UDF
rather than DataFusion's `array_remove_all` because DataFusion 53 changed
`array_remove_all`'s NULL semantics.
+- Spark 3.4.3 (audited 2026-05-27): `RuntimeReplaceable` -> `ArrayFilter(arr,
IsNotNull(lambda))`. Comet receives the rewritten form, dispatches through
`CometArrayFilter`, which emits a call to DataFusion's built-in `array_compact`
(from `datafusion-functions-nested`) via `CometScalarFunction("array_compact")`.
- Spark 3.5.8 (audited 2026-05-27): identical to 3.4.3.
-- Spark 4.0.1 (audited 2026-05-27): the replacement is wrapped in
`KnownNotContainsNull(...)` (analysis-only hint, no semantic change).
+- Spark 4.0.1 (audited 2026-05-27): the replacement is wrapped in
`KnownNotContainsNull(...)`. The 4.x `Spark4xCometExprShim` strips the wrapper
and emits the same `array_compact` call.
- Spark 4.1.1 (audited 2026-05-27): identical to 4.0.1.
## array_contains
@@ -128,7 +128,7 @@
## array_repeat
- Spark 3.4.3 (audited 2026-05-27): identical to 3.5.8.
-- Spark 3.5.8 (audited 2026-05-27): baseline. `ArrayRepeat(left, right)
extends BinaryExpression with ExpectsInputTypes`; `inputTypes =
Seq(AnyDataType, IntegerType)`. NULL count yields NULL; count <= 0 yields empty
array; count > `MAX_ROUNDED_ARRAY_LENGTH` throws at runtime. Comet wraps the
call in `CaseWhen(IsNotNull(right), array_repeat(...), null)`.
+- Spark 3.5.8 (audited 2026-05-27): baseline. `ArrayRepeat(left, right)
extends BinaryExpression with ExpectsInputTypes`; `inputTypes =
Seq(AnyDataType, IntegerType)`. NULL count yields NULL; count <= 0 yields empty
array; count > `MAX_ROUNDED_ARRAY_LENGTH` throws at runtime. Wired as
`CometScalarFunction("array_repeat")` against `datafusion-spark`'s
`SparkArrayRepeat`, which returns NULL for NULL count and repeats NULL elements
(matching Spark).
- Spark 4.0.1 (audited 2026-05-27): error message uses
`createArrayWithElementsExceedLimitError(prettyName, count)`; semantics
unchanged.
- Spark 4.1.1 (audited 2026-05-27): identical to 4.0.1.
diff --git a/contributor-guide/expression-audits/array_funcs.html
b/contributor-guide/expression-audits/array_funcs.html
index 439f939664..14102cf0d5 100644
--- a/contributor-guide/expression-audits/array_funcs.html
+++ b/contributor-guide/expression-audits/array_funcs.html
@@ -573,9 +573,9 @@ under the License.
<section id="array-compact">
<h2>array_compact<a class="headerlink" href="#array-compact" title="Link to
this heading">#</a></h2>
<ul class="simple">
-<li><p>Spark 3.4.3 (audited 2026-05-27): <code class="docutils literal
notranslate"><span class="pre">RuntimeReplaceable</span></code> -> <code
class="docutils literal notranslate"><span class="pre">ArrayFilter(arr,</span>
<span class="pre">IsNotNull(lambda))</span></code>. Comet receives the
rewritten form, dispatches through <code class="docutils literal
notranslate"><span class="pre">CometArrayFilter</span></code>, which delegates
back to <code class="docutils literal notranslate"> [...]
+<li><p>Spark 3.4.3 (audited 2026-05-27): <code class="docutils literal
notranslate"><span class="pre">RuntimeReplaceable</span></code> -> <code
class="docutils literal notranslate"><span class="pre">ArrayFilter(arr,</span>
<span class="pre">IsNotNull(lambda))</span></code>. Comet receives the
rewritten form, dispatches through <code class="docutils literal
notranslate"><span class="pre">CometArrayFilter</span></code>, which emits a
call to DataFusion’s built-in <code class="docutils l [...]
<li><p>Spark 3.5.8 (audited 2026-05-27): identical to 3.4.3.</p></li>
-<li><p>Spark 4.0.1 (audited 2026-05-27): the replacement is wrapped in <code
class="docutils literal notranslate"><span
class="pre">KnownNotContainsNull(...)</span></code> (analysis-only hint, no
semantic change).</p></li>
+<li><p>Spark 4.0.1 (audited 2026-05-27): the replacement is wrapped in <code
class="docutils literal notranslate"><span
class="pre">KnownNotContainsNull(...)</span></code>. The 4.x <code
class="docutils literal notranslate"><span
class="pre">Spark4xCometExprShim</span></code> strips the wrapper and emits the
same <code class="docutils literal notranslate"><span
class="pre">array_compact</span></code> call.</p></li>
<li><p>Spark 4.1.1 (audited 2026-05-27): identical to 4.0.1.</p></li>
</ul>
</section>
@@ -688,7 +688,7 @@ under the License.
<h2>array_repeat<a class="headerlink" href="#array-repeat" title="Link to this
heading">#</a></h2>
<ul class="simple">
<li><p>Spark 3.4.3 (audited 2026-05-27): identical to 3.5.8.</p></li>
-<li><p>Spark 3.5.8 (audited 2026-05-27): baseline. <code class="docutils
literal notranslate"><span class="pre">ArrayRepeat(left,</span> <span
class="pre">right)</span> <span class="pre">extends</span> <span
class="pre">BinaryExpression</span> <span class="pre">with</span> <span
class="pre">ExpectsInputTypes</span></code>; <code class="docutils literal
notranslate"><span class="pre">inputTypes</span> <span class="pre">=</span>
<span class="pre">Seq(AnyDataType,</span> <span class="pre">I [...]
+<li><p>Spark 3.5.8 (audited 2026-05-27): baseline. <code class="docutils
literal notranslate"><span class="pre">ArrayRepeat(left,</span> <span
class="pre">right)</span> <span class="pre">extends</span> <span
class="pre">BinaryExpression</span> <span class="pre">with</span> <span
class="pre">ExpectsInputTypes</span></code>; <code class="docutils literal
notranslate"><span class="pre">inputTypes</span> <span class="pre">=</span>
<span class="pre">Seq(AnyDataType,</span> <span class="pre">I [...]
<li><p>Spark 4.0.1 (audited 2026-05-27): error message uses <code
class="docutils literal notranslate"><span
class="pre">createArrayWithElementsExceedLimitError(prettyName,</span> <span
class="pre">count)</span></code>; semantics unchanged.</p></li>
<li><p>Spark 4.1.1 (audited 2026-05-27): identical to 4.0.1.</p></li>
</ul>
diff --git a/searchindex.js b/searchindex.js
index c5116646cf..819a837e81 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"!": [[53, "id1"]], "%": [[51, "id1"]], "&":
[[41, "id1"]], "*": [[51, "id2"]], "+": [[51, "id3"]], "-": [[51, "id4"]], "/":
[[51, "id5"]], "1. Format Your Code": [[38, "format-your-code"]], "1. Install
Comet": [[59, "install-comet"], [69, "install-comet"]], "1. Native Operators
(nativeExecs map)": [[26, "native-operators-nativeexecs-map"]], "2. Build and
Verify": [[38, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[59,
"clone-iceberg-and-apply- [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"!": [[53, "id1"]], "%": [[51, "id1"]], "&":
[[41, "id1"]], "*": [[51, "id2"]], "+": [[51, "id3"]], "-": [[51, "id4"]], "/":
[[51, "id5"]], "1. Format Your Code": [[38, "format-your-code"]], "1. Install
Comet": [[59, "install-comet"], [69, "install-comet"]], "1. Native Operators
(nativeExecs map)": [[26, "native-operators-nativeexecs-map"]], "2. Build and
Verify": [[38, "build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[59,
"clone-iceberg-and-apply- [...]
\ No newline at end of file
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
