This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new ae637d411 Publish built docs triggered by
ebb5cff64c045210b184efa586c51963f286db06
ae637d411 is described below
commit ae637d411cdc06dd17265bab58f3d6a59ea45d1a
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Wed May 13 12:26:32 2026 +0000
Publish built docs triggered by ebb5cff64c045210b184efa586c51963f286db06
---
_sources/user-guide/latest/compatibility/spark-versions.md.txt | 10 ++++++++++
searchindex.js | 2 +-
user-guide/latest/compatibility/spark-versions.html | 8 ++++++++
3 files changed, 19 insertions(+), 1 deletion(-)
diff --git a/_sources/user-guide/latest/compatibility/spark-versions.md.txt
b/_sources/user-guide/latest/compatibility/spark-versions.md.txt
index 663be37a2..8c17fd6b1 100644
--- a/_sources/user-guide/latest/compatibility/spark-versions.md.txt
+++ b/_sources/user-guide/latest/compatibility/spark-versions.md.txt
@@ -34,6 +34,11 @@ Spark 3.4.3 is supported with Java 11/17 and Scala 2.12/2.13.
(SPARK-36182), but Comet's `native_datafusion` scan silently returns the raw
UTC value instead.
See [Parquet Compatibility](scans.md#native_datafusion-limitations) for
details.
+- **Unsupported Parquet type conversions**: Spark 3.4 raises schema
incompatibility errors for
+ certain type mismatches (e.g., reading INT32 as BIGINT, decimal precision
changes), but Comet's
+ `native_datafusion` scan may not detect these and could return unexpected
values.
+ See [Parquet Compatibility](scans.md#native_datafusion-limitations) for
details.
+
## Spark 3.5
Spark 3.5.8 is supported with Java 11/17 and Scala 2.12/2.13.
@@ -44,6 +49,11 @@ Spark 3.5.8 is supported with Java 11/17 and Scala 2.12/2.13.
(SPARK-36182), but Comet's `native_datafusion` scan silently returns the raw
UTC value instead.
See [Parquet Compatibility](scans.md#native_datafusion-limitations) for
details.
+- **Unsupported Parquet type conversions**: Spark 3.5 raises schema
incompatibility errors for
+ certain type mismatches (e.g., reading INT32 as BIGINT, decimal precision
changes), but Comet's
+ `native_datafusion` scan may not detect these and could return unexpected
values.
+ See [Parquet Compatibility](scans.md#native_datafusion-limitations) for
details.
+
## Spark 4.0
Spark 4.0.2 is supported with Java 17 and Scala 2.13.
diff --git a/searchindex.js b/searchindex.js
index e0c94be90..b402d0545 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"1. Format Your Code": [[14,
"format-your-code"]], "1. Install Comet": [[16, "install-comet"], [24,
"install-comet"]], "1. Native Operators (nativeExecs map)": [[3,
"native-operators-nativeexecs-map"]], "2. Build and Verify": [[14,
"build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[16,
"clone-iceberg-and-apply-diff"]], "2. Clone Spark and Apply Diff": [[24,
"clone-spark-and-apply-diff"]], "2. Sink Operators (sinks map)": [[3,
"sink-operators-sinks-m [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"1. Format Your Code": [[14,
"format-your-code"]], "1. Install Comet": [[16, "install-comet"], [24,
"install-comet"]], "1. Native Operators (nativeExecs map)": [[3,
"native-operators-nativeexecs-map"]], "2. Build and Verify": [[14,
"build-and-verify"]], "2. Clone Iceberg and Apply Diff": [[16,
"clone-iceberg-and-apply-diff"]], "2. Clone Spark and Apply Diff": [[24,
"clone-spark-and-apply-diff"]], "2. Sink Operators (sinks map)": [[3,
"sink-operators-sinks-m [...]
\ No newline at end of file
diff --git a/user-guide/latest/compatibility/spark-versions.html
b/user-guide/latest/compatibility/spark-versions.html
index 3442aa7bc..b5af643c4 100644
--- a/user-guide/latest/compatibility/spark-versions.html
+++ b/user-guide/latest/compatibility/spark-versions.html
@@ -484,6 +484,10 @@ compatibility guide.</p>
<li><p><strong>Reading <code class="docutils literal notranslate"><span
class="pre">TimestampLTZ</span></code> as <code class="docutils literal
notranslate"><span class="pre">TimestampNTZ</span></code></strong>: Spark 3.4
raises an error for this operation
(SPARK-36182), but Comet’s <code class="docutils literal notranslate"><span
class="pre">native_datafusion</span></code> scan silently returns the raw UTC
value instead.
See <a class="reference internal"
href="scans.html#native-datafusion-limitations"><span class="std
std-ref">Parquet Compatibility</span></a> for details.</p></li>
+<li><p><strong>Unsupported Parquet type conversions</strong>: Spark 3.4 raises
schema incompatibility errors for
+certain type mismatches (e.g., reading INT32 as BIGINT, decimal precision
changes), but Comet’s
+<code class="docutils literal notranslate"><span
class="pre">native_datafusion</span></code> scan may not detect these and could
return unexpected values.
+See <a class="reference internal"
href="scans.html#native-datafusion-limitations"><span class="std
std-ref">Parquet Compatibility</span></a> for details.</p></li>
</ul>
</section>
</section>
@@ -496,6 +500,10 @@ See <a class="reference internal"
href="scans.html#native-datafusion-limitations
<li><p><strong>Reading <code class="docutils literal notranslate"><span
class="pre">TimestampLTZ</span></code> as <code class="docutils literal
notranslate"><span class="pre">TimestampNTZ</span></code></strong>: Spark 3.5
raises an error for this operation
(SPARK-36182), but Comet’s <code class="docutils literal notranslate"><span
class="pre">native_datafusion</span></code> scan silently returns the raw UTC
value instead.
See <a class="reference internal"
href="scans.html#native-datafusion-limitations"><span class="std
std-ref">Parquet Compatibility</span></a> for details.</p></li>
+<li><p><strong>Unsupported Parquet type conversions</strong>: Spark 3.5 raises
schema incompatibility errors for
+certain type mismatches (e.g., reading INT32 as BIGINT, decimal precision
changes), but Comet’s
+<code class="docutils literal notranslate"><span
class="pre">native_datafusion</span></code> scan may not detect these and could
return unexpected values.
+See <a class="reference internal"
href="scans.html#native-datafusion-limitations"><span class="std
std-ref">Parquet Compatibility</span></a> for details.</p></li>
</ul>
</section>
</section>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
