This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new fe792e19f Publish built docs triggered by
f01890910432350f2f9623e80ba7e7c4168d8656
fe792e19f is described below
commit fe792e19f477682a9e4a90160a55b8497fcded16
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Tue Mar 18 19:35:12 2025 +0000
Publish built docs triggered by f01890910432350f2f9623e80ba7e7c4168d8656
---
_sources/user-guide/datasources.md.txt | 2 +-
_sources/user-guide/installation.md.txt | 10 +++++-----
_sources/user-guide/kubernetes.md.txt | 16 ++++++++--------
_sources/user-guide/source.md.txt | 2 +-
searchindex.js | 2 +-
user-guide/datasources.html | 2 +-
user-guide/installation.html | 10 +++++-----
user-guide/kubernetes.html | 18 +++++++++---------
user-guide/source.html | 2 +-
9 files changed, 32 insertions(+), 32 deletions(-)
diff --git a/_sources/user-guide/datasources.md.txt
b/_sources/user-guide/datasources.md.txt
index 27c5492d8..5cca4b505 100644
--- a/_sources/user-guide/datasources.md.txt
+++ b/_sources/user-guide/datasources.md.txt
@@ -81,7 +81,7 @@ root
| |-- lastName: string (nullable = true)
| |-- ageInYears: integer (nullable = true)
-25/01/30 16:50:43 INFO core/src/lib.rs: Comet native library version 0.6.0
initialized
+25/01/30 16:50:43 INFO core/src/lib.rs: Comet native library version 0.7.0
initialized
== Physical Plan ==
* CometColumnarToRow (2)
+- CometNativeScan: (1)
diff --git a/_sources/user-guide/installation.md.txt
b/_sources/user-guide/installation.md.txt
index 2a2fc9c8c..88b651131 100644
--- a/_sources/user-guide/installation.md.txt
+++ b/_sources/user-guide/installation.md.txt
@@ -48,12 +48,12 @@ Cloud Service Providers.
Comet jar files are available in [Maven
Central](https://central.sonatype.com/namespace/org.apache.datafusion) for
amd64 and arm64 architectures for Linux. For Apple OSX, it
is currently necessary to build from source.
-Here are the direct links for downloading the Comet 0.6.0 jar file.
+Here are the direct links for downloading the Comet 0.7.0 jar file.
-- [Comet plugin for Spark 3.4 / Scala
2.12](https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.4_2.12/0.6.0/comet-spark-spark3.4_2.12-0.6.0.jar)
-- [Comet plugin for Spark 3.4 / Scala
2.13](https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.4_2.13/0.6.0/comet-spark-spark3.4_2.13-0.6.0.jar)
-- [Comet plugin for Spark 3.5 / Scala
2.12](https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.5_2.12/0.6.0/comet-spark-spark3.5_2.12-0.6.0.jar)
-- [Comet plugin for Spark 3.5 / Scala
2.13](https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.5_2.13/0.6.0/comet-spark-spark3.5_2.13-0.6.0.jar)
+- [Comet plugin for Spark 3.4 / Scala
2.12](https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.4_2.12/0.7.0/comet-spark-spark3.4_2.12-0.7.0.jar)
+- [Comet plugin for Spark 3.4 / Scala
2.13](https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.4_2.13/0.7.0/comet-spark-spark3.4_2.13-0.7.0.jar)
+- [Comet plugin for Spark 3.5 / Scala
2.12](https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.5_2.12/0.7.0/comet-spark-spark3.5_2.12-0.7.0.jar)
+- [Comet plugin for Spark 3.5 / Scala
2.13](https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.5_2.13/0.7.0/comet-spark-spark3.5_2.13-0.7.0.jar)
## Building from source
diff --git a/_sources/user-guide/kubernetes.md.txt
b/_sources/user-guide/kubernetes.md.txt
index d134d9560..1788d3f9a 100644
--- a/_sources/user-guide/kubernetes.md.txt
+++ b/_sources/user-guide/kubernetes.md.txt
@@ -22,7 +22,7 @@
## Comet Docker Images
Run the following command from the root of this repository to build the Comet
Docker image, or use a [published
-Docker
image](https://github.com/orgs/apache/packages?repo_name=datafusion-comet)
+Docker image](https://hub.docker.com/r/apache/datafusion-comet).
```shell
docker build -t apache/datafusion-comet -f kube/Dockerfile .
@@ -65,13 +65,13 @@ metadata:
spec:
type: Scala
mode: cluster
- image: ghcr.io/apache/datafusion-comet:spark-3.4-scala-2.12-0.5.0
+ image: apache/datafusion-comet:0.7.0-spark3.5.4-scala2.12-java11
imagePullPolicy: IfNotPresent
mainClass: org.apache.spark.examples.SparkPi
- mainApplicationFile:
local:///opt/spark/examples/jars/spark-examples_2.12-3.4.2.jar
+ mainApplicationFile:
local:///opt/spark/examples/jars/spark-examples_2.12-3.5.4.jar
sparkConf:
- "spark.executor.extraClassPath":
"/opt/spark/jars/comet-spark-spark3.4_2.12-0.5.0.jar"
- "spark.driver.extraClassPath":
"/opt/spark/jars/comet-spark-spark3.4_2.12-0.5.0.jar"
+ "spark.executor.extraClassPath":
"/opt/spark/jars/comet-spark-spark3.5_2.12-0.7.0.jar"
+ "spark.driver.extraClassPath":
"/opt/spark/jars/comet-spark-spark3.5_2.12-0.7.0.jar"
"spark.plugins": "org.apache.spark.CometPlugin"
"spark.comet.enabled": "true"
"spark.comet.exec.enabled": "true"
@@ -79,17 +79,17 @@ spec:
"spark.comet.exec.shuffle.enabled": "true"
"spark.comet.exec.shuffle.mode": "auto"
"spark.shuffle.manager":
"org.apache.spark.sql.comet.execution.shuffle.CometShuffleManager"
- sparkVersion: 3.4.3
+ sparkVersion: 3.5.4
driver:
labels:
- version: 3.4.3
+ version: 3.5.4
cores: 1
coreLimit: 1200m
memory: 512m
serviceAccount: spark-operator-spark
executor:
labels:
- version: 3.4.3
+ version: 3.5.4
instances: 1
cores: 2
coreLimit: 1200m
diff --git a/_sources/user-guide/source.md.txt
b/_sources/user-guide/source.md.txt
index d2f58dd85..ab7f89745 100644
--- a/_sources/user-guide/source.md.txt
+++ b/_sources/user-guide/source.md.txt
@@ -27,7 +27,7 @@ Official source releases can be downloaded from
https://dist.apache.org/repos/di
```console
# Pick the latest version
-export COMET_VERSION=0.6.0
+export COMET_VERSION=0.7.0
# Download the tarball
curl -O
"https://dist.apache.org/repos/dist/release/datafusion/datafusion-comet-$COMET_VERSION/apache-datafusion-comet-$COMET_VERSION.tar.gz";
# Unpack
diff --git a/searchindex.js b/searchindex.js
index 0296f2106..4e6e7ef19 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"1. Install Comet": [[9, "install-comet"]], "2.
Clone Spark and Apply Diff": [[9, "clone-spark-and-apply-diff"]], "3. Run Spark
SQL Tests": [[9, "run-spark-sql-tests"]], "ANSI mode": [[11, "ansi-mode"]],
"API Differences Between Spark Versions": [[0,
"api-differences-between-spark-versions"]], "ASF Links": [[10, null]], "Adding
Spark-side Tests for the New Expression": [[0,
"adding-spark-side-tests-for-the-new-expression"]], "Adding a New Expression":
[[0, [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"1. Install Comet": [[9, "install-comet"]], "2.
Clone Spark and Apply Diff": [[9, "clone-spark-and-apply-diff"]], "3. Run Spark
SQL Tests": [[9, "run-spark-sql-tests"]], "ANSI mode": [[11, "ansi-mode"]],
"API Differences Between Spark Versions": [[0,
"api-differences-between-spark-versions"]], "ASF Links": [[10, null]], "Adding
Spark-side Tests for the New Expression": [[0,
"adding-spark-side-tests-for-the-new-expression"]], "Adding a New Expression":
[[0, [...]
\ No newline at end of file
diff --git a/user-guide/datasources.html b/user-guide/datasources.html
index fbdfc089a..0028332aa 100644
--- a/user-guide/datasources.html
+++ b/user-guide/datasources.html
@@ -442,7 +442,7 @@ root
<span class="w"> </span><span class="p">|</span><span class="w">
</span><span class="p">|</span>--<span class="w"> </span>lastName:<span
class="w"> </span>string<span class="w"> </span><span class="o">(</span><span
class="nv">nullable</span><span class="w"> </span><span class="o">=</span><span
class="w"> </span><span class="nb">true</span><span class="o">)</span>
<span class="w"> </span><span class="p">|</span><span class="w">
</span><span class="p">|</span>--<span class="w"> </span>ageInYears:<span
class="w"> </span>integer<span class="w"> </span><span class="o">(</span><span
class="nv">nullable</span><span class="w"> </span><span class="o">=</span><span
class="w"> </span><span class="nb">true</span><span class="o">)</span>
-<span class="m">25</span>/01/30<span class="w"> </span><span
class="m">16</span>:50:43<span class="w"> </span>INFO<span class="w">
</span>core/src/lib.rs:<span class="w"> </span>Comet<span class="w">
</span>native<span class="w"> </span>library<span class="w">
</span>version<span class="w"> </span><span class="m">0</span>.6.0<span
class="w"> </span><span class="nv">initialized</span>
+<span class="m">25</span>/01/30<span class="w"> </span><span
class="m">16</span>:50:43<span class="w"> </span>INFO<span class="w">
</span>core/src/lib.rs:<span class="w"> </span>Comet<span class="w">
</span>native<span class="w"> </span>library<span class="w">
</span>version<span class="w"> </span><span class="m">0</span>.7.0<span
class="w"> </span><span class="nv">initialized</span>
<span class="o">==</span><span class="w"> </span>Physical<span class="w">
</span><span class="nv">Plan</span><span class="w"> </span><span
class="o">==</span>
*<span class="w"> </span>CometColumnarToRow<span class="w"> </span><span
class="o">(</span><span class="m">2</span><span class="o">)</span>
+-<span class="w"> </span>CometNativeScan:<span class="w"> </span><span
class="o">(</span><span class="m">1</span><span class="o">)</span>
diff --git a/user-guide/installation.html b/user-guide/installation.html
index fdf722b7f..b0ea5b5af 100644
--- a/user-guide/installation.html
+++ b/user-guide/installation.html
@@ -420,12 +420,12 @@ Cloud Service Providers.</p>
<h2>Using a Published JAR File<a class="headerlink"
href="#using-a-published-jar-file" title="Link to this heading">¶</a></h2>
<p>Comet jar files are available in <a class="reference external"
href="https://central.sonatype.com/namespace/org.apache.datafusion";>Maven
Central</a> for amd64 and arm64 architectures for Linux. For Apple OSX, it
is currently necessary to build from source.</p>
-<p>Here are the direct links for downloading the Comet 0.6.0 jar file.</p>
+<p>Here are the direct links for downloading the Comet 0.7.0 jar file.</p>
<ul class="simple">
-<li><p><a class="reference external"
href="https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.4_2.12/0.6.0/comet-spark-spark3.4_2.12-0.6.0.jar";>Comet
plugin for Spark 3.4 / Scala 2.12</a></p></li>
-<li><p><a class="reference external"
href="https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.4_2.13/0.6.0/comet-spark-spark3.4_2.13-0.6.0.jar";>Comet
plugin for Spark 3.4 / Scala 2.13</a></p></li>
-<li><p><a class="reference external"
href="https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.5_2.12/0.6.0/comet-spark-spark3.5_2.12-0.6.0.jar";>Comet
plugin for Spark 3.5 / Scala 2.12</a></p></li>
-<li><p><a class="reference external"
href="https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.5_2.13/0.6.0/comet-spark-spark3.5_2.13-0.6.0.jar";>Comet
plugin for Spark 3.5 / Scala 2.13</a></p></li>
+<li><p><a class="reference external"
href="https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.4_2.12/0.7.0/comet-spark-spark3.4_2.12-0.7.0.jar";>Comet
plugin for Spark 3.4 / Scala 2.12</a></p></li>
+<li><p><a class="reference external"
href="https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.4_2.13/0.7.0/comet-spark-spark3.4_2.13-0.7.0.jar";>Comet
plugin for Spark 3.4 / Scala 2.13</a></p></li>
+<li><p><a class="reference external"
href="https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.5_2.12/0.7.0/comet-spark-spark3.5_2.12-0.7.0.jar";>Comet
plugin for Spark 3.5 / Scala 2.12</a></p></li>
+<li><p><a class="reference external"
href="https://repo1.maven.org/maven2/org/apache/datafusion/comet-spark-spark3.5_2.13/0.7.0/comet-spark-spark3.5_2.13-0.7.0.jar";>Comet
plugin for Spark 3.5 / Scala 2.13</a></p></li>
</ul>
</section>
<section id="building-from-source">
diff --git a/user-guide/kubernetes.html b/user-guide/kubernetes.html
index 18f92b142..486ec8801 100644
--- a/user-guide/kubernetes.html
+++ b/user-guide/kubernetes.html
@@ -351,8 +351,8 @@ under the License.
<h1>Comet Kubernetes Support<a class="headerlink"
href="#comet-kubernetes-support" title="Link to this heading">¶</a></h1>
<section id="comet-docker-images">
<h2>Comet Docker Images<a class="headerlink" href="#comet-docker-images"
title="Link to this heading">¶</a></h2>
-<p>Run the following command from the root of this repository to build the
Comet Docker image, or use a <a class="reference external"
href="https://github.com/orgs/apache/packages?repo_name=datafusion-comet";>published
-Docker image</a></p>
+<p>Run the following command from the root of this repository to build the
Comet Docker image, or use a <a class="reference external"
href="https://hub.docker.com/r/apache/datafusion-comet";>published
+Docker image</a>.</p>
<div class="highlight-shell notranslate"><div
class="highlight"><pre><span></span>docker<span class="w"> </span>build<span
class="w"> </span>-t<span class="w"> </span>apache/datafusion-comet<span
class="w"> </span>-f<span class="w"> </span>kube/Dockerfile<span class="w">
</span>.
</pre></div>
</div>
@@ -391,13 +391,13 @@ metadata:
spec:
<span class="w"> </span>type:<span class="w"> </span>Scala
<span class="w"> </span>mode:<span class="w"> </span>cluster
-<span class="w"> </span>image:<span class="w">
</span>ghcr.io/apache/datafusion-comet:spark-3.4-scala-2.12-0.5.0
+<span class="w"> </span>image:<span class="w">
</span>apache/datafusion-comet:0.7.0-spark3.5.4-scala2.12-java11
<span class="w"> </span>imagePullPolicy:<span class="w"> </span>IfNotPresent
<span class="w"> </span>mainClass:<span class="w">
</span>org.apache.spark.examples.SparkPi
-<span class="w"> </span>mainApplicationFile:<span class="w">
</span>local:///opt/spark/examples/jars/spark-examples_2.12-3.4.2.jar
+<span class="w"> </span>mainApplicationFile:<span class="w">
</span>local:///opt/spark/examples/jars/spark-examples_2.12-3.5.4.jar
<span class="w"> </span>sparkConf:
-<span class="w"> </span><span
class="s2">"spark.executor.extraClassPath"</span>:<span class="w">
</span><span
class="s2">"/opt/spark/jars/comet-spark-spark3.4_2.12-0.5.0.jar"</span>
-<span class="w"> </span><span
class="s2">"spark.driver.extraClassPath"</span>:<span class="w">
</span><span
class="s2">"/opt/spark/jars/comet-spark-spark3.4_2.12-0.5.0.jar"</span>
+<span class="w"> </span><span
class="s2">"spark.executor.extraClassPath"</span>:<span class="w">
</span><span
class="s2">"/opt/spark/jars/comet-spark-spark3.5_2.12-0.7.0.jar"</span>
+<span class="w"> </span><span
class="s2">"spark.driver.extraClassPath"</span>:<span class="w">
</span><span
class="s2">"/opt/spark/jars/comet-spark-spark3.5_2.12-0.7.0.jar"</span>
<span class="w"> </span><span
class="s2">"spark.plugins"</span>:<span class="w"> </span><span
class="s2">"org.apache.spark.CometPlugin"</span>
<span class="w"> </span><span
class="s2">"spark.comet.enabled"</span>:<span class="w"> </span><span
class="s2">"true"</span>
<span class="w"> </span><span
class="s2">"spark.comet.exec.enabled"</span>:<span class="w">
</span><span class="s2">"true"</span>
@@ -405,17 +405,17 @@ spec:
<span class="w"> </span><span
class="s2">"spark.comet.exec.shuffle.enabled"</span>:<span class="w">
</span><span class="s2">"true"</span>
<span class="w"> </span><span
class="s2">"spark.comet.exec.shuffle.mode"</span>:<span class="w">
</span><span class="s2">"auto"</span>
<span class="w"> </span><span
class="s2">"spark.shuffle.manager"</span>:<span class="w">
</span><span
class="s2">"org.apache.spark.sql.comet.execution.shuffle.CometShuffleManager"</span>
-<span class="w"> </span>sparkVersion:<span class="w"> </span><span
class="m">3</span>.4.3
+<span class="w"> </span>sparkVersion:<span class="w"> </span><span
class="m">3</span>.5.4
<span class="w"> </span>driver:
<span class="w"> </span>labels:
-<span class="w"> </span>version:<span class="w"> </span><span
class="m">3</span>.4.3
+<span class="w"> </span>version:<span class="w"> </span><span
class="m">3</span>.5.4
<span class="w"> </span>cores:<span class="w"> </span><span
class="m">1</span>
<span class="w"> </span>coreLimit:<span class="w"> </span>1200m
<span class="w"> </span>memory:<span class="w"> </span>512m
<span class="w"> </span>serviceAccount:<span class="w">
</span>spark-operator-spark
<span class="w"> </span>executor:
<span class="w"> </span>labels:
-<span class="w"> </span>version:<span class="w"> </span><span
class="m">3</span>.4.3
+<span class="w"> </span>version:<span class="w"> </span><span
class="m">3</span>.5.4
<span class="w"> </span>instances:<span class="w"> </span><span
class="m">1</span>
<span class="w"> </span>cores:<span class="w"> </span><span
class="m">2</span>
<span class="w"> </span>coreLimit:<span class="w"> </span>1200m
diff --git a/user-guide/source.html b/user-guide/source.html
index 470e8600b..b58ae13a5 100644
--- a/user-guide/source.html
+++ b/user-guide/source.html
@@ -349,7 +349,7 @@ under the License.
<h2>Using a Published Source Release<a class="headerlink"
href="#using-a-published-source-release" title="Link to this heading">¶</a></h2>
<p>Official source releases can be downloaded from
https://dist.apache.org/repos/dist/release/datafusion/</p>
<div class="highlight-console notranslate"><div
class="highlight"><pre><span></span><span class="gp"># </span>Pick<span
class="w"> </span>the<span class="w"> </span>latest<span class="w">
</span>version
-<span class="go">export COMET_VERSION=0.6.0</span>
+<span class="go">export COMET_VERSION=0.7.0</span>
<span class="gp"># </span>Download<span class="w"> </span>the<span class="w">
</span>tarball
<span class="go">curl -O
"https://dist.apache.org/repos/dist/release/datafusion/datafusion-comet-$COMET_VERSION/apache-datafusion-comet-$COMET_VERSION.tar.gz"</span>
<span class="gp"># </span>Unpack
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
