This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new f1744e6c Publish built docs triggered by
5e05626c970b7ca4d2563b2d97442d3a69256880
f1744e6c is described below
commit f1744e6cda4844c1f8cc230fb3aaa3b6f0cdf7d2
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Wed May 15 19:22:35 2024 +0000
Publish built docs triggered by 5e05626c970b7ca4d2563b2d97442d3a69256880
---
_sources/user-guide/installation.md.txt | 8 ++++++--
searchindex.js | 2 +-
user-guide/installation.html | 16 ++++++++++------
3 files changed, 17 insertions(+), 9 deletions(-)
diff --git a/_sources/user-guide/installation.md.txt
b/_sources/user-guide/installation.md.txt
index efc58f1e..03ecc53e 100644
--- a/_sources/user-guide/installation.md.txt
+++ b/_sources/user-guide/installation.md.txt
@@ -57,13 +57,17 @@ Note that the project builds for Scala 2.12 by default but
can be built for Scal
make release PROFILES="-Pspark-3.4 -Pscala-2.13"
```
-## Run Spark with Comet enabled
+## Run Spark Shell with Comet enabled
Make sure `SPARK_HOME` points to the same Spark version as Comet was built for.
```console
+export COMET_JAR=spark/target/comet-spark-spark3.4_2.12-0.1.0-SNAPSHOT.jar
+
$SPARK_HOME/bin/spark-shell \
- --jars spark/target/comet-spark-spark3.4_2.12-0.1.0-SNAPSHOT.jar \
+ --jars $COMET_JAR \
+ --conf spark.driver.extraClassPath=$COMET_JAR \
+ --conf spark.executor.extraClassPath=$COMET_JAR \
--conf spark.sql.extensions=org.apache.comet.CometSparkSessionExtensions \
--conf spark.comet.enabled=true \
--conf spark.comet.exec.enabled=true \
diff --git a/searchindex.js b/searchindex.js
index 0629bd30..1c77886c 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"ANSI mode": [[5, "ansi-mode"]], "ASF Links":
[[4, null]], "Additional Info": [[1, "additional-info"]], "After your debugging
is done": [[1, "after-your-debugging-is-done"]], "Apache DataFusion Comet":
[[4, "apache-datafusion-comet"]], "Architecture": [[11, "architecture"]],
"Asking for Help": [[0, "asking-for-help"]], "Benchmark": [[2, "benchmark"]],
"Build & Test": [[2, "build-test"]], "Building From Source": [[9,
"building-from-source"]], "CLion": [[2, " [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"ANSI mode": [[5, "ansi-mode"]], "ASF Links":
[[4, null]], "Additional Info": [[1, "additional-info"]], "After your debugging
is done": [[1, "after-your-debugging-is-done"]], "Apache DataFusion Comet":
[[4, "apache-datafusion-comet"]], "Architecture": [[11, "architecture"]],
"Asking for Help": [[0, "asking-for-help"]], "Benchmark": [[2, "benchmark"]],
"Build & Test": [[2, "build-test"]], "Building From Source": [[9,
"building-from-source"]], "CLion": [[2, " [...]
\ No newline at end of file
diff --git a/user-guide/installation.html b/user-guide/installation.html
index 20269590..6a37b411 100644
--- a/user-guide/installation.html
+++ b/user-guide/installation.html
@@ -262,8 +262,8 @@ under the License.
</a>
</li>
<li class="toc-h2 nav-item toc-entry">
- <a class="reference internal nav-link" href="#run-spark-with-comet-enabled">
- Run Spark with Comet enabled
+ <a class="reference internal nav-link"
href="#run-spark-shell-with-comet-enabled">
+ Run Spark Shell with Comet enabled
</a>
<ul class="nav section-nav flex-column">
<li class="toc-h3 nav-item toc-entry">
@@ -362,11 +362,15 @@ under the License.
</pre></div>
</div>
</section>
-<section id="run-spark-with-comet-enabled">
-<h2>Run Spark with Comet enabled<a class="headerlink"
href="#run-spark-with-comet-enabled" title="Link to this heading">¶</a></h2>
+<section id="run-spark-shell-with-comet-enabled">
+<h2>Run Spark Shell with Comet enabled<a class="headerlink"
href="#run-spark-shell-with-comet-enabled" title="Link to this
heading">¶</a></h2>
<p>Make sure <code class="docutils literal notranslate"><span
class="pre">SPARK_HOME</span></code> points to the same Spark version as Comet
was built for.</p>
-<div class="highlight-console notranslate"><div
class="highlight"><pre><span></span><span
class="gp">$</span>SPARK_HOME/bin/spark-shell<span class="w"> </span><span
class="se">\</span>
-<span class="w"> </span>--jars<span class="w">
</span>spark/target/comet-spark-spark3.4_2.12-0.1.0-SNAPSHOT.jar<span
class="w"> </span><span class="se">\</span>
+<div class="highlight-console notranslate"><div
class="highlight"><pre><span></span><span class="go">export
COMET_JAR=spark/target/comet-spark-spark3.4_2.12-0.1.0-SNAPSHOT.jar</span>
+
+<span class="gp">$</span>SPARK_HOME/bin/spark-shell<span class="w">
</span><span class="se">\</span>
+<span class="w"> </span>--jars<span class="w"> </span><span
class="nv">$COMET_JAR</span><span class="w"> </span><span class="se">\</span>
+<span class="w"> </span>--conf<span class="w">
</span>spark.driver.extraClassPath<span class="o">=</span><span
class="nv">$COMET_JAR</span><span class="w"> </span><span class="se">\</span>
+<span class="w"> </span>--conf<span class="w">
</span>spark.executor.extraClassPath<span class="o">=</span><span
class="nv">$COMET_JAR</span><span class="w"> </span><span class="se">\</span>
<span class="w"> </span>--conf<span class="w">
</span>spark.sql.extensions<span
class="o">=</span>org.apache.comet.CometSparkSessionExtensions<span class="w">
</span><span class="se">\</span>
<span class="w"> </span>--conf<span class="w">
</span>spark.comet.enabled<span class="o">=</span><span
class="nb">true</span><span class="w"> </span><span class="se">\</span>
<span class="w"> </span>--conf<span class="w">
</span>spark.comet.exec.enabled<span class="o">=</span><span
class="nb">true</span><span class="w"> </span><span class="se">\</span>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
