This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 2c8421e4 Publish built docs triggered by
c819bc0b0d3d1c98e6b36fcafcf184f5bb4b2c2c
2c8421e4 is described below
commit 2c8421e4990170bd080a9763f5e74c1b3a03de46
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Wed Jun 5 22:13:32 2024 +0000
Publish built docs triggered by c819bc0b0d3d1c98e6b36fcafcf184f5bb4b2c2c
---
_sources/user-guide/installation.md.txt | 6 ++++++
_sources/user-guide/tuning.md.txt | 2 ++
searchindex.js | 2 +-
user-guide/installation.html | 4 ++++
user-guide/tuning.html | 3 +++
5 files changed, 16 insertions(+), 1 deletion(-)
diff --git a/_sources/user-guide/installation.md.txt
b/_sources/user-guide/installation.md.txt
index 03ecc53e..7335a488 100644
--- a/_sources/user-guide/installation.md.txt
+++ b/_sources/user-guide/installation.md.txt
@@ -57,6 +57,12 @@ Note that the project builds for Scala 2.12 by default but
can be built for Scal
make release PROFILES="-Pspark-3.4 -Pscala-2.13"
```
+To build Comet from the source distribution on an isolated environment without
an access to `github.com` it is necessary to disable
`git-commit-id-maven-plugin`, otherwise you will face errors that there is no
access to the git during the build process. In that case you may use:
+
+```console
+make release-nogit PROFILES="-Pspark-3.4"
+```
+
## Run Spark Shell with Comet enabled
Make sure `SPARK_HOME` points to the same Spark version as Comet was built for.
diff --git a/_sources/user-guide/tuning.md.txt
b/_sources/user-guide/tuning.md.txt
index 5a3100bd..f46ab9e0 100644
--- a/_sources/user-guide/tuning.md.txt
+++ b/_sources/user-guide/tuning.md.txt
@@ -39,6 +39,8 @@ It must be set before the Spark context is created. You can
enable or disable Co
at runtime by setting `spark.comet.exec.shuffle.enabled` to `true` or `false`.
Once it is disabled, Comet will fallback to the default Spark shuffle manager.
+> **_NOTE:_** At the moment Comet Shuffle is not compatible with Spark AQE
partition coalesce. To disable set
`spark.sql.adaptive.coalescePartitions.enabled` to `false`.
+
### Shuffle Mode
Comet provides three shuffle modes: Columnar Shuffle, Native Shuffle and Auto
Mode.
diff --git a/searchindex.js b/searchindex.js
index c95c0488..0ce03167 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"ANSI mode": [[8, "ansi-mode"]], "API
Differences Between Spark Versions": [[0,
"api-differences-between-spark-versions"]], "ASF Links": [[7, null]], "Adding
Spark-side Tests for the New Expression": [[0,
"adding-spark-side-tests-for-the-new-expression"]], "Adding a New Expression":
[[0, "adding-a-new-expression"]], "Adding a New Scalar Function Expression":
[[0, "adding-a-new-scalar-function-expression"]], "Adding the Expression To the
Protobuf Definition" [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"ANSI mode": [[8, "ansi-mode"]], "API
Differences Between Spark Versions": [[0,
"api-differences-between-spark-versions"]], "ASF Links": [[7, null]], "Adding
Spark-side Tests for the New Expression": [[0,
"adding-spark-side-tests-for-the-new-expression"]], "Adding a New Expression":
[[0, "adding-a-new-expression"]], "Adding a New Scalar Function Expression":
[[0, "adding-a-new-scalar-function-expression"]], "Adding the Expression To the
Protobuf Definition" [...]
\ No newline at end of file
diff --git a/user-guide/installation.html b/user-guide/installation.html
index 200a03e2..5925c0d7 100644
--- a/user-guide/installation.html
+++ b/user-guide/installation.html
@@ -381,6 +381,10 @@ under the License.
<div class="highlight-console notranslate"><div
class="highlight"><pre><span></span><span class="go">make release
PROFILES="-Pspark-3.4 -Pscala-2.13"</span>
</pre></div>
</div>
+<p>To build Comet from the source distribution on an isolated environment
without an access to <code class="docutils literal notranslate"><span
class="pre">github.com</span></code> it is necessary to disable <code
class="docutils literal notranslate"><span
class="pre">git-commit-id-maven-plugin</span></code>, otherwise you will face
errors that there is no access to the git during the build process. In that
case you may use:</p>
+<div class="highlight-console notranslate"><div
class="highlight"><pre><span></span><span class="go">make release-nogit
PROFILES="-Pspark-3.4"</span>
+</pre></div>
+</div>
</section>
<section id="run-spark-shell-with-comet-enabled">
<h2>Run Spark Shell with Comet enabled<a class="headerlink"
href="#run-spark-shell-with-comet-enabled" title="Link to this
heading">¶</a></h2>
diff --git a/user-guide/tuning.html b/user-guide/tuning.html
index ec97f952..de9db92e 100644
--- a/user-guide/tuning.html
+++ b/user-guide/tuning.html
@@ -352,6 +352,9 @@ The following sections describe the different shuffle
options available in Comet
It must be set before the Spark context is created. You can enable or disable
Comet shuffle
at runtime by setting <code class="docutils literal notranslate"><span
class="pre">spark.comet.exec.shuffle.enabled</span></code> to <code
class="docutils literal notranslate"><span class="pre">true</span></code> or
<code class="docutils literal notranslate"><span
class="pre">false</span></code>.
Once it is disabled, Comet will fallback to the default Spark shuffle
manager.</p>
+<blockquote>
+<div><p><strong><em>NOTE:</em></strong> At the moment Comet Shuffle is not
compatible with Spark AQE partition coalesce. To disable set <code
class="docutils literal notranslate"><span
class="pre">spark.sql.adaptive.coalescePartitions.enabled</span></code> to
<code class="docutils literal notranslate"><span
class="pre">false</span></code>.</p>
+</div></blockquote>
<section id="shuffle-mode">
<h3>Shuffle Mode<a class="headerlink" href="#shuffle-mode" title="Link to this
heading">¶</a></h3>
<p>Comet provides three shuffle modes: Columnar Shuffle, Native Shuffle and
Auto Mode.</p>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
