This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-gluten-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new cbf43b8 Automatic Site Publish by Buildbot
cbf43b8 is described below
commit cbf43b8228bf42fa040b1ec81009ddeb700a8125
Author: buildbot <[email protected]>
AuthorDate: Thu Sep 12 08:39:46 2024 +0000
Automatic Site Publish by Buildbot
---
output/404.html | 2 +-
output/DISCLAIMER-WIP | 18 ++++++++++++++++++
output/about/index.html | 2 +-
output/archives/index.html | 2 +-
.../v1.1.1/developers/UsingGperftoolsInCH.html | 2 +-
.../v1.1.1/developers/UsingJemallocWithCH.html | 2 +-
.../v1.1.1/developers/cpp_code_style/index.html | 2 +-
.../v1.1.1/developers/docker_centos7/index.html | 2 +-
output/archives/v1.1.1/developers/docker_centos8.html | 2 +-
.../v1.1.1/developers/docker_ubuntu/index.html | 2 +-
output/archives/v1.1.1/developers/howto/index.html | 2 +-
.../archives/v1.1.1/developers/howtorelease/index.html | 2 +-
output/archives/v1.1.1/developers/index.html | 2 +-
.../v1.1.1/developers/microbenchmark/index.html | 2 +-
output/archives/v1.1.1/developers/newto/index.html | 2 +-
output/archives/v1.1.1/developers/substrait/index.html | 2 +-
.../developers/velox_function_development/index.html | 2 +-
.../v1.1.1/docs/clickhouse/getting-started/index.html | 2 +-
output/archives/v1.1.1/docs/clickhouse/index.html | 2 +-
output/archives/v1.1.1/docs/index.html | 2 +-
.../v1.1.1/docs/velox/build_parameters/index.html | 2 +-
output/archives/v1.1.1/docs/velox/gcs/index.html | 2 +-
.../v1.1.1/docs/velox/getting-started/index.html | 2 +-
output/archives/v1.1.1/docs/velox/index.html | 2 +-
output/archives/v1.1.1/docs/velox/s3/index.html | 2 +-
output/archives/v1.1.1/index.html | 2 +-
output/assets/js/search-data.json | 2 +-
output/contact/index.html | 2 +-
output/contributing/index.html | 2 +-
output/docs/configuration/index.html | 2 +-
output/docs/developers/UsingGperftoolsInCH.html | 2 +-
output/docs/developers/UsingJemallocWithCH.html | 2 +-
output/docs/developers/cpp-code-style/index.html | 2 +-
output/docs/developers/docker-centos7/index.html | 2 +-
output/docs/developers/docker-centos8/index.html | 2 +-
output/docs/developers/docker-ubuntu/index.html | 2 +-
output/docs/developers/how-to-release/index.html | 2 +-
output/docs/developers/how-to-use/index.html | 2 +-
output/docs/developers/index.html | 2 +-
output/docs/developers/microbenchmarks/index.html | 2 +-
output/docs/developers/new-to/index.html | 2 +-
output/docs/developers/substrait/index.html | 2 +-
output/docs/developers/velox-function-dev/index.html | 2 +-
output/docs/getting-started/abfs/index.html | 2 +-
output/docs/getting-started/build-guide/index.html | 2 +-
.../docs/getting-started/clickhouse-backend/index.html | 2 +-
output/docs/getting-started/gcs/index.html | 2 +-
output/docs/getting-started/index.html | 2 +-
output/docs/getting-started/localcache/index.html | 2 +-
output/docs/getting-started/s3/index.html | 2 +-
output/docs/getting-started/velox-backend/index.html | 2 +-
output/docs/index.html | 2 +-
output/docs/velox-backend/index.html | 2 +-
output/docs/velox-backend/limitations/index.html | 2 +-
output/docs/velox-backend/support/index.html | 2 +-
output/docs/velox-backend/troubleshooting/index.html | 2 +-
output/docs/velox-backend/udf/index.html | 2 +-
output/downloads/index.html | 2 +-
output/feed.xml | 2 +-
output/index.html | 2 +-
output/jekyll/update/2024/02/08/welcome-to-jekyll.html | 2 +-
output/references/index.html | 2 +-
62 files changed, 79 insertions(+), 61 deletions(-)
diff --git a/output/404.html b/output/404.html
index d6a3c02..17599c3 100644
--- a/output/404.html
+++ b/output/404.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav ul li a { background-image: none; }
</style> <script src="/assets/js/vendor/lunr.min.js"></script> <script
src="/assets/js/just-the-docs.js"></script> <meta name= [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav ul li a { background-image: none; }
</style> <script src="/assets/js/vendor/lunr.min.js"></script> <script
src="/assets/js/just-the-docs.js"></script> <meta name= [...]
diff --git a/output/DISCLAIMER-WIP b/output/DISCLAIMER-WIP
new file mode 100644
index 0000000..981f188
--- /dev/null
+++ b/output/DISCLAIMER-WIP
@@ -0,0 +1,18 @@
+Apache Gluten (Incubating) is an effort undergoing incubation at the Apache
+Software Foundation (ASF), sponsored by the Apache Incubator PMC.
+
+Incubation is required of all newly accepted projects until a further review
+indicates that the infrastructure, communications, and decision making process
+have stabilized in a manner consistent with other successful ASF projects.
+
+While incubation status is not necessarily a reflection of the completeness
+or stability of the code, it does indicate that the project has yet to be
+fully endorsed by the ASF.
+
+Some of the incubating project’s releases may not be fully compliant with ASF
policy.
+For example, releases may have incomplete or un-reviewed licensing conditions.
+What follows is a list of issues the project is currently aware of (this list
is likely to be incomplete):
+
+* Releases may have incomplete licensing conditions.
+
+If you are planning to incorporate this work into your product/project, please
be aware that you will need to conduct a thorough licensing review to determine
the overall implications of including this work. For the current status of this
project through the Apache Incubator, visit:
https://incubator.apache.org/projects/gluten.html
diff --git a/output/about/index.html b/output/about/index.html
index f8b99bc..318743a 100644
--- a/output/about/index.html
+++ b/output/about/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(8)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(8)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
diff --git a/output/archives/index.html b/output/archives/index.html
index 9f8b000..04e4c07 100644
--- a/output/archives/index.html
+++ b/output/archives/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(3)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(3)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
diff --git a/output/archives/v1.1.1/developers/UsingGperftoolsInCH.html
b/output/archives/v1.1.1/developers/UsingGperftoolsInCH.html
index ffde2b7..4e9812a 100644
--- a/output/archives/v1.1.1/developers/UsingGperftoolsInCH.html
+++ b/output/archives/v1.1.1/developers/UsingGperftoolsInCH.html
@@ -3,4 +3,4 @@ export LD_PRELOAD=$tcmalloc_path,libch.so # load the library in
the driver
--files $tcmalloc_path # upload the library to the cluster
--conf spark.executorEnv.LD_PRELOAD=./libtcmalloc_and_profiler.so,libch.so #
load the library in the executor
--conf spark.executorEnv.HEAPPROFILE=/tmp/gluten_heap_perf # set the heap
profile path, you can change to CPUPROFILE for CPU profiling
-</code></pre></div></div> <p>For thrift server on local machine, note using
<code class="language-plaintext highlighter-rouge">export
LD_PRELOAD="$tcmalloc_path libch.so" # load the library in the driver</code> to
preload dynamic libraries.</p> <h2 id="analyze-the-result"> <a
href="#analyze-the-result" class="anchor-heading"
aria-labelledby="analyze-the-result"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Analyze the
result </h2> <p>We can get [...]
+</code></pre></div></div> <p>For thrift server on local machine, note using
<code class="language-plaintext highlighter-rouge">export
LD_PRELOAD="$tcmalloc_path libch.so" # load the library in the driver</code> to
preload dynamic libraries.</p> <h2 id="analyze-the-result"> <a
href="#analyze-the-result" class="anchor-heading"
aria-labelledby="analyze-the-result"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Analyze the
result </h2> <p>We can get [...]
diff --git a/output/archives/v1.1.1/developers/UsingJemallocWithCH.html
b/output/archives/v1.1.1/developers/UsingJemallocWithCH.html
index 3b8084d..a0ad4bc 100644
--- a/output/archives/v1.1.1/developers/UsingJemallocWithCH.html
+++ b/output/archives/v1.1.1/developers/UsingJemallocWithCH.html
@@ -9,4 +9,4 @@
</code></pre></div></div> <p>For more infomation, check
https://github.com/jemalloc/jemalloc/issues/2282.</p> <h2 id="get-jeprof"> <a
href="#get-jeprof" class="anchor-heading" aria-labelledby="get-jeprof"><svg
viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-link"></use></svg></a> Get jeprof </h2> <p>Change to the
directory where you want to install jemalloc, and run the following
commands:</p> <div class="language-plaintext highlighter-rouge"><div
class="highlight"><pre clas [...]
</code></pre></div></div> <p>Then we get jeprof in the directory <code
class="language-plaintext
highlighter-rouge">$Clickhouse_SOURCE_PATH/contrib/jemalloc/bin/jeprof</code>.</p>
<h2 id="compiler-libchso"> <a href="#compiler-libchso" class="anchor-heading"
aria-labelledby="compiler-libchso"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Compiler
libch.so </h2> <p>Ensure to enable jemalloc <code class="language-plaintext
highlighter-rouge">-DENAB [...]
</code></pre></div></div> <p>You can find more options in
https://github.com/jemalloc/jemalloc/wiki/Use-Case%3A-Heap-Profiling.</p> <h2
id="analyze-the-result"> <a href="#analyze-the-result" class="anchor-heading"
aria-labelledby="analyze-the-result"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Analyze the
result </h2> <p>After you get the heap file, you can use the following command
to analyze the result: Check memory diff, so you can find whi [...]
-</code></pre></div></div> <p>You can find more usage about jeprof with <code
class="language-plaintext highlighter-rouge">jeprof --help</code>.</p> </main>
<hr> <footer> <p><a href="#top" id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten, [...]
+</code></pre></div></div> <p>You can find more usage about jeprof with <code
class="language-plaintext highlighter-rouge">jeprof --help</code>.</p> </main>
<hr> <footer> <p><a href="#top" id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten, [...]
diff --git a/output/archives/v1.1.1/developers/cpp_code_style/index.html
b/output/archives/v1.1.1/developers/cpp_code_style/index.html
index a8274d4..2e36d37 100644
--- a/output/archives/v1.1.1/developers/cpp_code_style/index.html
+++ b/output/archives/v1.1.1/developers/cpp_code_style/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
diff --git a/output/archives/v1.1.1/developers/docker_centos7/index.html
b/output/archives/v1.1.1/developers/docker_centos7/index.html
index 02e39f1..80754bb 100644
--- a/output/archives/v1.1.1/developers/docker_centos7/index.html
+++ b/output/archives/v1.1.1/developers/docker_centos7/index.html
@@ -35,4 +35,4 @@ cd gluten
# To access HDFS or S3, you need to add the parameters `--enable_hdfs=ON` and
`--enable_s3=ON`
# If you have the same error with issue-3283, you need to add the parameter
`--compile_arrow_java=ON`
./dev/buildbundle-veloxbe.sh
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/archives/v1.1.1/developers/docker_centos8.html
b/output/archives/v1.1.1/developers/docker_centos8.html
index 07e859b..3b81fd5 100644
--- a/output/archives/v1.1.1/developers/docker_centos8.html
+++ b/output/archives/v1.1.1/developers/docker_centos8.html
@@ -32,4 +32,4 @@ cd gluten
# To access HDFS or S3, you need to add the parameters `--enable_hdfs=ON` and
`--enable_s3=ON`
./dev/buildbundle-veloxbe.sh
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/archives/v1.1.1/developers/docker_ubuntu/index.html
b/output/archives/v1.1.1/developers/docker_ubuntu/index.html
index b804027..449d091 100644
--- a/output/archives/v1.1.1/developers/docker_ubuntu/index.html
+++ b/output/archives/v1.1.1/developers/docker_ubuntu/index.html
@@ -41,4 +41,4 @@ cd gluten/
# It's suggested to build using static link, enabled by `--enable_vcpkg=ON`
# For developer, it's suggested to enable Debug info, by
--build_type=RelWithDebInfo. Note RelWithDebInfo uses -o2, release uses -o3
./dev/buildbundle-veloxbe.sh --enable_vcpkg=ON --build_type=RelWithDebInfo
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/archives/v1.1.1/developers/howto/index.html
b/output/archives/v1.1.1/developers/howto/index.html
index 750797b..4482cfc 100644
--- a/output/archives/v1.1.1/developers/howto/index.html
+++ b/output/archives/v1.1.1/developers/howto/index.html
@@ -19,4 +19,4 @@ gdb gluten_home/cpp/build/releases/libgluten.so
'core-Executor task l-2000883-16
</code></pre></div></div> <ul> <li>the <code class="language-plaintext
highlighter-rouge">core-Executor task l-2000883-1671542526</code> represents
the core file name.</li> </ul> <h1 id="how-to-run-tpc-h-on-velox-backend"> <a
href="#how-to-run-tpc-h-on-velox-backend" class="anchor-heading"
aria-labelledby="how-to-run-tpc-h-on-velox-backend"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> How to run
TPC-H on Velox backend </h1> <p>Now, both Parquet [...]
</code></pre></div> </div> </li> <li>set <code class="language-plaintext
highlighter-rouge">var gluten_root</code> to correct directory. If <code
class="language-plaintext highlighter-rouge">gluten_home</code> is the
directory of <code class="language-plaintext
highlighter-rouge">/home/gluten</code>, then modify it as below <div
class="language-plaintext highlighter-rouge"><div class="highlight"><pre
class="highlight"><code> var gluten_root = "/home/gluten"
</code></pre></div> </div> <div class="language-plaintext
highlighter-rouge"><div class="highlight"><pre class="highlight"><code> -
Modify `gluten_home/backends-velox/workload/tpch/run_tpch/tpch_parquet.sh`.
-</code></pre></div> </div> </li> <li>Set <code class="language-plaintext
highlighter-rouge">GLUTEN_JAR</code> correctly. Please refer to the section of
<a
href="https://gluten.apache.org/archives/v1.1.1/docs/velox/getting-started/#build-gluten-with-velox-backend";>Build
Gluten with Velox Backend</a></li> <li>Set <code class="language-plaintext
highlighter-rouge">SPARK_HOME</code> correctly.</li> <li>Set the memory
configurations appropriately. - Execute <code class="language-plaintext hig
[...]
+</code></pre></div> </div> </li> <li>Set <code class="language-plaintext
highlighter-rouge">GLUTEN_JAR</code> correctly. Please refer to the section of
<a
href="https://gluten.apache.org/archives/v1.1.1/docs/velox/getting-started/#build-gluten-with-velox-backend";>Build
Gluten with Velox Backend</a></li> <li>Set <code class="language-plaintext
highlighter-rouge">SPARK_HOME</code> correctly.</li> <li>Set the memory
configurations appropriately. - Execute <code class="language-plaintext hig
[...]
diff --git a/output/archives/v1.1.1/developers/howtorelease/index.html
b/output/archives/v1.1.1/developers/howtorelease/index.html
index 1faae7e..9cc1e1a 100644
--- a/output/archives/v1.1.1/developers/howtorelease/index.html
+++ b/output/archives/v1.1.1/developers/howtorelease/index.html
@@ -115,4 +115,4 @@ Resources:
Thanks,
<YOUR NAME>
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/archives/v1.1.1/developers/index.html
b/output/archives/v1.1.1/developers/index.html
index 55c415e..ea88a36 100644
--- a/output/archives/v1.1.1/developers/index.html
+++ b/output/archives/v1.1.1/developers/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
diff --git a/output/archives/v1.1.1/developers/microbenchmark/index.html
b/output/archives/v1.1.1/developers/microbenchmark/index.html
index 4d4ce83..9a4feb9 100644
--- a/output/archives/v1.1.1/developers/microbenchmark/index.html
+++ b/output/archives/v1.1.1/developers/microbenchmark/index.html
@@ -126,4 +126,4 @@ done >stdout.log 2>stderr.log
Benchmark Time
CPU Iterations UserCounters...
------------------------------------------------------------------------------------------------------------------
SkipInput/iterations:1/process_time/real_time/threads:8 1317255379 ns
10061941861 ns 8 collect_batch_time=0 elapsed_time=10.7563G
shuffle_compress_time=4.19964G shuffle_spill_time=0 shuffle_split_time=0
shuffle_write_time=1.91651G
-</code></pre></div></div> <p><img src="../image/TPCH-q5-first-stage.png"
alt="TPCH-Q5-first-stage" /></p> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, [...]
+</code></pre></div></div> <p><img src="../image/TPCH-q5-first-stage.png"
alt="TPCH-Q5-first-stage" /></p> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, [...]
diff --git a/output/archives/v1.1.1/developers/newto/index.html
b/output/archives/v1.1.1/developers/newto/index.html
index 4651c43..030dd60 100644
--- a/output/archives/v1.1.1/developers/newto/index.html
+++ b/output/archives/v1.1.1/developers/newto/index.html
@@ -125,4 +125,4 @@ ps ux | <span class="nb">grep </span>TestOperator
--conf spark.memory.offHeap.size=20g \
--jars
https://github.com/oap-project/gluten/releases/download/v1.0.0/gluten-velox-bundle-spark3.2_2.12-ubuntu_20.04_x86_64-1.0.0.jar
\
--conf
spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/archives/v1.1.1/developers/substrait/index.html
b/output/archives/v1.1.1/developers/substrait/index.html
index 6858233..3bc997a 100644
--- a/output/archives/v1.1.1/developers/substrait/index.html
+++ b/output/archives/v1.1.1/developers/substrait/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
diff --git
a/output/archives/v1.1.1/developers/velox_function_development/index.html
b/output/archives/v1.1.1/developers/velox_function_development/index.html
index f7c6cae..7907c3a 100644
--- a/output/archives/v1.1.1/developers/velox_function_development/index.html
+++ b/output/archives/v1.1.1/developers/velox_function_development/index.html
@@ -8,4 +8,4 @@ struct BitwiseAndFunction {
}
};
</code></pre></div></div> <p>It is templated, as well as the <code
class="language-plaintext highlighter-rouge">call</code> function, to allow
multiple types. In the above impl., the result will be null for null input.
Please use <code class="language-plaintext
highlighter-rouge">callNullable</code> if you need different behavior for null
input, e.g., get a non-null result for null input. Also see <code
class="language-plaintext highlighter-rouge">callNullFree</code> in velox
document. I [...]
-</code></pre></div></div> <p>Functions for complex types have similar
implementations. See <code class="language-plaintext
highlighter-rouge">ArrayAverageFunction</code> in <a
href="https://github.com/facebookincubator/velox/blob/main/velox/functions/prestosql/ArrayFunctions.h";>velox/functions/prestosql/ArrayFunctions.h</a>.</p>
<h3 id="reference"> <a href="#reference" class="anchor-heading"
aria-labelledby="reference"><svg viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-lin [...]
+</code></pre></div></div> <p>Functions for complex types have similar
implementations. See <code class="language-plaintext
highlighter-rouge">ArrayAverageFunction</code> in <a
href="https://github.com/facebookincubator/velox/blob/main/velox/functions/prestosql/ArrayFunctions.h";>velox/functions/prestosql/ArrayFunctions.h</a>.</p>
<h3 id="reference"> <a href="#reference" class="anchor-heading"
aria-labelledby="reference"><svg viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-lin [...]
diff --git a/output/archives/v1.1.1/docs/clickhouse/getting-started/index.html
b/output/archives/v1.1.1/docs/clickhouse/getting-started/index.html
index af4d777..66bd8c2 100644
--- a/output/archives/v1.1.1/docs/clickhouse/getting-started/index.html
+++ b/output/archives/v1.1.1/docs/clickhouse/getting-started/index.html
@@ -352,4 +352,4 @@ spark.dynamicAllocation.enabled false
<span class="nb">mkdir</span> /opt/hadoop <span class="o">&&</span>
<span class="nb">chmod </span>777 /opt/hadoop <span class="o">&&</span>
<span class="se">\</span>
<span class="nb">echo</span> <span class="nt">-e</span> <span
class="s2">"celeborn.worker.flusher.threads 4</span><span
class="se">\n</span><span class="s2">celeborn.worker.storage.dirs
/tmp</span><span class="se">\n</span><span
class="s2">celeborn.worker.monitor.disk.enabled false"</span> <span
class="o">></span>
apache-celeborn-0.3.0-incubating-bin/conf/celeborn-defaults.conf <span
class="o">&&</span> <span class="se">\</span>
bash apache-celeborn-0.3.0-incubating-bin/sbin/start-master.sh <span
class="o">&&</span> bash
apache-celeborn-0.3.0-incubating-bin/sbin/start-worker.sh
-</code></pre></div></div> <h3 id="columnar-shuffle-mode"> <a
href="#columnar-shuffle-mode" class="anchor-heading"
aria-labelledby="columnar-shuffle-mode"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Columnar
shuffle mode </h3> <p>We have two modes of columnar shuffle</p> <ol> <li>prefer
cache</li> <li>prefer spill</li> </ol> <p>Switch through the configuration
<code class="language-plaintext
highlighter-rouge">spark.gluten.sql.columnar.backend. [...]
+</code></pre></div></div> <h3 id="columnar-shuffle-mode"> <a
href="#columnar-shuffle-mode" class="anchor-heading"
aria-labelledby="columnar-shuffle-mode"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Columnar
shuffle mode </h3> <p>We have two modes of columnar shuffle</p> <ol> <li>prefer
cache</li> <li>prefer spill</li> </ol> <p>Switch through the configuration
<code class="language-plaintext
highlighter-rouge">spark.gluten.sql.columnar.backend. [...]
diff --git a/output/archives/v1.1.1/docs/clickhouse/index.html
b/output/archives/v1.1.1/docs/clickhouse/index.html
index 0be93cb..9ad5c48 100644
--- a/output/archives/v1.1.1/docs/clickhouse/index.html
+++ b/output/archives/v1.1.1/docs/clickhouse/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
diff --git a/output/archives/v1.1.1/docs/index.html
b/output/archives/v1.1.1/docs/index.html
index d1b44a7..7607502 100644
--- a/output/archives/v1.1.1/docs/index.html
+++ b/output/archives/v1.1.1/docs/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
diff --git a/output/archives/v1.1.1/docs/velox/build_parameters/index.html
b/output/archives/v1.1.1/docs/velox/build_parameters/index.html
index 7e12cae..b623e79 100644
--- a/output/archives/v1.1.1/docs/velox/build_parameters/index.html
+++ b/output/archives/v1.1.1/docs/velox/build_parameters/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
diff --git a/output/archives/v1.1.1/docs/velox/gcs/index.html
b/output/archives/v1.1.1/docs/velox/gcs/index.html
index d48ee0e..76e0561 100644
--- a/output/archives/v1.1.1/docs/velox/gcs/index.html
+++ b/output/archives/v1.1.1/docs/velox/gcs/index.html
@@ -1,4 +1,4 @@
<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
spark.hadoop.fs.gs.auth.service.account.json.keyfile // path to the json file
with the credentials.
</code></pre></div></div> <h2 id="configuring-gcs-endpoints"> <a
href="#configuring-gcs-endpoints" class="anchor-heading"
aria-labelledby="configuring-gcs-endpoints"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Configuring GCS
endpoints </h2> <p>For cases when a GCS mock is used, an optional endpoint can
be provided:</p> <div class="language-sh highlighter-rouge"><div
class="highlight"><pre class="highlight"><code>spark.hadoop.fs.gs.storage.roo
[...]
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/archives/v1.1.1/docs/velox/getting-started/index.html
b/output/archives/v1.1.1/docs/velox/getting-started/index.html
index 03ca284..f6ff9e8 100644
--- a/output/archives/v1.1.1/docs/velox/getting-started/index.html
+++ b/output/archives/v1.1.1/docs/velox/getting-started/index.html
@@ -347,4 +347,4 @@ ashProbe: Input: 9 rows (864B, 3 batches), Output: 27 rows
(3.56KB, 3 batches),
</code></pre></div></div> <h1 id="gluten-implicits"> <a
href="#gluten-implicits" class="anchor-heading"
aria-labelledby="gluten-implicits"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Gluten
Implicits </h1> <p>Gluten provides a helper class to get the fallback summary
from a Spark Dataset.</p> <div class="language-scala highlighter-rouge"><div
class="highlight"><pre class="highlight"><code><span class="k">import</span>
<span class="nn">org.apac [...]
<span class="k">val</span> <span class="nv">df</span> <span class="k">=</span>
<span class="nv">spark</span><span class="o">.</span><span
class="py">sql</span><span class="o">(</span><span class="s">"SELECT * FROM
t"</span><span class="o">)</span>
<span class="nv">df</span><span class="o">.</span><span
class="py">fallbackSummary</span>
-</code></pre></div></div> <p>Note that, if AQE is enabled, but the query is
not materialized, then it will re-plan the query execution with disabled AQE.
It is a workaround to get the final plan, and it may cause the inconsistent
results with a materialized query. However, we have no choice.</p> </main> <hr>
<footer> <p><a href="#top" id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p cla [...]
+</code></pre></div></div> <p>Note that, if AQE is enabled, but the query is
not materialized, then it will re-plan the query execution with disabled AQE.
It is a workaround to get the final plan, and it may cause the inconsistent
results with a materialized query. However, we have no choice.</p> </main> <hr>
<footer> <p><a href="#top" id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p cla [...]
diff --git a/output/archives/v1.1.1/docs/velox/index.html
b/output/archives/v1.1.1/docs/velox/index.html
index fa55fe2..c21623f 100644
--- a/output/archives/v1.1.1/docs/velox/index.html
+++ b/output/archives/v1.1.1/docs/velox/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li > a, .sit [...]
diff --git a/output/archives/v1.1.1/docs/velox/s3/index.html
b/output/archives/v1.1.1/docs/velox/s3/index.html
index db3724b..4a1213f 100644
--- a/output/archives/v1.1.1/docs/velox/s3/index.html
+++ b/output/archives/v1.1.1/docs/velox/s3/index.html
@@ -15,4 +15,4 @@ spark.gluten.sql.columnar.backend.velox.ssdCacheSize //
the total size of t
spark.gluten.sql.columnar.backend.velox.ssdCacheShards // the shards of the
SSD cache, default is 1.
spark.gluten.sql.columnar.backend.velox.ssdCacheIOThreads // the IO threads
for cache promoting, default is 1. Velox will try to do "read-ahead" if this
value is bigger than 1
spark.gluten.sql.columnar.backend.velox.ssdODirect // enable or disable
O_DIRECT on cache write, default false.
-</code></pre></div></div> <p>It’s recommended to mount SSDs to the cache path
to get the best performance of local caching. On the start up of Spark context,
the cache files will be allocated under
“spark.gluten.sql.columnar.backend.velox.cachePath”, with UUID based suffix,
e.g. “/tmp/cache.13e8ab65-3af4-46ac-8d28-ff99b2a9ec9b0”. Gluten is not able to
reuse older caches for now, and the old cache files are left there after Spark
context shutdown.</p> </main> <hr> <footer> <p><a href="#to [...]
+</code></pre></div></div> <p>It’s recommended to mount SSDs to the cache path
to get the best performance of local caching. On the start up of Spark context,
the cache files will be allocated under
“spark.gluten.sql.columnar.backend.velox.cachePath”, with UUID based suffix,
e.g. “/tmp/cache.13e8ab65-3af4-46ac-8d28-ff99b2a9ec9b0”. Gluten is not able to
reuse older caches for now, and the old cache files are left there after Spark
context shutdown.</p> </main> <hr> <footer> <p><a href="#to [...]
diff --git a/output/archives/v1.1.1/index.html
b/output/archives/v1.1.1/index.html
index bd4ea93..71450cb 100644
--- a/output/archives/v1.1.1/index.html
+++ b/output/archives/v1.1.1/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(1)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(1)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
diff --git a/output/assets/js/search-data.json
b/output/assets/js/search-data.json
index 1373199..690d779 100644
--- a/output/assets/js/search-data.json
+++ b/output/assets/js/search-data.json
@@ -2157,7 +2157,7 @@
},"308": {
"doc": "Home",
"title": "Gluten + Velox backend Performance",
- "content": "The below test environment: single node with 3TB data on
Intel® Xeon® Platinum 8592+; Spark-3.3.1 for both baseline and Gluten. The
TPCH-like result (tested in Mar. 2024) shows an overall speedup of 3.34x and up
to 23.45x speedup in a single query with Gluten + Velox backend used. The
TPCDS-like result (tested in Mar. 2024) shows an overall speedup of 3.02x and
up to 13.75x speedup in a single query with Gluten + Velox backend used.
Notices & Disclaimers . Performance [...]
+ "content": "The below test environment: single node with 3TB data on
Intel® Xeon® Platinum 8592+; Spark-3.3.1 for both baseline and Gluten. The
TPCH-like result (tested in Mar. 2024) shows an overall speedup of 3.34x and up
to 23.45x speedup in a single query with Gluten + Velox backend used. The
TPCDS-like result (tested in Mar. 2024) shows an overall speedup of 3.02x and
up to 13.75x speedup in a single query with Gluten + Velox backend used.
Notices & Disclaimers . Performance [...]
"url": "/#gluten--velox-backend-performance",
"relUrl": "/#gluten--velox-backend-performance"
diff --git a/output/contact/index.html b/output/contact/index.html
index fde273b..4ac3145 100644
--- a/output/contact/index.html
+++ b/output/contact/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(7)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(7)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
diff --git a/output/contributing/index.html b/output/contributing/index.html
index db5bc8d..3c9d0f5 100644
--- a/output/contributing/index.html
+++ b/output/contributing/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(6)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(6)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
diff --git a/output/docs/configuration/index.html
b/output/docs/configuration/index.html
index 402b9c0..626d5ff 100644
--- a/output/docs/configuration/index.html
+++ b/output/docs/configuration/index.html
@@ -1,4 +1,4 @@
<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(2)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
<span class="nv">sparkContext</span><span class="o">.</span><span
class="py">setLocalProperty</span><span class="o">(</span><span
class="n">key</span><span class="o">,</span> <span class="n">value</span><span
class="o">)</span>
<span class="nv">spark</span><span class="o">.</span><span
class="py">sql</span><span class="o">(</span><span class="s">"select * from
demo_tables"</span><span class="o">).</span><span class="py">show</span><span
class="o">()</span>
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/docs/developers/UsingGperftoolsInCH.html
b/output/docs/developers/UsingGperftoolsInCH.html
index c586c44..aa43b56 100644
--- a/output/docs/developers/UsingGperftoolsInCH.html
+++ b/output/docs/developers/UsingGperftoolsInCH.html
@@ -3,4 +3,4 @@ export LD_PRELOAD=$tcmalloc_path,libch.so # load the library in
the driver
--files $tcmalloc_path # upload the library to the cluster
--conf spark.executorEnv.LD_PRELOAD=./libtcmalloc_and_profiler.so,libch.so #
load the library in the executor
--conf spark.executorEnv.HEAPPROFILE=/tmp/gluten_heap_perf # set the heap
profile path, you can change to CPUPROFILE for CPU profiling
-</code></pre></div></div> <p>For thrift server on local machine, note using
<code class="language-plaintext highlighter-rouge">export
LD_PRELOAD="$tcmalloc_path libch.so" # load the library in the driver</code> to
preload dynamic libraries.</p> <h2 id="analyze-the-result"> <a
href="#analyze-the-result" class="anchor-heading"
aria-labelledby="analyze-the-result"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Analyze the
result </h2> <p>We can get [...]
+</code></pre></div></div> <p>For thrift server on local machine, note using
<code class="language-plaintext highlighter-rouge">export
LD_PRELOAD="$tcmalloc_path libch.so" # load the library in the driver</code> to
preload dynamic libraries.</p> <h2 id="analyze-the-result"> <a
href="#analyze-the-result" class="anchor-heading"
aria-labelledby="analyze-the-result"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Analyze the
result </h2> <p>We can get [...]
diff --git a/output/docs/developers/UsingJemallocWithCH.html
b/output/docs/developers/UsingJemallocWithCH.html
index ece4113..8f79e05 100644
--- a/output/docs/developers/UsingJemallocWithCH.html
+++ b/output/docs/developers/UsingJemallocWithCH.html
@@ -9,4 +9,4 @@
</code></pre></div></div> <p>For more infomation, check
https://github.com/jemalloc/jemalloc/issues/2282.</p> <h2 id="get-jeprof"> <a
href="#get-jeprof" class="anchor-heading" aria-labelledby="get-jeprof"><svg
viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-link"></use></svg></a> Get jeprof </h2> <p>Change to the
directory where you want to install jemalloc, and run the following
commands:</p> <div class="language-plaintext highlighter-rouge"><div
class="highlight"><pre clas [...]
</code></pre></div></div> <p>Then we get jeprof in the directory <code
class="language-plaintext
highlighter-rouge">$Clickhouse_SOURCE_PATH/contrib/jemalloc/bin/jeprof</code>.</p>
<h2 id="compiler-libchso"> <a href="#compiler-libchso" class="anchor-heading"
aria-labelledby="compiler-libchso"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Compiler
libch.so </h2> <p>Ensure to enable jemalloc <code class="language-plaintext
highlighter-rouge">-DENAB [...]
</code></pre></div></div> <p>You can find more options in
https://github.com/jemalloc/jemalloc/wiki/Use-Case%3A-Heap-Profiling.</p> <h2
id="analyze-the-result"> <a href="#analyze-the-result" class="anchor-heading"
aria-labelledby="analyze-the-result"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Analyze the
result </h2> <p>After you get the heap file, you can use the following command
to analyze the result: Check memory diff, so you can find whi [...]
-</code></pre></div></div> <p>You can find more usage about jeprof with <code
class="language-plaintext highlighter-rouge">jeprof --help</code>.</p> </main>
<hr> <footer> <p><a href="#top" id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten, [...]
+</code></pre></div></div> <p>You can find more usage about jeprof with <code
class="language-plaintext highlighter-rouge">jeprof --help</code>.</p> </main>
<hr> <footer> <p><a href="#top" id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten, [...]
diff --git a/output/docs/developers/cpp-code-style/index.html
b/output/docs/developers/cpp-code-style/index.html
index 50b9a21..55cd68f 100644
--- a/output/docs/developers/cpp-code-style/index.html
+++ b/output/docs/developers/cpp-code-style/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
diff --git a/output/docs/developers/docker-centos7/index.html
b/output/docs/developers/docker-centos7/index.html
index 8e1e9fa..883c66e 100644
--- a/output/docs/developers/docker-centos7/index.html
+++ b/output/docs/developers/docker-centos7/index.html
@@ -35,4 +35,4 @@ git clone https://github.com/oap-project/gluten.git
<span class="c"># To access HDFS or S3, you need to add the parameters
`--enable_hdfs=ON` and `--enable_s3=ON`</span>
<span class="c"># If you have the same error with issue-3283, you need to add
the parameter `--compile_arrow_java=ON`</span>
./dev/buildbundle-veloxbe.sh
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/docs/developers/docker-centos8/index.html
b/output/docs/developers/docker-centos8/index.html
index 8463453..8eb9b93 100644
--- a/output/docs/developers/docker-centos8/index.html
+++ b/output/docs/developers/docker-centos8/index.html
@@ -32,4 +32,4 @@ git clone https://github.com/oap-project/gluten.git
<span class="c"># To access HDFS or S3, you need to add the parameters
`--enable_hdfs=ON` and `--enable_s3=ON`</span>
./dev/buildbundle-veloxbe.sh
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/docs/developers/docker-ubuntu/index.html
b/output/docs/developers/docker-ubuntu/index.html
index 2a2d03b..493740b 100644
--- a/output/docs/developers/docker-ubuntu/index.html
+++ b/output/docs/developers/docker-ubuntu/index.html
@@ -41,4 +41,4 @@ git clone https://github.com/oap-project/gluten.git
<span class="c"># It's suggested to build using static link, enabled by
`--enable_vcpkg=ON`</span>
<span class="c"># For developer, it's suggested to enable Debug info, by
--build_type=RelWithDebInfo. Note RelWithDebInfo uses -o2, release uses
-o3</span>
./dev/buildbundle-veloxbe.sh <span class="nt">--enable_vcpkg</span><span
class="o">=</span>ON <span class="nt">--build_type</span><span
class="o">=</span>RelWithDebInfo
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/docs/developers/how-to-release/index.html
b/output/docs/developers/how-to-release/index.html
index db50968..3f7dfb8 100644
--- a/output/docs/developers/how-to-release/index.html
+++ b/output/docs/developers/how-to-release/index.html
@@ -115,4 +115,4 @@ Resources:
Thanks,
<YOUR NAME>
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/docs/developers/how-to-use/index.html
b/output/docs/developers/how-to-use/index.html
index a95f627..1c994e3 100644
--- a/output/docs/developers/how-to-use/index.html
+++ b/output/docs/developers/how-to-use/index.html
@@ -19,4 +19,4 @@ gdb gluten_home/cpp/build/releases/libgluten.so <span
class="s1">'core-Executor
</code></pre></div></div> <ul> <li>the <code class="language-plaintext
highlighter-rouge">core-Executor task l-2000883-1671542526</code> represents
the core file name.</li> </ul> <h1 id="how-to-run-tpc-h-on-velox-backend"> <a
href="#how-to-run-tpc-h-on-velox-backend" class="anchor-heading"
aria-labelledby="how-to-run-tpc-h-on-velox-backend"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> How to run
TPC-H on Velox backend </h1> <p>Now, both Parquet [...]
</code></pre></div> </div> </li> <li>set <code class="language-plaintext
highlighter-rouge">var gluten_root</code> to correct directory. If <code
class="language-plaintext highlighter-rouge">gluten_home</code> is the
directory of <code class="language-plaintext
highlighter-rouge">/home/gluten</code>, then modify it as below <div
class="language-scala highlighter-rouge"><div class="highlight"><pre
class="highlight"><code> <span class="k">var</span> <span
class="n">gluten_root</span> <span [...]
</code></pre></div> </div> <div class="language-plaintext
highlighter-rouge"><div class="highlight"><pre class="highlight"><code> -
Modify `gluten_home/backends-velox/workload/tpch/run_tpch/tpch_parquet.sh`.
-</code></pre></div> </div> </li> <li>Set <code class="language-plaintext
highlighter-rouge">GLUTEN_JAR</code> correctly. Please refer to the section of
<a
href="http://gluten.apache.org/docs/getting-started/velox-backend/#build-gluten-with-velox-backend";>Build
Gluten with Velox Backend</a></li> <li>Set <code class="language-plaintext
highlighter-rouge">SPARK_HOME</code> correctly.</li> <li>Set the memory
configurations appropriately. - Execute <code class="language-plaintext
highlighter- [...]
+</code></pre></div> </div> </li> <li>Set <code class="language-plaintext
highlighter-rouge">GLUTEN_JAR</code> correctly. Please refer to the section of
<a
href="http://gluten.apache.org/docs/getting-started/velox-backend/#build-gluten-with-velox-backend";>Build
Gluten with Velox Backend</a></li> <li>Set <code class="language-plaintext
highlighter-rouge">SPARK_HOME</code> correctly.</li> <li>Set the memory
configurations appropriately. - Execute <code class="language-plaintext
highlighter- [...]
diff --git a/output/docs/developers/index.html
b/output/docs/developers/index.html
index 0d27f69..dea83a0 100644
--- a/output/docs/developers/index.html
+++ b/output/docs/developers/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(3)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(3)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
diff --git a/output/docs/developers/microbenchmarks/index.html
b/output/docs/developers/microbenchmarks/index.html
index 905cfae..6988f82 100644
--- a/output/docs/developers/microbenchmarks/index.html
+++ b/output/docs/developers/microbenchmarks/index.html
@@ -126,4 +126,4 @@
InputFromBatchVector/iterations:1/process_time/real_time/threads:1 41304520 ns
Benchmark Time
CPU Iterations UserCounters...
<span
class="nt">------------------------------------------------------------------------------------------------------------------</span>
SkipInput/iterations:1/process_time/real_time/threads:8 1317255379 ns
10061941861 ns 8 <span class="nv">collect_batch_time</span><span
class="o">=</span>0 <span class="nv">elapsed_time</span><span
class="o">=</span>10.7563G <span class="nv">shuffle_compress_time</span><span
class="o">=</span>4.19964G <span class="nv">shuffle_spill_time</span><span
class="o">=</span>0 <span class="nv">shuffle_split_time</span><span
class="o">=</span>0 <span class="nv">shuffle_write_time</span [...]
-</code></pre></div></div> <p><img src="/assets/images/TPCH-q5-first-stage.png"
alt="TPCH-Q5-first-stage" /></p> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather [...]
+</code></pre></div></div> <p><img src="/assets/images/TPCH-q5-first-stage.png"
alt="TPCH-Q5-first-stage" /></p> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather [...]
diff --git a/output/docs/developers/new-to/index.html
b/output/docs/developers/new-to/index.html
index f58a36d..ce8efe3 100644
--- a/output/docs/developers/new-to/index.html
+++ b/output/docs/developers/new-to/index.html
@@ -125,4 +125,4 @@ ps ux | <span class="nb">grep </span>TestOperator
<span class="nt">--conf</span> spark.memory.offHeap.size<span
class="o">=</span>20g <span class="se">\</span>
<span class="nt">--jars</span>
https://github.com/oap-project/gluten/releases/download/v1.0.0/gluten-velox-bundle-spark3.2_2.12-ubuntu_20.04_x86_64-1.0.0.jar
<span class="se">\</span>
<span class="nt">--conf</span> spark.shuffle.manager<span
class="o">=</span>org.apache.spark.shuffle.sort.ColumnarShuffleManager
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/docs/developers/substrait/index.html
b/output/docs/developers/substrait/index.html
index bb5ae4c..c060103 100644
--- a/output/docs/developers/substrait/index.html
+++ b/output/docs/developers/substrait/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
diff --git a/output/docs/developers/velox-function-dev/index.html
b/output/docs/developers/velox-function-dev/index.html
index d4be324..4858bf5 100644
--- a/output/docs/developers/velox-function-dev/index.html
+++ b/output/docs/developers/velox-function-dev/index.html
@@ -8,4 +8,4 @@ struct BitwiseAndFunction {
}
};
</code></pre></div></div> <p>It is templated, as well as the <code
class="language-plaintext highlighter-rouge">call</code> function, to allow
multiple types. In the above impl., the result will be null for null input.
Please use <code class="language-plaintext
highlighter-rouge">callNullable</code> if you need different behavior for null
input, e.g., get a non-null result for null input. Also see <code
class="language-plaintext highlighter-rouge">callNullFree</code> in velox
document. I [...]
-</code></pre></div></div> <p>Functions for complex types have similar
implementations. See <code class="language-plaintext
highlighter-rouge">ArrayAverageFunction</code> in <a
href="https://github.com/facebookincubator/velox/blob/main/velox/functions/prestosql/ArrayFunctions.h";>velox/functions/prestosql/ArrayFunctions.h</a>.</p>
<h3 id="reference"> <a href="#reference" class="anchor-heading"
aria-labelledby="reference"><svg viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-lin [...]
+</code></pre></div></div> <p>Functions for complex types have similar
implementations. See <code class="language-plaintext
highlighter-rouge">ArrayAverageFunction</code> in <a
href="https://github.com/facebookincubator/velox/blob/main/velox/functions/prestosql/ArrayFunctions.h";>velox/functions/prestosql/ArrayFunctions.h</a>.</p>
<h3 id="reference"> <a href="#reference" class="anchor-heading"
aria-labelledby="reference"><svg viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-lin [...]
diff --git a/output/docs/getting-started/abfs/index.html
b/output/docs/getting-started/abfs/index.html
index b5c31f7..e48dcdd 100644
--- a/output/docs/getting-started/abfs/index.html
+++ b/output/docs/getting-started/abfs/index.html
@@ -1,2 +1,2 @@
<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
-</code></pre></div></div> <h3
id="other-authentatication-methods-are-not-yet-supported"> <a
href="#other-authentatication-methods-are-not-yet-supported"
class="anchor-heading"
aria-labelledby="other-authentatication-methods-are-not-yet-supported"><svg
viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-link"></use></svg></a> Other authentatication methods are not
yet supported. </h3> <h1 id="local-caching-support"> <a
href="#local-caching-support" class="anchor-heading" aria-lab [...]
+</code></pre></div></div> <h3
id="other-authentatication-methods-are-not-yet-supported"> <a
href="#other-authentatication-methods-are-not-yet-supported"
class="anchor-heading"
aria-labelledby="other-authentatication-methods-are-not-yet-supported"><svg
viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-link"></use></svg></a> Other authentatication methods are not
yet supported. </h3> <h1 id="local-caching-support"> <a
href="#local-caching-support" class="anchor-heading" aria-lab [...]
diff --git a/output/docs/getting-started/build-guide/index.html
b/output/docs/getting-started/build-guide/index.html
index b979c89..8b04ff4 100644
--- a/output/docs/getting-started/build-guide/index.html
+++ b/output/docs/getting-started/build-guide/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
diff --git a/output/docs/getting-started/clickhouse-backend/index.html
b/output/docs/getting-started/clickhouse-backend/index.html
index 0b5d264..9b66904 100644
--- a/output/docs/getting-started/clickhouse-backend/index.html
+++ b/output/docs/getting-started/clickhouse-backend/index.html
@@ -345,4 +345,4 @@ spark.celeborn.storage.hdfs.dir
hdfs://<namenode>/celeborn
<span class="c"># If you want to use dynamic resource allocation,</span>
<span class="c"># please refer to this URL
(https://github.com/apache/celeborn/tree/main/assets/spark-patch) to apply the
patch into your own Spark.</span>
spark.dynamicAllocation.enabled <span class="nb">false</span>
-</code></pre></div></div> <h3 id="columnar-shuffle-mode"> <a
href="#columnar-shuffle-mode" class="anchor-heading"
aria-labelledby="columnar-shuffle-mode"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Columnar
shuffle mode </h3> <p>We have two modes of columnar shuffle</p> <ol> <li>prefer
cache</li> <li>prefer spill</li> </ol> <p>Switch through the configuration
<code class="language-plaintext
highlighter-rouge">spark.gluten.sql.columnar.backend. [...]
+</code></pre></div></div> <h3 id="columnar-shuffle-mode"> <a
href="#columnar-shuffle-mode" class="anchor-heading"
aria-labelledby="columnar-shuffle-mode"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Columnar
shuffle mode </h3> <p>We have two modes of columnar shuffle</p> <ol> <li>prefer
cache</li> <li>prefer spill</li> </ol> <p>Switch through the configuration
<code class="language-plaintext
highlighter-rouge">spark.gluten.sql.columnar.backend. [...]
diff --git a/output/docs/getting-started/gcs/index.html
b/output/docs/getting-started/gcs/index.html
index 1538a5e..8cfe81a 100644
--- a/output/docs/getting-started/gcs/index.html
+++ b/output/docs/getting-started/gcs/index.html
@@ -3,4 +3,4 @@ spark.hadoop.fs.gs.auth.service.account.json.keyfile // path to
the json file wi
</code></pre></div></div> <h2 id="configuring-gcs-endpoints"> <a
href="#configuring-gcs-endpoints" class="anchor-heading"
aria-labelledby="configuring-gcs-endpoints"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Configuring GCS
endpoints </h2> <p>For cases when a GCS mock is used, an optional endpoint can
be provided:</p> <div class="language-shell highlighter-rouge"><div
class="highlight"><pre class="highlight"><code>spark.hadoop.fs.gs.storage. [...]
</code></pre></div></div> <h2 id="configuring-gcs-max-retry-count"> <a
href="#configuring-gcs-max-retry-count" class="anchor-heading"
aria-labelledby="configuring-gcs-max-retry-count"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Configuring GCS
max retry count </h2> <p>For cases when a transient server error is detected,
GCS can be configured to keep retrying until a number of transient error is
detected.</p> <div class="language-shell highligh [...]
</code></pre></div></div> <h2 id="configuring-gcs-max-retry-time"> <a
href="#configuring-gcs-max-retry-time" class="anchor-heading"
aria-labelledby="configuring-gcs-max-retry-time"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Configuring GCS
max retry time </h2> <p>For cases when a transient server error is detected,
GCS can be configured to keep retrying until the retry loop exceeds a
prescribed duration.</p> <div class="language-shell highlig [...]
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/docs/getting-started/index.html
b/output/docs/getting-started/index.html
index eaa2f30..3ffd43e 100644
--- a/output/docs/getting-started/index.html
+++ b/output/docs/getting-started/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(1)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(1)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
diff --git a/output/docs/getting-started/localcache/index.html
b/output/docs/getting-started/localcache/index.html
index ba76450..8123161 100644
--- a/output/docs/getting-started/localcache/index.html
+++ b/output/docs/getting-started/localcache/index.html
@@ -5,4 +5,4 @@ spark.gluten.sql.columnar.backend.velox.ssdCacheSize //
the total size of t
spark.gluten.sql.columnar.backend.velox.ssdCacheShards // the shards of the
SSD cache, default is 1.
spark.gluten.sql.columnar.backend.velox.ssdCacheIOThreads // the IO threads
<span class="k">for </span>cache promoting, default is 1. Velox will try to
<span class="k">do</span> <span class="s2">"read-ahead"</span> <span
class="k">if </span>this value is bigger than 1
spark.gluten.sql.columnar.backend.velox.ssdODirect // <span
class="nb">enable </span>or disable O_DIRECT on cache write, default false.
-</code></pre></div></div> <p>It’s recommended to mount SSDs to the cache path
to get the best performance of local caching. Cache files will be written to
“spark.gluten.sql.columnar.backend.velox.cachePath”, with UUID based suffix,
e.g. “/tmp/cache.13e8ab65-3af4-46ac-8d28-ff99b2a9ec9b0”. Gluten cannot reuse
older caches for now, and the old cache files are left after Spark context
shutdown.</p> </main> <hr> <footer> <p><a href="#top" id="back-to-top">Back to
top</a></p> <a href="https:// [...]
+</code></pre></div></div> <p>It’s recommended to mount SSDs to the cache path
to get the best performance of local caching. Cache files will be written to
“spark.gluten.sql.columnar.backend.velox.cachePath”, with UUID based suffix,
e.g. “/tmp/cache.13e8ab65-3af4-46ac-8d28-ff99b2a9ec9b0”. Gluten cannot reuse
older caches for now, and the old cache files are left after Spark context
shutdown.</p> </main> <hr> <footer> <p><a href="#top" id="back-to-top">Back to
top</a></p> <a href="https:// [...]
diff --git a/output/docs/getting-started/s3/index.html
b/output/docs/getting-started/s3/index.html
index 8fcd97d..e34eb19 100644
--- a/output/docs/getting-started/s3/index.html
+++ b/output/docs/getting-started/s3/index.html
@@ -8,4 +8,4 @@ spark.hadoop.fs.s3a.connection.ssl.enabled <span
class="nb">true
</code></pre></div></div> <h2 id="configuring-s3-instance-credentials"> <a
href="#configuring-s3-instance-credentials" class="anchor-heading"
aria-labelledby="configuring-s3-instance-credentials"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Configuring S3
instance credentials </h2> <p>S3 also provides other methods for accessing, you
can also use instance credentials by setting the following config</p> <div
class="language-plaintext highlighter [...]
</code></pre></div></div> <p>Note that in this case,
“spark.hadoop.fs.s3a.endpoint” won’t take affect as Gluten will use the
endpoint set during instance creation.</p> <h2 id="configuring-s3-iam-roles">
<a href="#configuring-s3-iam-roles" class="anchor-heading"
aria-labelledby="configuring-s3-iam-roles"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Configuring S3
IAM roles </h2> <p>You can also use iam role credentials by setting the
following c [...]
spark.hadoop.fs.s3a.iam.role.session.name xxxx
-</code></pre></div></div> <p>Note that <code class="language-plaintext
highlighter-rouge">spark.hadoop.fs.s3a.iam.role.session.name</code> is
optional.</p> <h2 id="other-authentatication-methods-are-not-supported-yet"> <a
href="#other-authentatication-methods-are-not-supported-yet"
class="anchor-heading"
aria-labelledby="other-authentatication-methods-are-not-supported-yet"><svg
viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-link"></use></svg></a> Other authentatication met [...]
+</code></pre></div></div> <p>Note that <code class="language-plaintext
highlighter-rouge">spark.hadoop.fs.s3a.iam.role.session.name</code> is
optional.</p> <h2 id="other-authentatication-methods-are-not-supported-yet"> <a
href="#other-authentatication-methods-are-not-supported-yet"
class="anchor-heading"
aria-labelledby="other-authentatication-methods-are-not-supported-yet"><svg
viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-link"></use></svg></a> Other authentatication met [...]
diff --git a/output/docs/getting-started/velox-backend/index.html
b/output/docs/getting-started/velox-backend/index.html
index d988f89..979f9a4 100644
--- a/output/docs/getting-started/velox-backend/index.html
+++ b/output/docs/getting-started/velox-backend/index.html
@@ -291,4 +291,4 @@ ashProbe: Input: 9 rows (864B, 3 batches), Output: 27 rows
(3.56KB, 3 batches),
</code></pre></div></div> <h1 id="gluten-implicits"> <a
href="#gluten-implicits" class="anchor-heading"
aria-labelledby="gluten-implicits"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> Gluten
Implicits </h1> <p>Gluten provides a helper class to get the fallback summary
from a Spark Dataset.</p> <div class="language-plaintext
highlighter-rouge"><div class="highlight"><pre class="highlight"><code>import
org.apache.spark.sql.execution.GlutenImplicits._
val df = spark.sql("SELECT * FROM t")
df.fallbackSummary
-</code></pre></div></div> <p>Note that, if AQE is enabled, but the query is
not materialized, then it will re-plan the query execution with disabled AQE.
It is a workaround to get the final plan, and it may cause the inconsistent
results with a materialized query. However, we have no choice.</p> </main> <hr>
<footer> <p><a href="#top" id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p cla [...]
+</code></pre></div></div> <p>Note that, if AQE is enabled, but the query is
not materialized, then it will re-plan the query execution with disabled AQE.
It is a workaround to get the final plan, and it may cause the inconsistent
results with a materialized query. However, we have no choice.</p> </main> <hr>
<footer> <p><a href="#top" id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p cla [...]
diff --git a/output/docs/index.html b/output/docs/index.html
index 0565b97..2c59792 100644
--- a/output/docs/index.html
+++ b/output/docs/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(2)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(2)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
diff --git a/output/docs/velox-backend/index.html
b/output/docs/velox-backend/index.html
index 6f1a72e..78ba3f1 100644
--- a/output/docs/velox-backend/index.html
+++ b/output/docs/velox-backend/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(4)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li:not(:nth-child(4)) > a,
.site-nav > ul.nav-list:first-child > li > ul > li [...]
diff --git a/output/docs/velox-backend/limitations/index.html
b/output/docs/velox-backend/limitations/index.html
index 75bc378..becf8d2 100644
--- a/output/docs/velox-backend/limitations/index.html
+++ b/output/docs/velox-backend/limitations/index.html
@@ -21,4 +21,4 @@
<span class="o">.</span><span class="py">write</span>
<span class="o">.</span><span class="py">format</span><span
class="o">(</span><span class="s">"parquet"</span><span class="o">)</span>
<span class="o">.</span><span class="py">saveAsTable</span><span
class="o">(</span><span class="s">"velox_ctas"</span><span class="o">)</span>
-</code></pre></div></div> <h4 id="hivefileformat-write"> <a
href="#hivefileformat-write" class="anchor-heading"
aria-labelledby="hivefileformat-write"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> HiveFileFormat
write </h4> <p>Gluten supports writes of HiveFileFormat when the output file
type is of type <code class="language-plaintext
highlighter-rouge">parquet</code> only</p> <h4 id="nan-support"> <a
href="#nan-support" class="anchor-heading" a [...]
+</code></pre></div></div> <h4 id="hivefileformat-write"> <a
href="#hivefileformat-write" class="anchor-heading"
aria-labelledby="hivefileformat-write"><svg viewBox="0 0 16 16"
aria-hidden="true"><use xlink:href="#svg-link"></use></svg></a> HiveFileFormat
write </h4> <p>Gluten supports writes of HiveFileFormat when the output file
type is of type <code class="language-plaintext
highlighter-rouge">parquet</code> only</p> <h4 id="nan-support"> <a
href="#nan-support" class="anchor-heading" a [...]
diff --git a/output/docs/velox-backend/support/index.html
b/output/docs/velox-backend/support/index.html
index 5a2e441..c252d02 100644
--- a/output/docs/velox-backend/support/index.html
+++ b/output/docs/velox-backend/support/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child > li > a,
.site-nav > ul.nav-list:first-child > li > ul > li > a, .site-nav >
ul.nav-list:first-child > li > ul > li > ul > li:not(:nth- [...]
diff --git a/output/docs/velox-backend/troubleshooting/index.html
b/output/docs/velox-backend/troubleshooting/index.html
index ffbaf89..91d3ea9 100644
--- a/output/docs/velox-backend/troubleshooting/index.html
+++ b/output/docs/velox-backend/troubleshooting/index.html
@@ -43,4 +43,4 @@
spark.executor.extraClassPath={absolute_path}/gluten-<spark-version>-<g
/usr/local/jdk1.8.0_381/jre/lib/amd64/server/libjvm.so(JVM_LoadLibrary+0xa1)[0x7f38c205e0c1]
/usr/local/jdk1.8.0_381/jre/lib/amd64/libjava.so(Java_java_lang_ClassLoader_00024NativeLibrary_load+0x1ac)
...
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/docs/velox-backend/udf/index.html
b/output/docs/velox-backend/udf/index.html
index 4339a1b..1720e68 100644
--- a/output/docs/velox-backend/udf/index.html
+++ b/output/docs/velox-backend/udf/index.html
@@ -84,4 +84,4 @@ VeloxColumnarToRowExec
+- ^(2) InputAdapter
+- ^(2) ColumnarArrowEvalPython [pandas_plus_one(quantity#2L)#40L],
[pythonUDF0#45L], 200
+- ^(1) NativeFileScan orc [quantity#2L] Batched: true,
DataFilters: [], Format: ORC, Location: InMemoryFileIndex(1 paths)[file:/***],
PartitionFilters: [], PushedFilters: [], ReadSchema:
struct<quantity:bigint>
-</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
+</code></pre></div></div> </main> <hr> <footer> <p><a href="#top"
id="back-to-top">Back to top</a></p> <a
href="https://incubator.apache.org/";><img
src="/assets/images/apache-incubator.svg" style="width:300px"></a> <p
class="text-small text-grey-dk-100 mb-0">Copyright © 2024 The Apache Software
Foundation, Licensed under the Apache License, Version 2.0. Apache Gluten,
Gluten, Apache, the Apache feather logo, and the Apache Gluten project logo are
either registered trademarks or trademark [...]
diff --git a/output/downloads/index.html b/output/downloads/index.html
index 8781ee5..62081bd 100644
--- a/output/downloads/index.html
+++ b/output/downloads/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(4)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(4)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
diff --git a/output/feed.xml b/output/feed.xml
index c5436cd..9f5e90a 100644
--- a/output/feed.xml
+++ b/output/feed.xml
@@ -1,4 +1,4 @@
-<?xml version="1.0" encoding="utf-8"?><feed
xmlns="http://www.w3.org/2005/Atom"; ><generator uri="https://jekyllrb.com/";
version="3.9.3">Jekyll</generator><link
href="https://gluten.apache.org/feed.xml"; rel="self"
type="application/atom+xml" /><link href="https://gluten.apache.org/";
rel="alternate" type="text/html"
/><updated>2024-09-12T07:44:01+00:00</updated><id>https://gluten.apache.org/feed.xml</id><title
type="html">Apache Gluten incubating</title><subtitle>Gluten is a middle layer
r [...]
+<?xml version="1.0" encoding="utf-8"?><feed
xmlns="http://www.w3.org/2005/Atom"; ><generator uri="https://jekyllrb.com/";
version="3.9.3">Jekyll</generator><link
href="https://gluten.apache.org/feed.xml"; rel="self"
type="application/atom+xml" /><link href="https://gluten.apache.org/";
rel="alternate" type="text/html"
/><updated>2024-09-12T08:39:36+00:00</updated><id>https://gluten.apache.org/feed.xml</id><title
type="html">Apache Gluten incubating</title><subtitle>Gluten is a middle layer
r [...]
<p>Jekyll requires blog post files to be named according to the
following format:</p>
diff --git a/output/index.html b/output/index.html
index 84fd08b..5a7bcd9 100644
--- a/output/index.html
+++ b/output/index.html
@@ -15,4 +15,4 @@ spark-shell \
--conf spark.executor.extraClassPath=${gluten_jar} \
--conf
spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager
...
-</code></pre></div></div> <h2
id="321-build-and-install-gluten-with-velox-backend"> <a
href="#321-build-and-install-gluten-with-velox-backend" class="anchor-heading"
aria-labelledby="321-build-and-install-gluten-with-velox-backend"><svg
viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-link"></use></svg></a> 3.2.1 Build and install Gluten with
Velox backend </h2> <p>If you want to use Gluten <strong>Velox</strong>
backend, see <a href="https://gluten.apache.org/docs/getting-st [...]
+</code></pre></div></div> <h2
id="321-build-and-install-gluten-with-velox-backend"> <a
href="#321-build-and-install-gluten-with-velox-backend" class="anchor-heading"
aria-labelledby="321-build-and-install-gluten-with-velox-backend"><svg
viewBox="0 0 16 16" aria-hidden="true"><use
xlink:href="#svg-link"></use></svg></a> 3.2.1 Build and install Gluten with
Velox backend </h2> <p>If you want to use Gluten <strong>Velox</strong>
backend, see <a href="https://gluten.apache.org/docs/getting-st [...]
diff --git a/output/jekyll/update/2024/02/08/welcome-to-jekyll.html
b/output/jekyll/update/2024/02/08/welcome-to-jekyll.html
index 7fe9dd8..b4bd1ff 100644
--- a/output/jekyll/update/2024/02/08/welcome-to-jekyll.html
+++ b/output/jekyll/update/2024/02/08/welcome-to-jekyll.html
@@ -2,4 +2,4 @@
<span class="nb">puts</span> <span class="s2">"Hi, </span><span
class="si">#{</span><span class="nb">name</span><span class="si">}</span><span
class="s2">"</span>
<span class="k">end</span>
<span class="n">print_hi</span><span class="p">(</span><span
class="s1">'Tom'</span><span class="p">)</span>
-<span class="c1">#=> prints 'Hi, Tom' to
STDOUT.</span></code></pre></figure> <p>Check out the <a
href="https://jekyllrb.com/docs/home";>Jekyll docs</a> for more info on how to
get the most out of Jekyll. File all bugs/feature requests at <a
href="https://github.com/jekyll/jekyll";>Jekyll’s GitHub repo</a>. If you have
questions, you can ask them on <a href="https://talk.jekyllrb.com/";>Jekyll
Talk</a>.</p> </main> <hr> <footer> <p><a href="#top" id="back-to-top">Back to
top</a></p> <a h [...]
+<span class="c1">#=> prints 'Hi, Tom' to
STDOUT.</span></code></pre></figure> <p>Check out the <a
href="https://jekyllrb.com/docs/home";>Jekyll docs</a> for more info on how to
get the most out of Jekyll. File all bugs/feature requests at <a
href="https://github.com/jekyll/jekyll";>Jekyll’s GitHub repo</a>. If you have
questions, you can ask them on <a href="https://talk.jekyllrb.com/";>Jekyll
Talk</a>.</p> </main> <hr> <footer> <p><a href="#top" id="back-to-top">Back to
top</a></p> <a h [...]
diff --git a/output/references/index.html b/output/references/index.html
index 66c5d14..d9a4408 100644
--- a/output/references/index.html
+++ b/output/references/index.html
@@ -1 +1 @@
-<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(5)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
+<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta
http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet"
href="/assets/css/just-the-docs-default.css"> <link rel="stylesheet"
href="/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet">
<style id="jtd-nav-activation"> .site-nav > ul.nav-list:first-child >
li:not(:nth-child(5)) > a, .site-nav > ul.nav-list:first-child > li > ul > li a
{ background-image: none; } .site-nav > ul.nav-list:no [...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
