This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/datafusion-python.git
The following commit(s) were added to refs/heads/asf-staging by this push:
new f025306 Publish built docs triggered by
4ea0032ff890fb5ab0838e42b8b66ffbd521f4df
f025306 is described below
commit f0253060d3c19e6d774024f25fa37f70027e02f5
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Sat Sep 7 11:11:12 2024 +0000
Publish built docs triggered by 4ea0032ff890fb5ab0838e42b8b66ffbd521f4df
---
_sources/contributor-guide/introduction.rst.txt | 11 +++++++
contributor-guide/introduction.html | 15 ++++++++++
searchindex.js | 2 +-
user-guide/common-operations/aggregations.html | 18 ++++++------
user-guide/common-operations/basic-info.html | 34 +++++++++++-----------
user-guide/common-operations/functions.html | 22 +++++++-------
user-guide/common-operations/joins.html | 6 ++--
.../common-operations/select-and-filter.html | 2 +-
user-guide/common-operations/windows.html | 2 +-
9 files changed, 69 insertions(+), 43 deletions(-)
diff --git a/_sources/contributor-guide/introduction.rst.txt
b/_sources/contributor-guide/introduction.rst.txt
index 6de2b87..4457a89 100644
--- a/_sources/contributor-guide/introduction.rst.txt
+++ b/_sources/contributor-guide/introduction.rst.txt
@@ -71,6 +71,17 @@ Our pre-commit hooks can be installed by running
:code:`pre-commit install`, whi
The pre-commit hooks can also be run adhoc without installing them by simply
running :code:`pre-commit run --all-files`
+Guidelines for Separating Python and Rust Code
+----------------------------------------------
+
+Version 40 of ``datafusion-python`` introduced ``python`` wrappers around the
``pyo3`` generated code to vastly improve the user experience. (See the `blog
post
<https://datafusion.apache.org/blog/2024/08/20/python-datafusion-40.0.0/>`_ and
`pull request <https://github.com/apache/datafusion-python/pull/750>`_ for more
details.)
+
+Mostly, the ``python`` code is limited to pure wrappers with type hints and
good docstrings, but there are a few reasons for when the code does more:
+
+1. Trivial aliases like :py:func:`~datafusion.functions.array_append` and
:py:func:`~datafusion.functions.list_append`.
+2. Simple type conversion, like from a ``path`` to a ``string`` of the path or
from ``number`` to ``lit(number)``.
+3. The additional code makes an API **much** more pythonic, like we do for
:py:func:`~datafusion.functions.named_struct` (see `source code
<https://github.com/apache/datafusion-python/blob/a0913c728f5f323c1eb4913e614c9d996083e274/python/datafusion/functions.py#L1040-L1046>`_).
+
Update Dependencies
-------------------
diff --git a/contributor-guide/introduction.html
b/contributor-guide/introduction.html
index 387eb2e..fa5bd0b 100644
--- a/contributor-guide/introduction.html
+++ b/contributor-guide/introduction.html
@@ -355,6 +355,11 @@
Running & Installing pre-commit hooks
</a>
</li>
+ <li class="toc-h2 nav-item toc-entry">
+ <a class="reference internal nav-link"
href="#guidelines-for-separating-python-and-rust-code">
+ Guidelines for Separating Python and Rust Code
+ </a>
+ </li>
<li class="toc-h2 nav-item toc-entry">
<a class="reference internal nav-link" href="#update-dependencies">
Update Dependencies
@@ -425,6 +430,16 @@ python<span class="w"> </span>-m<span class="w">
</span>pytest
<p>Our pre-commit hooks can be installed by running <code class="code docutils
literal notranslate"><span class="pre">pre-commit</span> <span
class="pre">install</span></code>, which will install the configurations in
your ARROW_DATAFUSION_PYTHON_ROOT/.github directory and run each time you
perform a commit, failing to complete the commit if an offending lint is found
allowing you to make changes locally before pushing.</p>
<p>The pre-commit hooks can also be run adhoc without installing them by
simply running <code class="code docutils literal notranslate"><span
class="pre">pre-commit</span> <span class="pre">run</span> <span
class="pre">--all-files</span></code></p>
</section>
+<section id="guidelines-for-separating-python-and-rust-code">
+<h2>Guidelines for Separating Python and Rust Code<a class="headerlink"
href="#guidelines-for-separating-python-and-rust-code" title="Link to this
heading">¶</a></h2>
+<p>Version 40 of <code class="docutils literal notranslate"><span
class="pre">datafusion-python</span></code> introduced <code class="docutils
literal notranslate"><span class="pre">python</span></code> wrappers around the
<code class="docutils literal notranslate"><span class="pre">pyo3</span></code>
generated code to vastly improve the user experience. (See the <a
class="reference external"
href="https://datafusion.apache.org/blog/2024/08/20/python-datafusion-40.0.0/";>blog
post</a> and [...]
+<p>Mostly, the <code class="docutils literal notranslate"><span
class="pre">python</span></code> code is limited to pure wrappers with type
hints and good docstrings, but there are a few reasons for when the code does
more:</p>
+<ol class="arabic simple">
+<li><p>Trivial aliases like <a class="reference internal"
href="../autoapi/datafusion/functions/index.html#datafusion.functions.array_append"
title="datafusion.functions.array_append"><code class="xref py py-func
docutils literal notranslate"><span
class="pre">array_append()</span></code></a> and <a class="reference internal"
href="../autoapi/datafusion/functions/index.html#datafusion.functions.list_append"
title="datafusion.functions.list_append"><code class="xref py py-func docutils
li [...]
+<li><p>Simple type conversion, like from a <code class="docutils literal
notranslate"><span class="pre">path</span></code> to a <code class="docutils
literal notranslate"><span class="pre">string</span></code> of the path or from
<code class="docutils literal notranslate"><span
class="pre">number</span></code> to <code class="docutils literal
notranslate"><span class="pre">lit(number)</span></code>.</p></li>
+<li><p>The additional code makes an API <strong>much</strong> more pythonic,
like we do for <a class="reference internal"
href="../autoapi/datafusion/functions/index.html#datafusion.functions.named_struct"
title="datafusion.functions.named_struct"><code class="xref py py-func
docutils literal notranslate"><span
class="pre">named_struct()</span></code></a> (see <a class="reference external"
href="https://github.com/apache/datafusion-python/blob/a0913c728f5f323c1eb4913e614c9d996083e274/pyt
[...]
+</ol>
+</section>
<section id="update-dependencies">
<h2>Update Dependencies<a class="headerlink" href="#update-dependencies"
title="Link to this heading">¶</a></h2>
<p>To change test dependencies, change the <cite>requirements.in</cite> and
run</p>
diff --git a/searchindex.js b/searchindex.js
index 273dbec..5dd37f9 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"API Reference": [[13, null]], "Aggregate
Functions": [[25, "aggregate-functions"]], "Aggregation": [[17, null]],
"Arrays": [[19, "arrays"]], "Arrow": [[28, null]], "Attributes": [[3,
"attributes"], [5, "attributes"], [9, "attributes"], [12, "attributes"]],
"Available Functions": [[25, "available-functions"]], "Avro": [[29, null]],
"Basic Operations": [[18, null]], "Boolean": [[19, "boolean"]], "CSV": [[30,
null]], "Classes": [[0, "classes"], [1, "classes"] [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"API Reference": [[13, null]], "Aggregate
Functions": [[25, "aggregate-functions"]], "Aggregation": [[17, null]],
"Arrays": [[19, "arrays"]], "Arrow": [[28, null]], "Attributes": [[3,
"attributes"], [5, "attributes"], [9, "attributes"], [12, "attributes"]],
"Available Functions": [[25, "available-functions"]], "Avro": [[29, null]],
"Basic Operations": [[18, null]], "Boolean": [[19, "boolean"]], "CSV": [[30,
null]], "Classes": [[0, "classes"], [1, "classes"] [...]
\ No newline at end of file
diff --git a/user-guide/common-operations/aggregations.html
b/user-guide/common-operations/aggregations.html
index cdbabb0..ef1ab0a 100644
--- a/user-guide/common-operations/aggregations.html
+++ b/user-guide/common-operations/aggregations.html
@@ -400,7 +400,7 @@ For performing an aggregation, DataFusion provides the <a
class="reference inter
<span
class="o">+----------------------------+--------------------------+------------------------------------------------+</span>
<span class="o">|</span> <span class="n">approx_distinct</span><span
class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span
class="n">c</span><span class="p">)</span> <span class="o">|</span> <span
class="n">approx_median</span><span class="p">(</span><span
class="n">foo_bar</span><span class="o">.</span><span class="n">d</span><span
class="p">)</span> <span class="o">|</span> <span
class="n">approx_percentile_cont</span><span class="p">(</span><span
class="n">foo_ [...]
<span
class="o">+----------------------------+--------------------------+------------------------------------------------+</span>
-<span class="o">|</span> <span class="mi">7</span>
<span class="o">|</span> <span class="mf">0.31327860747768554</span> <span
class="o">|</span> <span class="mf">0.31327860747768554</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">7</span>
<span class="o">|</span> <span class="mf">0.7494960517869685</span> <span
class="o">|</span> <span class="mf">0.7494960517869685</span>
<span class="o">|</span>
<span
class="o">+----------------------------+--------------------------+------------------------------------------------+</span>
</pre></div>
</div>
@@ -412,8 +412,8 @@ the <code class="code docutils literal notranslate"><span
class="pre">group_by</
<span
class="o">+-----+----------------+--------------------+---------------------+</span>
<span class="o">|</span> <span class="n">a</span> <span class="o">|</span>
<span class="nb">sum</span><span class="p">(</span><span
class="n">foo_bar</span><span class="o">.</span><span class="n">c</span><span
class="p">)</span> <span class="o">|</span> <span class="nb">max</span><span
class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span
class="n">d</span><span class="p">)</span> <span class="o">|</span> <span
class="nb">min</span><span class="p">(</span><s [...]
<span
class="o">+-----+----------------+--------------------+---------------------+</span>
-<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span>
<span class="mi">293</span> <span class="o">|</span> <span
class="mf">0.8857827743604686</span> <span class="o">|</span> <span
class="mf">0.279294876658467</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span>
<span class="mi">152</span> <span class="o">|</span> <span
class="mf">0.9843857999624357</span> <span class="o">|</span> <span
class="mf">0.06477303246728938</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span>
<span class="mi">336</span> <span class="o">|</span> <span
class="mf">0.9341676700228333</span> <span class="o">|</span> <span
class="mf">0.10639618500928816</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span>
<span class="mi">185</span> <span class="o">|</span> <span
class="mf">0.8019483672002637</span> <span class="o">|</span> <span
class="mf">0.326764659316201</span> <span class="o">|</span>
<span
class="o">+-----+----------------+--------------------+---------------------+</span>
</pre></div>
</div>
@@ -424,12 +424,12 @@ the <code class="code docutils literal notranslate"><span
class="pre">group_by</
<span
class="o">+-----+-------+----------------+---------------------+---------------------+</span>
<span class="o">|</span> <span class="n">a</span> <span class="o">|</span>
<span class="n">b</span> <span class="o">|</span> <span
class="nb">sum</span><span class="p">(</span><span
class="n">foo_bar</span><span class="o">.</span><span class="n">c</span><span
class="p">)</span> <span class="o">|</span> <span class="nb">max</span><span
class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span
class="n">d</span><span class="p">)</span> <span class="o">|</span [...]
<span
class="o">+-----+-------+----------------+---------------------+---------------------+</span>
-<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span>
<span class="n">one</span> <span class="o">|</span> <span
class="mi">98</span> <span class="o">|</span> <span
class="mf">0.8857827743604686</span> <span class="o">|</span> <span
class="mf">0.4927895884634398</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span>
<span class="n">one</span> <span class="o">|</span> <span
class="mi">57</span> <span class="o">|</span> <span
class="mf">0.06477303246728938</span> <span class="o">|</span> <span
class="mf">0.06477303246728938</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span>
<span class="n">two</span> <span class="o">|</span> <span
class="mi">159</span> <span class="o">|</span> <span
class="mf">0.35844881791356153</span> <span class="o">|</span> <span
class="mf">0.3121087467199357</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span>
<span class="n">two</span> <span class="o">|</span> <span
class="mi">38</span> <span class="o">|</span> <span
class="mf">0.2264365135664288</span> <span class="o">|</span> <span
class="mf">0.2264365135664288</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span>
<span class="n">three</span> <span class="o">|</span> <span
class="mi">57</span> <span class="o">|</span> <span
class="mf">0.9843857999624357</span> <span class="o">|</span> <span
class="mf">0.9843857999624357</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span>
<span class="n">three</span> <span class="o">|</span> <span
class="mi">36</span> <span class="o">|</span> <span
class="mf">0.279294876658467</span> <span class="o">|</span> <span
class="mf">0.279294876658467</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span>
<span class="n">three</span> <span class="o">|</span> <span
class="mi">72</span> <span class="o">|</span> <span
class="mf">0.326764659316201</span> <span class="o">|</span> <span
class="mf">0.326764659316201</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span>
<span class="n">three</span> <span class="o">|</span> <span
class="mi">52</span> <span class="o">|</span> <span
class="mf">0.5978672275586263</span> <span class="o">|</span> <span
class="mf">0.5978672275586263</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span>
<span class="n">one</span> <span class="o">|</span> <span
class="mi">110</span> <span class="o">|</span> <span
class="mf">0.9341676700228333</span> <span class="o">|</span> <span
class="mf">0.807676489211807</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span>
<span class="n">one</span> <span class="o">|</span> <span
class="mi">72</span> <span class="o">|</span> <span
class="mf">0.38451778075411214</span> <span class="o">|</span> <span
class="mf">0.38451778075411214</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span>
<span class="n">two</span> <span class="o">|</span> <span
class="mi">174</span> <span class="o">|</span> <span
class="mf">0.8745881366337083</span> <span class="o">|</span> <span
class="mf">0.10639618500928816</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span>
<span class="n">two</span> <span class="o">|</span> <span
class="mi">41</span> <span class="o">|</span> <span
class="mf">0.8019483672002637</span> <span class="o">|</span> <span
class="mf">0.8019483672002637</span> <span class="o">|</span>
<span
class="o">+-----+-------+----------------+---------------------+---------------------+</span>
</pre></div>
</div>
diff --git a/user-guide/common-operations/basic-info.html
b/user-guide/common-operations/basic-info.html
index 1c364c0..b5afffa 100644
--- a/user-guide/common-operations/basic-info.html
+++ b/user-guide/common-operations/basic-info.html
@@ -384,11 +384,11 @@
<span class="o">+-----+---------+--------+--------+</span>
<span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span>
<span class="n">names</span> <span class="o">|</span> <span
class="n">random</span> <span class="o">|</span> <span class="n">groups</span>
<span class="o">|</span>
<span class="o">+-----+---------+--------+--------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span>
<span class="n">python</span> <span class="o">|</span> <span
class="mi">522</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span>
<span class="n">ruby</span> <span class="o">|</span> <span
class="mi">162</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span>
<span class="n">java</span> <span class="o">|</span> <span
class="mi">228</span> <span class="o">|</span> <span class="n">B</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">4</span> <span class="o">|</span>
<span class="n">haskell</span> <span class="o">|</span> <span
class="mi">640</span> <span class="o">|</span> <span class="n">C</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">5</span> <span class="o">|</span>
<span class="n">go</span> <span class="o">|</span> <span
class="mi">711</span> <span class="o">|</span> <span class="n">B</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span>
<span class="n">python</span> <span class="o">|</span> <span
class="mi">655</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span>
<span class="n">ruby</span> <span class="o">|</span> <span
class="mi">947</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span>
<span class="n">java</span> <span class="o">|</span> <span
class="mi">433</span> <span class="o">|</span> <span class="n">B</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">4</span> <span class="o">|</span>
<span class="n">haskell</span> <span class="o">|</span> <span
class="mi">681</span> <span class="o">|</span> <span class="n">C</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">5</span> <span class="o">|</span>
<span class="n">go</span> <span class="o">|</span> <span
class="mi">828</span> <span class="o">|</span> <span class="n">B</span>
<span class="o">|</span>
<span class="o">+-----+---------+--------+--------+</span>
</pre></div>
</div>
@@ -399,8 +399,8 @@
<span class="o">+-----+--------+--------+--------+</span>
<span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span>
<span class="n">names</span> <span class="o">|</span> <span
class="n">random</span> <span class="o">|</span> <span class="n">groups</span>
<span class="o">|</span>
<span class="o">+-----+--------+--------+--------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span>
<span class="n">python</span> <span class="o">|</span> <span
class="mi">522</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span>
<span class="n">ruby</span> <span class="o">|</span> <span
class="mi">162</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span>
<span class="n">python</span> <span class="o">|</span> <span
class="mi">655</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span>
<span class="n">ruby</span> <span class="o">|</span> <span
class="mi">947</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
<span class="o">+-----+--------+--------+--------+</span>
</pre></div>
</div>
@@ -418,11 +418,11 @@ passing them to an Arrow table, and then converting them
to a pandas DataFrame.<
<div class="highlight-ipython notranslate"><div
class="highlight"><pre><span></span><span class="n">In</span> <span
class="p">[</span><span class="mi">8</span><span class="p">]:</span> <span
class="n">df</span><span class="o">.</span><span
class="n">to_pandas</span><span class="p">()</span>
<span class="n">Out</span><span class="p">[</span><span
class="mi">8</span><span class="p">]:</span>
<span class="n">nrs</span> <span class="n">names</span> <span
class="n">random</span> <span class="n">groups</span>
-<span class="mi">0</span> <span class="mi">1</span> <span
class="n">python</span> <span class="mi">522</span> <span
class="n">A</span>
-<span class="mi">1</span> <span class="mi">2</span> <span
class="n">ruby</span> <span class="mi">162</span> <span
class="n">A</span>
-<span class="mi">2</span> <span class="mi">3</span> <span
class="n">java</span> <span class="mi">228</span> <span
class="n">B</span>
-<span class="mi">3</span> <span class="mi">4</span> <span
class="n">haskell</span> <span class="mi">640</span> <span
class="n">C</span>
-<span class="mi">4</span> <span class="mi">5</span> <span
class="n">go</span> <span class="mi">711</span> <span
class="n">B</span>
+<span class="mi">0</span> <span class="mi">1</span> <span
class="n">python</span> <span class="mi">655</span> <span
class="n">A</span>
+<span class="mi">1</span> <span class="mi">2</span> <span
class="n">ruby</span> <span class="mi">947</span> <span
class="n">A</span>
+<span class="mi">2</span> <span class="mi">3</span> <span
class="n">java</span> <span class="mi">433</span> <span
class="n">B</span>
+<span class="mi">3</span> <span class="mi">4</span> <span
class="n">haskell</span> <span class="mi">681</span> <span
class="n">C</span>
+<span class="mi">4</span> <span class="mi">5</span> <span
class="n">go</span> <span class="mi">828</span> <span
class="n">B</span>
</pre></div>
</div>
<p><a class="reference internal"
href="../../autoapi/datafusion/dataframe/index.html#datafusion.dataframe.DataFrame.describe"
title="datafusion.dataframe.DataFrame.describe"><code class="xref py py-func
docutils literal notranslate"><span class="pre">describe()</span></code></a>
shows a quick statistic summary of your data:</p>
@@ -434,11 +434,11 @@ passing them to an Arrow table, and then converting them
to a pandas DataFrame.<
<span
class="o">+------------+--------------------+-------+--------------------+--------+</span>
<span class="o">|</span> <span class="n">count</span> <span
class="o">|</span> <span class="mf">5.0</span> <span
class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span
class="mf">5.0</span> <span class="o">|</span> <span
class="mi">5</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">null_count</span> <span
class="o">|</span> <span class="mf">0.0</span> <span
class="o">|</span> <span class="mi">0</span> <span class="o">|</span> <span
class="mf">0.0</span> <span class="o">|</span> <span
class="mi">0</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">mean</span> <span
class="o">|</span> <span class="mf">3.0</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">452.6</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">std</span> <span
class="o">|</span> <span class="mf">1.5811388300841898</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">245.76370765432395</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
-<span class="o">|</span> <span class="nb">min</span> <span
class="o">|</span> <span class="mf">1.0</span> <span
class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span
class="mf">162.0</span> <span class="o">|</span> <span
class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="nb">max</span> <span
class="o">|</span> <span class="mf">5.0</span> <span
class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span
class="mf">711.0</span> <span class="o">|</span> <span
class="n">C</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">median</span> <span
class="o">|</span> <span class="mf">3.0</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">522.0</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">mean</span> <span
class="o">|</span> <span class="mf">3.0</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">708.8</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">std</span> <span
class="o">|</span> <span class="mf">1.5811388300841898</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">194.08812431470403</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="nb">min</span> <span
class="o">|</span> <span class="mf">1.0</span> <span
class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span
class="mf">433.0</span> <span class="o">|</span> <span
class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="nb">max</span> <span
class="o">|</span> <span class="mf">5.0</span> <span
class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span
class="mf">947.0</span> <span class="o">|</span> <span
class="n">C</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">median</span> <span
class="o">|</span> <span class="mf">3.0</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">681.0</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
<span
class="o">+------------+--------------------+-------+--------------------+--------+</span>
</pre></div>
</div>
diff --git a/user-guide/common-operations/functions.html
b/user-guide/common-operations/functions.html
index c60324a..c74bccc 100644
--- a/user-guide/common-operations/functions.html
+++ b/user-guide/common-operations/functions.html
@@ -405,7 +405,7 @@ In here we will cover some of the more popular use cases.
If you want to view al
<span class="o">...</span><span class="p">:</span> <span
class="s2">"pokemon.csv"</span><span class="p">,</span>
<span class="o">...</span><span class="p">:</span> <span class="p">)</span>
<span class="o">...</span><span class="p">:</span>
-<span class="n">Out</span><span class="p">[</span><span
class="mi">3</span><span class="p">]:</span> <span class="p">(</span><span
class="s1">'pokemon.csv'</span><span class="p">,</span> <span
class="o"><</span><span class="n">http</span><span class="o">.</span><span
class="n">client</span><span class="o">.</span><span
class="n">HTTPMessage</span> <span class="n">at</span> <span
class="mh">0x7f57ae98e490</span><span class="o">></span><span
class="p">)</span>
+<span class="n">Out</span><span class="p">[</span><span
class="mi">3</span><span class="p">]:</span> <span class="p">(</span><span
class="s1">'pokemon.csv'</span><span class="p">,</span> <span
class="o"><</span><span class="n">http</span><span class="o">.</span><span
class="n">client</span><span class="o">.</span><span
class="n">HTTPMessage</span> <span class="n">at</span> <span
class="mh">0x7fad29b0fcd0</span><span class="o">></span><span
class="p">)</span>
<span class="n">In</span> <span class="p">[</span><span
class="mi">4</span><span class="p">]:</span> <span class="n">ctx</span> <span
class="o">=</span> <span class="n">SessionContext</span><span
class="p">()</span>
@@ -479,16 +479,16 @@ In here we will cover some of the more popular use cases.
If you want to view al
<span class="o">+--------------------------------+</span>
<span class="o">|</span> <span class="n">now</span><span class="p">()</span>
<span class="o">|</span>
<span class="o">+--------------------------------+</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T01</span><span class="p">:</span><span
class="mi">14</span><span class="p">:</span><span
class="mf">00.556577393</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span
class="o">-</span><span class="mi">09</span><span class="o">-</span><span
class="mi">07</span><span class="n">T11</span><span class="p">:</span><span
class="mi">11</span><span class="p">:</span><span
class="mf">06.704243436</span><span class="n">Z</span> <span class="o">|</span>
<span class="o">+--------------------------------+</span>
</pre></div>
</div>
diff --git a/user-guide/common-operations/joins.html
b/user-guide/common-operations/joins.html
index 5a9b786..77ddd68 100644
--- a/user-guide/common-operations/joins.html
+++ b/user-guide/common-operations/joins.html
@@ -433,8 +433,8 @@ will be included in the resulting DataFrame.</p>
<span class="o">+-------------+----------+----+-----------+</span>
<span class="o">|</span> <span class="n">customer_id</span> <span
class="o">|</span> <span class="n">customer</span> <span class="o">|</span>
<span class="nb">id</span> <span class="o">|</span> <span class="n">name</span>
<span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span
class="o">|</span> <span class="n">Alice</span> <span class="o">|</span>
<span class="mi">1</span> <span class="o">|</span> <span
class="n">CityCabs</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">2</span> <span
class="o">|</span> <span class="n">Bob</span> <span class="o">|</span>
<span class="mi">2</span> <span class="o">|</span> <span
class="n">MetroRide</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span
class="o">|</span> <span class="n">Alice</span> <span class="o">|</span>
<span class="mi">1</span> <span class="o">|</span> <span
class="n">CityCabs</span> <span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
</pre></div>
</div>
@@ -452,9 +452,9 @@ values for the corresponding columns.</p>
<span class="o">+-------------+----------+----+-----------+</span>
<span class="o">|</span> <span class="n">customer_id</span> <span
class="o">|</span> <span class="n">customer</span> <span class="o">|</span>
<span class="nb">id</span> <span class="o">|</span> <span class="n">name</span>
<span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
-<span class="o">|</span> <span class="mi">2</span> <span
class="o">|</span> <span class="n">Bob</span> <span class="o">|</span>
<span class="mi">2</span> <span class="o">|</span> <span
class="n">MetroRide</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">1</span> <span
class="o">|</span> <span class="n">Alice</span> <span class="o">|</span>
<span class="mi">1</span> <span class="o">|</span> <span
class="n">CityCabs</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">3</span> <span
class="o">|</span> <span class="n">Charlie</span> <span class="o">|</span>
<span class="o">|</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span
class="o">|</span> <span class="n">Bob</span> <span class="o">|</span>
<span class="mi">2</span> <span class="o">|</span> <span
class="n">MetroRide</span> <span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
</pre></div>
</div>
@@ -469,8 +469,8 @@ is no match. Unmatched rows will have null values.</p>
<span class="o">+-------------+----------+----+-----------+</span>
<span class="o">|</span> <span class="n">customer_id</span> <span
class="o">|</span> <span class="n">customer</span> <span class="o">|</span>
<span class="nb">id</span> <span class="o">|</span> <span class="n">name</span>
<span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
-<span class="o">|</span> <span class="mi">2</span> <span
class="o">|</span> <span class="n">Bob</span> <span class="o">|</span>
<span class="mi">2</span> <span class="o">|</span> <span
class="n">MetroRide</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">1</span> <span
class="o">|</span> <span class="n">Alice</span> <span class="o">|</span>
<span class="mi">1</span> <span class="o">|</span> <span
class="n">CityCabs</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span
class="o">|</span> <span class="n">Bob</span> <span class="o">|</span>
<span class="mi">2</span> <span class="o">|</span> <span
class="n">MetroRide</span> <span class="o">|</span>
<span class="o">|</span> <span class="o">|</span> <span
class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span
class="n">UrbanGo</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">3</span> <span
class="o">|</span> <span class="n">Charlie</span> <span class="o">|</span>
<span class="o">|</span> <span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
diff --git a/user-guide/common-operations/select-and-filter.html
b/user-guide/common-operations/select-and-filter.html
index af3bb89..b5367c0 100644
--- a/user-guide/common-operations/select-and-filter.html
+++ b/user-guide/common-operations/select-and-filter.html
@@ -373,7 +373,7 @@
<span class="n">In</span> <span class="p">[</span><span
class="mi">3</span><span class="p">]:</span> <span class="n">urllib</span><span
class="o">.</span><span class="n">request</span><span class="o">.</span><span
class="n">urlretrieve</span><span class="p">(</span><span
class="s2">"https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2021-01.parquet"</span><span
class="p">,</span>
<span class="o">...</span><span class="p">:</span>
<span class="s2">"yellow_trip_data.parquet"</span><span
class="p">)</span>
<span class="o">...</span><span class="p">:</span>
-<span class="n">Out</span><span class="p">[</span><span
class="mi">3</span><span class="p">]:</span> <span class="p">(</span><span
class="s1">'yellow_trip_data.parquet'</span><span class="p">,</span>
<span class="o"><</span><span class="n">http</span><span
class="o">.</span><span class="n">client</span><span class="o">.</span><span
class="n">HTTPMessage</span> <span class="n">at</span> <span
class="mh">0x7f57a5f19ad0</span><span class="o">></span><span
class="p">)</span>
+<span class="n">Out</span><span class="p">[</span><span
class="mi">3</span><span class="p">]:</span> <span class="p">(</span><span
class="s1">'yellow_trip_data.parquet'</span><span class="p">,</span>
<span class="o"><</span><span class="n">http</span><span
class="o">.</span><span class="n">client</span><span class="o">.</span><span
class="n">HTTPMessage</span> <span class="n">at</span> <span
class="mh">0x7fad18939710</span><span class="o">></span><span
class="p">)</span>
<span class="n">In</span> <span class="p">[</span><span
class="mi">4</span><span class="p">]:</span> <span class="n">ctx</span> <span
class="o">=</span> <span class="n">SessionContext</span><span
class="p">()</span>
diff --git a/user-guide/common-operations/windows.html
b/user-guide/common-operations/windows.html
index 75aaac1..9989a81 100644
--- a/user-guide/common-operations/windows.html
+++ b/user-guide/common-operations/windows.html
@@ -423,7 +423,7 @@ provides a single value for multiple rows.</p>
<span class="o">...</span><span class="p">:</span> <span
class="s2">"pokemon.csv"</span><span class="p">,</span>
<span class="o">...</span><span class="p">:</span> <span class="p">)</span>
<span class="o">...</span><span class="p">:</span>
-<span class="n">Out</span><span class="p">[</span><span
class="mi">5</span><span class="p">]:</span> <span class="p">(</span><span
class="s1">'pokemon.csv'</span><span class="p">,</span> <span
class="o"><</span><span class="n">http</span><span class="o">.</span><span
class="n">client</span><span class="o">.</span><span
class="n">HTTPMessage</span> <span class="n">at</span> <span
class="mh">0x7f57a5f661d0</span><span class="o">></span><span
class="p">)</span>
+<span class="n">Out</span><span class="p">[</span><span
class="mi">5</span><span class="p">]:</span> <span class="p">(</span><span
class="s1">'pokemon.csv'</span><span class="p">,</span> <span
class="o"><</span><span class="n">http</span><span class="o">.</span><span
class="n">client</span><span class="o">.</span><span
class="n">HTTPMessage</span> <span class="n">at</span> <span
class="mh">0x7fad18971890</span><span class="o">></span><span
class="p">)</span>
<span class="n">In</span> <span class="p">[</span><span
class="mi">6</span><span class="p">]:</span> <span class="n">ctx</span> <span
class="o">=</span> <span class="n">SessionContext</span><span
class="p">()</span>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
