This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a commit to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/datafusion-python.git
The following commit(s) were added to refs/heads/asf-staging by this push:
new c59f686f Publish built docs triggered by
23062f78ad55a7121517c5ab00742503e95c7342
c59f686f is described below
commit c59f686f07bca2e17490010efdf75d1ad0791955
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Fri Jun 5 16:37:59 2026 +0000
Publish built docs triggered by 23062f78ad55a7121517c5ab00742503e95c7342
---
_sources/autoapi/datafusion/context/index.rst.txt | 42 ++++++++++++++++
autoapi/datafusion/context/index.html | 56 ++++++++++++++++++++++
genindex.html | 4 ++
objects.inv | Bin 10954 -> 10974 bytes
searchindex.js | 2 +-
user-guide/common-operations/aggregations.html | 32 ++++++-------
user-guide/common-operations/basic-info.html | 46 +++++++++---------
user-guide/common-operations/functions.html | 20 ++++----
user-guide/common-operations/udf-and-udfa.html | 4 +-
9 files changed, 154 insertions(+), 52 deletions(-)
diff --git a/_sources/autoapi/datafusion/context/index.rst.txt
b/_sources/autoapi/datafusion/context/index.rst.txt
index 226f88a2..9f3d1533 100644
--- a/_sources/autoapi/datafusion/context/index.rst.txt
+++ b/_sources/autoapi/datafusion/context/index.rst.txt
@@ -527,6 +527,23 @@ Module Contents
+ .. py:method:: copied_config() -> SessionConfig
+
+ Return a copy of the active :py:class:`SessionConfig`.
+
+ Mutating the returned config does not affect this context; use
+ the result when you need a starting point for a new context or
+ want to inspect the current settings independent of further
+ changes here.
+
+ .. rubric:: Examples
+
+ >>> ctx = SessionContext(SessionConfig().with_batch_size(1024))
+ >>> isinstance(ctx.copied_config(), SessionConfig)
+ True
+
+
+
.. py:method:: create_dataframe(partitions:
list[list[pyarrow.RecordBatch]], name: str | None = None, schema:
pyarrow.Schema | None = None) -> datafusion.dataframe.DataFrame
Create and return a dataframe using the provided partitions.
@@ -723,6 +740,31 @@ Module Contents
+ .. py:method:: parse_capacity_limit(config_name: str, limit: str) -> int
+ :staticmethod:
+
+
+ Parse a size string into a byte count.
+
+ Accepts strings like ``"100M"``, ``"1.5G"``, or ``"512K"``.
+ ``"0"`` is accepted and returns 0. ``config_name`` is used purely
+ for error messages and identifies which configuration setting the
+ limit belongs to. Use this helper when constructing a
+ :py:class:`RuntimeEnvBuilder` from a human-friendly size string.
+
+ .. rubric:: Examples
+
+ >>> SessionContext.parse_capacity_limit(
+ ... "datafusion.runtime.memory_limit", "1M"
+ ... )
+ 1048576
+ >>> SessionContext.parse_capacity_limit(
+ ... "datafusion.runtime.memory_limit", "0"
+ ... )
+ 0
+
+
+
.. py:method:: parse_sql_expr(sql: str, schema: datafusion.common.DFSchema)
-> datafusion.expr.Expr
Parse a SQL expression string into a logical expression.
diff --git a/autoapi/datafusion/context/index.html
b/autoapi/datafusion/context/index.html
index c753edc7..0dd4b61d 100644
--- a/autoapi/datafusion/context/index.html
+++ b/autoapi/datafusion/context/index.html
@@ -868,6 +868,15 @@
</code>
</a>
</li>
+ <li class="toc-h4 nav-item toc-entry">
+ <a class="reference internal nav-link"
href="#datafusion.context.SessionContext.copied_config">
+ <code class="docutils literal notranslate">
+ <span class="pre">
+ SessionContext.copied_config()
+ </span>
+ </code>
+ </a>
+ </li>
<li class="toc-h4 nav-item toc-entry">
<a class="reference internal nav-link"
href="#datafusion.context.SessionContext.create_dataframe">
<code class="docutils literal notranslate">
@@ -1039,6 +1048,15 @@
</code>
</a>
</li>
+ <li class="toc-h4 nav-item toc-entry">
+ <a class="reference internal nav-link"
href="#datafusion.context.SessionContext.parse_capacity_limit">
+ <code class="docutils literal notranslate">
+ <span class="pre">
+ SessionContext.parse_capacity_limit()
+ </span>
+ </code>
+ </a>
+ </li>
<li class="toc-h4 nav-item toc-entry">
<a class="reference internal nav-link"
href="#datafusion.context.SessionContext.parse_sql_expr">
<code class="docutils literal notranslate">
@@ -2154,6 +2172,22 @@ a <a class="reference internal"
href="#datafusion.context.PhysicalOptimizerRuleE
<dd><p>Returns the list of catalogs in this context.</p>
</dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py"
id="datafusion.context.SessionContext.copied_config">
+<span class="sig-name descname"><span
class="pre">copied_config</span></span><span class="sig-paren">(</span><span
class="sig-paren">)</span> <span class="sig-return"><span
class="sig-return-icon">→</span> <span class="sig-return-typehint"><a
class="reference internal" href="#datafusion.context.SessionConfig"
title="datafusion.context.SessionConfig"><span
class="pre">SessionConfig</span></a></span></span><a class="headerlink"
href="#datafusion.context.SessionContext.copied_config" [...]
+<dd><p>Return a copy of the active <a class="reference internal"
href="#datafusion.context.SessionConfig"
title="datafusion.context.SessionConfig"><code class="xref py py-class docutils
literal notranslate"><span class="pre">SessionConfig</span></code></a>.</p>
+<p>Mutating the returned config does not affect this context; use
+the result when you need a starting point for a new context or
+want to inspect the current settings independent of further
+changes here.</p>
+<p class="rubric">Examples</p>
+<div class="doctest highlight-default notranslate"><div
class="highlight"><pre><span></span><span class="gp">>>> </span><span
class="n">ctx</span> <span class="o">=</span> <span
class="n">SessionContext</span><span class="p">(</span><span
class="n">SessionConfig</span><span class="p">()</span><span
class="o">.</span><span class="n">with_batch_size</span><span
class="p">(</span><span class="mi">1024</span><span class="p">))</span>
+<span class="gp">>>> </span><span class="nb">isinstance</span><span
class="p">(</span><span class="n">ctx</span><span class="o">.</span><span
class="n">copied_config</span><span class="p">(),</span> <span
class="n">SessionConfig</span><span class="p">)</span>
+<span class="go">True</span>
+</pre></div>
+</div>
+</dd></dl>
+
<dl class="py method">
<dt class="sig sig-object py"
id="datafusion.context.SessionContext.create_dataframe">
<span class="sig-name descname"><span
class="pre">create_dataframe</span></span><span class="sig-paren">(</span><em
class="sig-param"><span class="n"><span
class="pre">partitions</span></span><span class="p"><span
class="pre">:</span></span><span class="w"> </span><span class="n"><span
class="pre">list</span><span class="p"><span class="pre">[</span></span><span
class="pre">list</span><span class="p"><span class="pre">[</span></span><span
class="pre">pyarrow.RecordBatch</span><span class [...]
@@ -2413,6 +2447,28 @@ a struct array.</p>
</dl>
</dd></dl>
+<dl class="py method">
+<dt class="sig sig-object py"
id="datafusion.context.SessionContext.parse_capacity_limit">
+<em class="property"><span class="pre">static</span><span class="w">
</span></em><span class="sig-name descname"><span
class="pre">parse_capacity_limit</span></span><span
class="sig-paren">(</span><em class="sig-param"><span class="n"><span
class="pre">config_name</span></span><span class="p"><span
class="pre">:</span></span><span class="w"> </span><span class="n"><span
class="pre">str</span></span></em>, <em class="sig-param"><span class="n"><span
class="pre">limit</span></span><span cl [...]
+<dd><p>Parse a size string into a byte count.</p>
+<p>Accepts strings like <code class="docutils literal notranslate"><span
class="pre">"100M"</span></code>, <code class="docutils literal
notranslate"><span class="pre">"1.5G"</span></code>, or <code
class="docutils literal notranslate"><span
class="pre">"512K"</span></code>.
+<code class="docutils literal notranslate"><span
class="pre">"0"</span></code> is accepted and returns 0. <code
class="docutils literal notranslate"><span
class="pre">config_name</span></code> is used purely
+for error messages and identifies which configuration setting the
+limit belongs to. Use this helper when constructing a
+<a class="reference internal" href="#datafusion.context.RuntimeEnvBuilder"
title="datafusion.context.RuntimeEnvBuilder"><code class="xref py py-class
docutils literal notranslate"><span
class="pre">RuntimeEnvBuilder</span></code></a> from a human-friendly size
string.</p>
+<p class="rubric">Examples</p>
+<div class="doctest highlight-default notranslate"><div
class="highlight"><pre><span></span><span class="gp">>>> </span><span
class="n">SessionContext</span><span class="o">.</span><span
class="n">parse_capacity_limit</span><span class="p">(</span>
+<span class="gp">... </span> <span
class="s2">"datafusion.runtime.memory_limit"</span><span
class="p">,</span> <span class="s2">"1M"</span>
+<span class="gp">... </span><span class="p">)</span>
+<span class="go">1048576</span>
+<span class="gp">>>> </span><span
class="n">SessionContext</span><span class="o">.</span><span
class="n">parse_capacity_limit</span><span class="p">(</span>
+<span class="gp">... </span> <span
class="s2">"datafusion.runtime.memory_limit"</span><span
class="p">,</span> <span class="s2">"0"</span>
+<span class="gp">... </span><span class="p">)</span>
+<span class="go">0</span>
+</pre></div>
+</div>
+</dd></dl>
+
<dl class="py method">
<dt class="sig sig-object py"
id="datafusion.context.SessionContext.parse_sql_expr">
<span class="sig-name descname"><span
class="pre">parse_sql_expr</span></span><span class="sig-paren">(</span><em
class="sig-param"><span class="n"><span class="pre">sql</span></span><span
class="p"><span class="pre">:</span></span><span class="w"> </span><span
class="n"><span class="pre">str</span></span></em>, <em class="sig-param"><span
class="n"><span class="pre">schema</span></span><span class="p"><span
class="pre">:</span></span><span class="w"> </span><span class="n"><span
class=" [...]
diff --git a/genindex.html b/genindex.html
index fde8a673..cda9756e 100644
--- a/genindex.html
+++ b/genindex.html
@@ -1558,6 +1558,8 @@
<li><a
href="autoapi/datafusion/substrait/index.html#datafusion.substrait.Consumer">Consumer
(class in datafusion.substrait)</a>
</li>
<li><a
href="autoapi/datafusion/functions/index.html#datafusion.functions.contains">contains()
(in module datafusion.functions)</a>
+</li>
+ <li><a
href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.copied_config">copied_config()
(datafusion.context.SessionContext method)</a>
</li>
<li><a
href="autoapi/datafusion/expr/index.html#datafusion.expr.CopyTo">CopyTo (in
module datafusion.expr)</a>
</li>
@@ -3083,6 +3085,8 @@
<li><a
href="autoapi/datafusion/dataframe/index.html#datafusion.dataframe.ParquetWriterOptions">(class
in datafusion.dataframe)</a>
</li>
</ul></li>
+ <li><a
href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.parse_capacity_limit">parse_capacity_limit()
(datafusion.context.SessionContext static method)</a>
+</li>
<li><a
href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.parse_sql_expr">parse_sql_expr()
(datafusion.context.SessionContext method)</a>
<ul>
diff --git a/objects.inv b/objects.inv
index 0e629ce7..0e9de9f7 100644
Binary files a/objects.inv and b/objects.inv differ
diff --git a/searchindex.js b/searchindex.js
index f4eaa485..d8730cd8 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"API Reference": [[19, null], [37,
"api-reference"]], "Accessing the Calling Session": [[32,
"accessing-the-calling-session"]], "Additional Resources": [[39,
"additional-resources"]], "Aggregate Functions": [[25, "aggregate-functions"],
[32, "aggregate-functions"], [34, "aggregate-functions"]], "Aggregated vs
Per-Partition Metrics": [[37, "aggregated-vs-per-partition-metrics"]],
"Aggregation": [[25, null]], "Alternative Approach": [[20, "alternative-approac
[...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"API Reference": [[19, null], [37,
"api-reference"]], "Accessing the Calling Session": [[32,
"accessing-the-calling-session"]], "Additional Resources": [[39,
"additional-resources"]], "Aggregate Functions": [[25, "aggregate-functions"],
[32, "aggregate-functions"], [34, "aggregate-functions"]], "Aggregated vs
Per-Partition Metrics": [[37, "aggregated-vs-per-partition-metrics"]],
"Aggregation": [[25, null]], "Alternative Approach": [[20, "alternative-approac
[...]
\ No newline at end of file
diff --git a/user-guide/common-operations/aggregations.html
b/user-guide/common-operations/aggregations.html
index f8ba6bfb..c3d3b4b5 100644
--- a/user-guide/common-operations/aggregations.html
+++ b/user-guide/common-operations/aggregations.html
@@ -667,15 +667,15 @@ Pokemon set. Since there will be many entries of <code
class="docutils literal n
<span
class="o">+----------+--------------------------------------------------+</span>
<span class="o">|</span> <span class="n">Type</span> <span class="mi">1</span>
<span class="o">|</span> <span class="n">Type</span> <span
class="mi">2</span> <span class="n">List</span>
<span class="o">|</span>
<span
class="o">+----------+--------------------------------------------------+</span>
-<span class="o">|</span> <span class="n">Water</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span
class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span
class="n">Flying</span><span class="p">,</span> <span class="p">,</span> <span
class="n">Fighting</span><span class="p">,</span> <span
class="n">Ice</span><span class="p">,</span> <span class="n">Dark</span><span
class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Water</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span
class="p">,</span> <span class="n">Psychic</span><span class="p">,</span> <span
class="n">Dark</span><span class="p">,</span> <span
class="n">Flying</span><span class="p">,</span> <span
class="n">Fighting</span><span class="p">,</span> <span class="p">,</span>
<span class="n">Ice</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Rock</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Water</span><span
class="p">,</span> <span class="n">Ground</span><span class="p">,</span> <span
class="n">Flying</span><span class="p">]</span> <span
class="o">|</span>
<span class="o">|</span> <span class="n">Ghost</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span
class="p">]</span> <span
class="o">|</span>
-<span class="o">|</span> <span class="n">Ice</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Psychic</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Ice</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">]</span>
<span class="o">|</span>
<span class="o">|</span> <span class="n">Dragon</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="p">]</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="n">Grass</span> <span
class="o">|</span> <span class="p">[,</span> <span class="n">Poison</span><span
class="p">,</span> <span class="n">Psychic</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Grass</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span
class="p">,</span> <span class="p">,</span> <span class="n">Poison</span><span
class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Fire</span> <span
class="o">|</span> <span class="p">[,</span> <span class="n">Flying</span><span
class="p">,</span> <span class="n">Dragon</span><span class="p">]</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="n">Normal</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Fairy</span><span
class="p">,</span> <span class="p">,</span> <span class="n">Flying</span><span
class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Poison</span> <span
class="o">|</span> <span class="p">[,</span> <span class="n">Flying</span><span
class="p">,</span> <span class="n">Ground</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Normal</span> <span
class="o">|</span> <span class="p">[,</span> <span class="n">Flying</span><span
class="p">,</span> <span class="n">Fairy</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Poison</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span
class="p">,</span> <span class="p">,</span> <span class="n">Flying</span><span
class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Fighting</span> <span
class="o">|</span> <span class="p">[]</span>
<span class="o">|</span>
<span
class="o">+----------+--------------------------------------------------+</span>
<span class="n">Data</span> <span class="n">truncated</span><span
class="o">.</span>
@@ -691,15 +691,15 @@ entries entirely removed. The second is we can use the
<code class="docutils lit
<span
class="o">+--------+------------------------------------------------+</span>
<span class="o">|</span> <span class="n">Type</span> <span class="mi">1</span>
<span class="o">|</span> <span class="n">Type</span> <span class="mi">2</span>
<span class="n">List</span> <span
class="o">|</span>
<span
class="o">+--------+------------------------------------------------+</span>
-<span class="o">|</span> <span class="n">Water</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Ice</span><span
class="p">,</span> <span class="n">Fighting</span><span class="p">,</span>
<span class="n">Poison</span><span class="p">,</span> <span
class="n">Psychic</span><span class="p">,</span> <span
class="n">Dark</span><span class="p">,</span> <span
class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Rock</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Water</span><span class="p">,</span> <span
class="n">Ground</span><span class="p">]</span> <span
class="o">|</span>
+<span class="o">|</span> <span class="n">Water</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Fighting</span><span
class="p">,</span> <span class="n">Dark</span><span class="p">,</span> <span
class="n">Ice</span><span class="p">,</span> <span class="n">Flying</span><span
class="p">,</span> <span class="n">Psychic</span><span class="p">,</span> <span
class="n">Poison</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Rock</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span
class="n">Water</span><span class="p">]</span> <span
class="o">|</span>
<span class="o">|</span> <span class="n">Ghost</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span
class="p">]</span> <span
class="o">|</span>
<span class="o">|</span> <span class="n">Ice</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">]</span>
<span class="o">|</span>
<span class="o">|</span> <span class="n">Dragon</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">]</span> <span
class="o">|</span>
-<span class="o">|</span> <span class="n">Grass</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span
class="p">,</span> <span class="n">Poison</span><span class="p">]</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="n">Fire</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Dragon</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">]</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="n">Normal</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Fairy</span><span class="p">]</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="n">Poison</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Grass</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span
class="p">,</span> <span class="n">Psychic</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Fire</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Dragon</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Normal</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Fairy</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Poison</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Ground</span><span class="p">]</span>
<span class="o">|</span>
<span class="o">|</span> <span class="n">Ground</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Rock</span><span
class="p">]</span> <span
class="o">|</span>
<span
class="o">+--------+------------------------------------------------+</span>
<span class="n">Data</span> <span class="n">truncated</span><span
class="o">.</span>
@@ -710,15 +710,15 @@ entries entirely removed. The second is we can use the
<code class="docutils lit
<span
class="o">+----------+------------------------------------------------+</span>
<span class="o">|</span> <span class="n">Type</span> <span class="mi">1</span>
<span class="o">|</span> <span class="n">Type</span> <span
class="mi">2</span> <span class="n">List</span>
<span class="o">|</span>
<span
class="o">+----------+------------------------------------------------+</span>
-<span class="o">|</span> <span class="n">Water</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span
class="p">,</span> <span class="n">Fighting</span><span class="p">,</span>
<span class="n">Poison</span><span class="p">,</span> <span
class="n">Ice</span><span class="p">,</span> <span class="n">Flying</span><span
class="p">,</span> <span class="n">Dark</span><span class="p">]</span> <span
class="o">|</span>
-<span class="o">|</span> <span class="n">Rock</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Ground</span><span class="p">,</span> <span
class="n">Water</span><span class="p">]</span> <span
class="o">|</span>
+<span class="o">|</span> <span class="n">Water</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Ice</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span
class="n">Dark</span><span class="p">,</span> <span
class="n">Poison</span><span class="p">,</span> <span
class="n">Psychic</span><span class="p">,</span> <span
class="n">Fighting</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Rock</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span
class="n">Water</span><span class="p">]</span> <span
class="o">|</span>
<span class="o">|</span> <span class="n">Ghost</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span
class="p">]</span> <span
class="o">|</span>
-<span class="o">|</span> <span class="n">Ice</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Psychic</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Ice</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">]</span>
<span class="o">|</span>
<span class="o">|</span> <span class="n">Dragon</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">]</span> <span
class="o">|</span>
<span class="o">|</span> <span class="n">Grass</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span
class="p">,</span> <span class="n">Poison</span><span class="p">]</span>
<span class="o">|</span>
<span class="o">|</span> <span class="n">Fire</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Dragon</span><span class="p">]</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="n">Normal</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Fairy</span><span class="p">]</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="n">Poison</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Normal</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Fairy</span><span
class="p">,</span> <span class="n">Flying</span><span class="p">]</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="n">Poison</span> <span
class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span
class="p">,</span> <span class="n">Ground</span><span class="p">]</span>
<span class="o">|</span>
<span class="o">|</span> <span class="n">Fighting</span> <span
class="o">|</span> <span
class="o">|</span>
<span
class="o">+----------+------------------------------------------------+</span>
<span class="n">Data</span> <span class="n">truncated</span><span
class="o">.</span>
diff --git a/user-guide/common-operations/basic-info.html
b/user-guide/common-operations/basic-info.html
index 2039c2df..93f36f63 100644
--- a/user-guide/common-operations/basic-info.html
+++ b/user-guide/common-operations/basic-info.html
@@ -471,11 +471,11 @@
<span class="o">+-----+---------+--------+--------+</span>
<span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span>
<span class="n">names</span> <span class="o">|</span> <span
class="n">random</span> <span class="o">|</span> <span class="n">groups</span>
<span class="o">|</span>
<span class="o">+-----+---------+--------+--------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span>
<span class="n">python</span> <span class="o">|</span> <span
class="mi">42</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span>
<span class="n">ruby</span> <span class="o">|</span> <span
class="mi">926</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span>
<span class="n">java</span> <span class="o">|</span> <span
class="mi">830</span> <span class="o">|</span> <span class="n">B</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">4</span> <span class="o">|</span>
<span class="n">haskell</span> <span class="o">|</span> <span
class="mi">127</span> <span class="o">|</span> <span class="n">C</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">5</span> <span class="o">|</span>
<span class="n">go</span> <span class="o">|</span> <span
class="mi">103</span> <span class="o">|</span> <span class="n">B</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span>
<span class="n">python</span> <span class="o">|</span> <span
class="mi">923</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span>
<span class="n">ruby</span> <span class="o">|</span> <span
class="mi">786</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span>
<span class="n">java</span> <span class="o">|</span> <span
class="mi">284</span> <span class="o">|</span> <span class="n">B</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">4</span> <span class="o">|</span>
<span class="n">haskell</span> <span class="o">|</span> <span
class="mi">130</span> <span class="o">|</span> <span class="n">C</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">5</span> <span class="o">|</span>
<span class="n">go</span> <span class="o">|</span> <span
class="mi">48</span> <span class="o">|</span> <span class="n">B</span>
<span class="o">|</span>
<span class="o">+-----+---------+--------+--------+</span>
</pre></div>
</div>
@@ -486,8 +486,8 @@
<span class="o">+-----+--------+--------+--------+</span>
<span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span>
<span class="n">names</span> <span class="o">|</span> <span
class="n">random</span> <span class="o">|</span> <span class="n">groups</span>
<span class="o">|</span>
<span class="o">+-----+--------+--------+--------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span>
<span class="n">python</span> <span class="o">|</span> <span
class="mi">42</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
-<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span>
<span class="n">ruby</span> <span class="o">|</span> <span
class="mi">926</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span>
<span class="n">python</span> <span class="o">|</span> <span
class="mi">923</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span>
<span class="n">ruby</span> <span class="o">|</span> <span
class="mi">786</span> <span class="o">|</span> <span class="n">A</span>
<span class="o">|</span>
<span class="o">+-----+--------+--------+--------+</span>
</pre></div>
</div>
@@ -505,28 +505,28 @@ passing them to an Arrow table, and then converting them
to a pandas DataFrame.<
<div class="highlight-ipython notranslate"><div
class="highlight"><pre><span></span><span class="n">In</span> <span
class="p">[</span><span class="mi">8</span><span class="p">]:</span> <span
class="n">df</span><span class="o">.</span><span
class="n">to_pandas</span><span class="p">()</span>
<span class="n">Out</span><span class="p">[</span><span
class="mi">8</span><span class="p">]:</span>
<span class="n">nrs</span> <span class="n">names</span> <span
class="n">random</span> <span class="n">groups</span>
-<span class="mi">0</span> <span class="mi">1</span> <span
class="n">python</span> <span class="mi">42</span> <span
class="n">A</span>
-<span class="mi">1</span> <span class="mi">2</span> <span
class="n">ruby</span> <span class="mi">926</span> <span
class="n">A</span>
-<span class="mi">2</span> <span class="mi">3</span> <span
class="n">java</span> <span class="mi">830</span> <span
class="n">B</span>
-<span class="mi">3</span> <span class="mi">4</span> <span
class="n">haskell</span> <span class="mi">127</span> <span
class="n">C</span>
-<span class="mi">4</span> <span class="mi">5</span> <span
class="n">go</span> <span class="mi">103</span> <span
class="n">B</span>
+<span class="mi">0</span> <span class="mi">1</span> <span
class="n">python</span> <span class="mi">923</span> <span
class="n">A</span>
+<span class="mi">1</span> <span class="mi">2</span> <span
class="n">ruby</span> <span class="mi">786</span> <span
class="n">A</span>
+<span class="mi">2</span> <span class="mi">3</span> <span
class="n">java</span> <span class="mi">284</span> <span
class="n">B</span>
+<span class="mi">3</span> <span class="mi">4</span> <span
class="n">haskell</span> <span class="mi">130</span> <span
class="n">C</span>
+<span class="mi">4</span> <span class="mi">5</span> <span
class="n">go</span> <span class="mi">48</span> <span
class="n">B</span>
</pre></div>
</div>
<p><a class="reference internal"
href="../../autoapi/datafusion/dataframe/index.html#datafusion.dataframe.DataFrame.describe"
title="datafusion.dataframe.DataFrame.describe"><code class="xref py py-func
docutils literal notranslate"><span class="pre">describe()</span></code></a>
shows a quick statistic summary of your data:</p>
<div class="highlight-ipython notranslate"><div
class="highlight"><pre><span></span><span class="n">In</span> <span
class="p">[</span><span class="mi">9</span><span class="p">]:</span> <span
class="n">df</span><span class="o">.</span><span class="n">describe</span><span
class="p">()</span>
<span class="n">Out</span><span class="p">[</span><span
class="mi">9</span><span class="p">]:</span>
<span class="n">DataFrame</span><span class="p">()</span>
-<span
class="o">+------------+--------------------+-------+------------------+--------+</span>
-<span class="o">|</span> <span class="n">describe</span> <span
class="o">|</span> <span class="n">nrs</span> <span
class="o">|</span> <span class="n">names</span> <span class="o">|</span> <span
class="n">random</span> <span class="o">|</span> <span
class="n">groups</span> <span class="o">|</span>
-<span
class="o">+------------+--------------------+-------+------------------+--------+</span>
-<span class="o">|</span> <span class="n">count</span> <span
class="o">|</span> <span class="mf">5.0</span> <span
class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span
class="mf">5.0</span> <span class="o">|</span> <span
class="mi">5</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">null_count</span> <span
class="o">|</span> <span class="mf">0.0</span> <span
class="o">|</span> <span class="mi">0</span> <span class="o">|</span> <span
class="mf">0.0</span> <span class="o">|</span> <span
class="mi">0</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">mean</span> <span
class="o">|</span> <span class="mf">3.0</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">405.6</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">std</span> <span
class="o">|</span> <span class="mf">1.5811388300841898</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">433.682256957787</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
-<span class="o">|</span> <span class="nb">min</span> <span
class="o">|</span> <span class="mf">1.0</span> <span
class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span
class="mf">42.0</span> <span class="o">|</span> <span
class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="nb">max</span> <span
class="o">|</span> <span class="mf">5.0</span> <span
class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span
class="mf">926.0</span> <span class="o">|</span> <span
class="n">C</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">median</span> <span
class="o">|</span> <span class="mf">3.0</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">127.0</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
-<span
class="o">+------------+--------------------+-------+------------------+--------+</span>
+<span
class="o">+------------+--------------------+-------+--------------------+--------+</span>
+<span class="o">|</span> <span class="n">describe</span> <span
class="o">|</span> <span class="n">nrs</span> <span
class="o">|</span> <span class="n">names</span> <span class="o">|</span> <span
class="n">random</span> <span class="o">|</span> <span
class="n">groups</span> <span class="o">|</span>
+<span
class="o">+------------+--------------------+-------+--------------------+--------+</span>
+<span class="o">|</span> <span class="n">count</span> <span
class="o">|</span> <span class="mf">5.0</span> <span
class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span
class="mf">5.0</span> <span class="o">|</span> <span
class="mi">5</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">null_count</span> <span
class="o">|</span> <span class="mf">0.0</span> <span
class="o">|</span> <span class="mi">0</span> <span class="o">|</span> <span
class="mf">0.0</span> <span class="o">|</span> <span
class="mi">0</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">mean</span> <span
class="o">|</span> <span class="mf">3.0</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">434.2</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">std</span> <span
class="o">|</span> <span class="mf">1.5811388300841898</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">395.89670369933623</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="nb">min</span> <span
class="o">|</span> <span class="mf">1.0</span> <span
class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span
class="mf">48.0</span> <span class="o">|</span> <span
class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="nb">max</span> <span
class="o">|</span> <span class="mf">5.0</span> <span
class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span
class="mf">923.0</span> <span class="o">|</span> <span
class="n">C</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">median</span> <span
class="o">|</span> <span class="mf">3.0</span> <span
class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span
class="mf">284.0</span> <span class="o">|</span> <span
class="n">null</span> <span class="o">|</span>
+<span
class="o">+------------+--------------------+-------+--------------------+--------+</span>
</pre></div>
</div>
</section>
diff --git a/user-guide/common-operations/functions.html
b/user-guide/common-operations/functions.html
index 13f0ac29..f0668bf2 100644
--- a/user-guide/common-operations/functions.html
+++ b/user-guide/common-operations/functions.html
@@ -581,16 +581,16 @@ In here we will cover some of the more popular use cases.
If you want to view al
<span class="o">+-------------------------------+</span>
<span class="o">|</span> <span class="n">now</span><span class="p">()</span>
<span class="o">|</span>
<span class="o">+-------------------------------+</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">04</span><span class="n">T12</span><span class="p">:</span><span
class="mi">47</span><span class="p">:</span><span
class="mf">55.489431747</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2026</span><span
class="o">-</span><span class="mi">06</span><span class="o">-</span><span
class="mi">05</span><span class="n">T16</span><span class="p">:</span><span
class="mi">37</span><span class="p">:</span><span
class="mf">43.169581510</span> <span class="o">|</span>
<span class="o">+-------------------------------+</span>
<span class="n">Data</span> <span class="n">truncated</span><span
class="o">.</span>
</pre></div>
diff --git a/user-guide/common-operations/udf-and-udfa.html
b/user-guide/common-operations/udf-and-udfa.html
index 705344e5..526d5aac 100644
--- a/user-guide/common-operations/udf-and-udfa.html
+++ b/user-guide/common-operations/udf-and-udfa.html
@@ -661,7 +661,7 @@ over column references and literals, so the optimizer can
analyze it:</p>
<span class="n">In</span> <span class="p">[</span><span
class="mi">29</span><span class="p">]:</span> <span
class="nb">print</span><span class="p">(</span><span
class="n">native_filtered</span><span class="o">.</span><span
class="n">execution_plan</span><span class="p">()</span><span
class="o">.</span><span class="n">display_indent</span><span
class="p">())</span>
<span class="n">FilterExec</span><span class="p">:</span> <span
class="n">brand</span><span class="o">@</span><span class="mi">1</span> <span
class="o">=</span> <span class="n">A</span> <span class="n">AND</span> <span
class="n">qty</span><span class="o">@</span><span class="mi">2</span> <span
class="o">>=</span> <span class="mi">150</span>
<span class="n">RepartitionExec</span><span class="p">:</span> <span
class="n">partitioning</span><span class="o">=</span><span
class="n">RoundRobinBatch</span><span class="p">(</span><span
class="mi">4</span><span class="p">),</span> <span
class="n">input_partitions</span><span class="o">=</span><span
class="mi">1</span>
- <span class="n">DataSourceExec</span><span class="p">:</span> <span
class="n">file_groups</span><span class="o">=</span><span
class="p">{</span><span class="mi">1</span> <span class="n">group</span><span
class="p">:</span> <span class="p">[[</span><span class="n">tmp</span><span
class="o">/</span><span class="n">tmpupbc1umq</span><span
class="o">/</span><span class="n">items</span><span class="o">.</span><span
class="n">parquet</span><span class="p">]]},</span> <span class="n">projec [...]
+ <span class="n">DataSourceExec</span><span class="p">:</span> <span
class="n">file_groups</span><span class="o">=</span><span
class="p">{</span><span class="mi">1</span> <span class="n">group</span><span
class="p">:</span> <span class="p">[[</span><span class="n">tmp</span><span
class="o">/</span><span class="n">tmpbhn52lvp</span><span
class="o">/</span><span class="n">items</span><span class="o">.</span><span
class="n">parquet</span><span class="p">]]},</span> <span class="n">projec [...]
</pre></div>
</div>
<p>Notice the <code class="docutils literal notranslate"><span
class="pre">DataSourceExec</span></code> line. It carries three annotations the
@@ -694,7 +694,7 @@ bloom filter or dictionary is available to skip
pages.</p></li>
<span class="n">In</span> <span class="p">[</span><span
class="mi">33</span><span class="p">]:</span> <span
class="nb">print</span><span class="p">(</span><span
class="n">udf_filtered</span><span class="o">.</span><span
class="n">execution_plan</span><span class="p">()</span><span
class="o">.</span><span class="n">display_indent</span><span
class="p">())</span>
<span class="n">FilterExec</span><span class="p">:</span> <span
class="n">brand_qty_filter</span><span class="p">(</span><span
class="n">CAST</span><span class="p">(</span><span class="n">brand</span><span
class="o">@</span><span class="mi">1</span> <span class="n">AS</span> <span
class="n">Utf8</span><span class="p">),</span> <span class="n">qty</span><span
class="o">@</span><span class="mi">2</span><span class="p">)</span>
<span class="n">RepartitionExec</span><span class="p">:</span> <span
class="n">partitioning</span><span class="o">=</span><span
class="n">RoundRobinBatch</span><span class="p">(</span><span
class="mi">4</span><span class="p">),</span> <span
class="n">input_partitions</span><span class="o">=</span><span
class="mi">1</span>
- <span class="n">DataSourceExec</span><span class="p">:</span> <span
class="n">file_groups</span><span class="o">=</span><span
class="p">{</span><span class="mi">1</span> <span class="n">group</span><span
class="p">:</span> <span class="p">[[</span><span class="n">tmp</span><span
class="o">/</span><span class="n">tmpupbc1umq</span><span
class="o">/</span><span class="n">items</span><span class="o">.</span><span
class="n">parquet</span><span class="p">]]},</span> <span class="n">projec [...]
+ <span class="n">DataSourceExec</span><span class="p">:</span> <span
class="n">file_groups</span><span class="o">=</span><span
class="p">{</span><span class="mi">1</span> <span class="n">group</span><span
class="p">:</span> <span class="p">[[</span><span class="n">tmp</span><span
class="o">/</span><span class="n">tmpbhn52lvp</span><span
class="o">/</span><span class="n">items</span><span class="o">.</span><span
class="n">parquet</span><span class="p">]]},</span> <span class="n">projec [...]
</pre></div>
</div>
<p>The <code class="docutils literal notranslate"><span
class="pre">DataSourceExec</span></code> now carries only <code class="docutils
literal notranslate"><span
class="pre">predicate=brand_qty_filter(...)</span></code>.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
