This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
The following commit(s) were added to refs/heads/asf-site by this push:
new a60eca6f91 Publish built docs triggered by
0414b9f1a030c7bd16700490b3d65c36b2529874
a60eca6f91 is described below
commit a60eca6f911c0ab9cb3a79fc0b672a87b2b6bccb
Author: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
AuthorDate: Wed Jan 31 07:19:34 2024 +0000
Publish built docs triggered by 0414b9f1a030c7bd16700490b3d65c36b2529874
---
_sources/user-guide/sql/ddl.md.txt | 12 +++++++++++-
searchindex.js | 2 +-
user-guide/sql/ddl.html | 9 ++++++++-
3 files changed, 20 insertions(+), 3 deletions(-)
diff --git a/_sources/user-guide/sql/ddl.md.txt
b/_sources/user-guide/sql/ddl.md.txt
index b67d323126..81e62efbeb 100644
--- a/_sources/user-guide/sql/ddl.md.txt
+++ b/_sources/user-guide/sql/ddl.md.txt
@@ -56,7 +56,7 @@ file system or remote object store as a named table which can
be queried.
The supported syntax is:
```
-CREATE EXTERNAL TABLE
+CREATE [UNBOUNDED] EXTERNAL TABLE
[ IF NOT EXISTS ]
<TABLE_NAME>[ (<column_definition>) ]
STORED AS <file_type>
@@ -147,6 +147,16 @@ WITH HEADER ROW
LOCATION '/path/to/directory/of/files';
```
+With `CREATE UNBOUNDED EXTERNAL TABLE` SQL statement. We can create unbounded
data sources such as following:
+
+```sql
+CREATE UNBOUNDED EXTERNAL TABLE taxi
+STORED AS PARQUET
+LOCATION '/mnt/nyctaxi/tripdata.parquet';
+```
+
+Note that this statement actually reads data from a fixed-size file, so a
better example would involve reading from a FIFO file. Nevertheless, once
Datafusion sees the `UNBOUNDED` keyword in a data source, it tries to execute
queries that refer to this unbounded source in streaming fashion. If this is
not possible according to query specifications, plan generation fails stating
it is not possible to execute given query in streaming fashion. Note that
queries that can run with unbounded s [...]
+
When creating an output from a data source that is already ordered by
an expression, you can pre-specify the order of the data using the
`WITH ORDER` clause. This applies even if the expression used for
diff --git a/searchindex.js b/searchindex.js
index 1aeb2884ea..cb568bca2f 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"docnames": ["contributor-guide/architecture",
"contributor-guide/communication", "contributor-guide/index",
"contributor-guide/quarterly_roadmap", "contributor-guide/roadmap",
"contributor-guide/specification/index",
"contributor-guide/specification/invariants",
"contributor-guide/specification/output-field-name-semantic", "index",
"library-user-guide/adding-udfs", "library-user-guide/building-logical-plans",
"library-user-guide/catalogs", "library-user-guide/custom-tab [...]
\ No newline at end of file
+Search.setIndex({"docnames": ["contributor-guide/architecture",
"contributor-guide/communication", "contributor-guide/index",
"contributor-guide/quarterly_roadmap", "contributor-guide/roadmap",
"contributor-guide/specification/index",
"contributor-guide/specification/invariants",
"contributor-guide/specification/output-field-name-semantic", "index",
"library-user-guide/adding-udfs", "library-user-guide/building-logical-plans",
"library-user-guide/catalogs", "library-user-guide/custom-tab [...]
\ No newline at end of file
diff --git a/user-guide/sql/ddl.html b/user-guide/sql/ddl.html
index 55bf3af75b..6c7250c05c 100644
--- a/user-guide/sql/ddl.html
+++ b/user-guide/sql/ddl.html
@@ -471,7 +471,7 @@ CREATE SCHEMA [ IF NOT EXISTS ] [ <i><b>catalog.</i></b> ]
<b><i>schema_name</i>
<p><code class="docutils literal notranslate"><span class="pre">CREATE</span>
<span class="pre">EXTERNAL</span> <span class="pre">TABLE</span></code> SQL
statement registers a location on a local
file system or remote object store as a named table which can be queried.</p>
<p>The supported syntax is:</p>
-<div class="highlight-default notranslate"><div
class="highlight"><pre><span></span><span class="n">CREATE</span> <span
class="n">EXTERNAL</span> <span class="n">TABLE</span>
+<div class="highlight-default notranslate"><div
class="highlight"><pre><span></span><span class="n">CREATE</span> <span
class="p">[</span><span class="n">UNBOUNDED</span><span class="p">]</span>
<span class="n">EXTERNAL</span> <span class="n">TABLE</span>
<span class="p">[</span> <span class="n">IF</span> <span class="n">NOT</span>
<span class="n">EXISTS</span> <span class="p">]</span>
<span class="o"><</span><span class="n">TABLE_NAME</span><span
class="o">></span><span class="p">[</span> <span class="p">(</span><span
class="o"><</span><span class="n">column_definition</span><span
class="o">></span><span class="p">)</span> <span class="p">]</span>
<span class="n">STORED</span> <span class="n">AS</span> <span
class="o"><</span><span class="n">file_type</span><span class="o">></span>
@@ -549,6 +549,13 @@ table (multiple files with the same schema)</p>
<span class="k">LOCATION</span><span class="w"> </span><span
class="s1">'/path/to/directory/of/files'</span><span class="p">;</span>
</pre></div>
</div>
+<p>With <code class="docutils literal notranslate"><span
class="pre">CREATE</span> <span class="pre">UNBOUNDED</span> <span
class="pre">EXTERNAL</span> <span class="pre">TABLE</span></code> SQL
statement. We can create unbounded data sources such as following:</p>
+<div class="highlight-sql notranslate"><div
class="highlight"><pre><span></span><span class="k">CREATE</span><span
class="w"> </span><span class="n">UNBOUNDED</span><span class="w"> </span><span
class="k">EXTERNAL</span><span class="w"> </span><span
class="k">TABLE</span><span class="w"> </span><span class="n">taxi</span>
+<span class="n">STORED</span><span class="w"> </span><span
class="k">AS</span><span class="w"> </span><span class="n">PARQUET</span>
+<span class="k">LOCATION</span><span class="w"> </span><span
class="s1">'/mnt/nyctaxi/tripdata.parquet'</span><span
class="p">;</span>
+</pre></div>
+</div>
+<p>Note that this statement actually reads data from a fixed-size file, so a
better example would involve reading from a FIFO file. Nevertheless, once
Datafusion sees the <code class="docutils literal notranslate"><span
class="pre">UNBOUNDED</span></code> keyword in a data source, it tries to
execute queries that refer to this unbounded source in streaming fashion. If
this is not possible according to query specifications, plan generation fails
stating it is not possible to execute given [...]
<p>When creating an output from a data source that is already ordered by
an expression, you can pre-specify the order of the data using the
<code class="docutils literal notranslate"><span class="pre">WITH</span> <span
class="pre">ORDER</span></code> clause. This applies even if the expression
used for
