This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/iceberg-docs.git
The following commit(s) were added to refs/heads/asf-site by this push:
new ad7e9404 deploy: 581063a4c4ec86ab188c0e783decf0280706b62f
ad7e9404 is described below
commit ad7e9404f062cbdd1c83188c6d16b81182c0516c
Author: rdblue <[email protected]>
AuthorDate: Wed Jul 20 02:16:29 2022 +0000
deploy: 581063a4c4ec86ab188c0e783decf0280706b62f
---
docs/0.14.0/api/index.html | 10 +++++-----
docs/0.14.0/aws/index.html | 10 +++++-----
docs/0.14.0/configuration/index.html | 2 +-
docs/0.14.0/custom-catalog/index.html | 2 +-
docs/0.14.0/evolution/index.html | 2 +-
docs/0.14.0/flink-connector/index.html | 2 +-
docs/0.14.0/flink/index.html | 8 ++++----
docs/0.14.0/getting-started/index.html | 8 ++++----
docs/0.14.0/hive/index.html | 4 ++--
docs/0.14.0/index.html | 2 +-
docs/0.14.0/index.xml | 2 +-
docs/0.14.0/java-api-quickstart/index.html | 4 ++--
docs/0.14.0/jdbc/index.html | 4 ++--
docs/0.14.0/maintenance/index.html | 12 ++++++------
docs/0.14.0/nessie/index.html | 8 ++++----
docs/0.14.0/partitioning/index.html | 2 +-
docs/0.14.0/performance/index.html | 2 +-
docs/0.14.0/python-api-intro/index.html | 2 +-
docs/0.14.0/python-feature-support/index.html | 2 +-
docs/0.14.0/python-quickstart/index.html | 2 +-
docs/0.14.0/reliability/index.html | 2 +-
docs/0.14.0/schemas/index.html | 2 +-
docs/0.14.0/search.json | 2 +-
docs/0.14.0/spark-configuration/index.html | 2 +-
docs/0.14.0/spark-ddl/index.html | 2 +-
docs/0.14.0/spark-procedures/index.html | 8 ++++----
docs/0.14.0/spark-queries/index.html | 2 +-
docs/0.14.0/spark-structured-streaming/index.html | 2 +-
docs/0.14.0/spark-writes/index.html | 2 +-
29 files changed, 57 insertions(+), 57 deletions(-)
diff --git a/docs/0.14.0/api/index.html b/docs/0.14.0/api/index.html
index 7375e208..4eede34b 100644
--- a/docs/0.14.0/api/index.html
+++ b/docs/0.14.0/api/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations
class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a
href=../jdbc/>JDBC</a></li><li><a
href=../nessie/>Nessie</a></li></ul></div><li><a class=chevron-toggle
data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul
class=sub-menu><li><a href=../java-api-quickstart/>Java
Quickstart</a></li><li><a id=active href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul
class=sub-menu><li><a href=../java-api-quickstart/>Java
Quickstart</a></li><li><a id=active href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
</span></span></code></pre></div><p>To configure a scan, call
<code>filter</code> and <code>select</code> on the <code>TableScan</code> to
get a new <code>TableScan</code> with those changes.</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-java data-lang=java><span style=display:flex><span>TableScan
filteredScan <span style=color:#f92672>=</span> scan<span
style=color:#f92672>.</span><span [...]
</span></span></code></pre></div><p>Calls to configuration methods create a
new <code>TableScan</code> so that each <code>TableScan</code> is immutable and
won’t change unexpectedly if shared across threads.</p><p>When a scan is
configured, <code>planFiles</code>, <code>planTasks</code>, and
<code>schema</code> are used to return files, tasks, and the read
projection.</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;
[...]
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>filter</span><span
style=color:#f92672>(</span>Expressions<span style=color:#f92672>.</span><span
style=color:#a6e22e>equal</span><span style=color:#f92672>(</span><span
style=color:#e6db74>"id"</span><span style=color:#f92672>,</span>
5<span style=color:#f92672>))</span>
@@ -26,7 +26,7 @@
</span></span></code></pre></div><p>When a scan is configured, call method
<code>build</code> to execute scan. <code>build</code> return
<code>CloseableIterable<Record></code></p><div class=highlight><pre
tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-java data-lang=java><span
style=display:flex><span>CloseableIterable<span
style=color:#f92672><</span>Record<span style=color:#f92672>></span>
result <span styl [...]
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>where</span><span
style=color:#f92672>(</span>Expressions<span style=color:#f92672>.</span><span
style=color:#a6e22e>lessThan</span><span style=color:#f92672>(</span><span
style=color:#e6db74>"id"</span><span style=color:#f92672>,</span>
5<span style=color:#f92672>))</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>build</span><span
style=color:#f92672>();</span>
-</span></span></code></pre></div><p>where <code>Record</code> is Iceberg
record for iceberg-data module
<code>org.apache.iceberg.data.Record</code>.</p><h3 id=update-operations>Update
operations</h3><p><code>Table</code> also exposes operations that update the
table. These operations use a builder pattern, <a
href=../../../javadoc/0.13.2/index.html?org/apache/iceberg/PendingUpdate.html><code>PendingUpdate</code></a>,
that commits when <code>PendingUpdate#commit</code> is called.</p><p>Fo [...]
+</span></span></code></pre></div><p>where <code>Record</code> is Iceberg
record for iceberg-data module
<code>org.apache.iceberg.data.Record</code>.</p><h3 id=update-operations>Update
operations</h3><p><code>Table</code> also exposes operations that update the
table. These operations use a builder pattern, <a
href=../../../javadoc/0.14.0/index.html?org/apache/iceberg/PendingUpdate.html><code>PendingUpdate</code></a>,
that commits when <code>PendingUpdate#commit</code> is called.</p><p>Fo [...]
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>addColumn</span><span
style=color:#f92672>(</span><span
style=color:#e6db74>"count"</span><span style=color:#f92672>,</span>
Types<span style=color:#f92672>.</span><span
style=color:#a6e22e>LongType</span><span style=color:#f92672>.</span><span
style=color:#a6e22e>get</span><span style=color:#f92672>())</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>commit</span><span
style=color:#f92672>();</span>
</span></span></code></pre></div><p>Available operations to update a table
are:</p><ul><li><code>updateSchema</code> – update the table
schema</li><li><code>updateProperties</code> – update table
properties</li><li><code>updateLocation</code> – update the table’s
base location</li><li><code>newAppend</code> – used to append data
files</li><li><code>newFastAppend</code> – used to append data files,
will not compact metadata</li><li><code>newOverwrite</c [...]
@@ -37,7 +37,7 @@
</span></span><span style=display:flex><span>
</span></span><span style=display:flex><span><span style=color:#75715e>//
commit all the changes to the table
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span>t<span style=color:#f92672>.</span><span
style=color:#a6e22e>commitTransaction</span><span style=color:#f92672>();</span>
-</span></span></code></pre></div><h2 id=types>Types</h2><p>Iceberg data types
are located in the <a
href=../../../javadoc/0.13.2/index.html?org/apache/iceberg/types/package-summary.html><code>org.apache.iceberg.types</code>
package</a>.</p><h3 id=primitives>Primitives</h3><p>Primitive type instances
are available from static methods in each type class. Types without parameters
use <code>get</code>, and types like <code>decimal</code> use factory
methods:</p><div class=highlight><pre tabi [...]
+</span></span></code></pre></div><h2 id=types>Types</h2><p>Iceberg data types
are located in the <a
href=../../../javadoc/0.14.0/index.html?org/apache/iceberg/types/package-summary.html><code>org.apache.iceberg.types</code>
package</a>.</p><h3 id=primitives>Primitives</h3><p>Primitive type instances
are available from static methods in each type class. Types without parameters
use <code>get</code>, and types like <code>decimal</code> use factory
methods:</p><div class=highlight><pre tabi [...]
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span>Types<span style=color:#f92672>.</span><span
style=color:#a6e22e>DoubleType</span><span style=color:#f92672>.</span><span
style=color:#a6e22e>get</span><span style=color:#f92672>()</span> <span
style=color:#75715e>// double
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span>Types<span style=color:#f92672>.</span><span
style=color:#a6e22e>DecimalType</span><span style=color:#f92672>.</span><span
style=color:#a6e22e>of</span><span style=color:#f92672>(</span>9<span
style=color:#f92672>,</span> 2<span style=color:#f92672>)</span> <span
style=color:#75715e>// decimal(9, 2)
</span></span></span></code></pre></div><h3 id=nested-types>Nested
types</h3><p>Structs, maps, and lists are created using factory methods in type
classes.</p><p>Like struct fields, map keys or values and list elements are
tracked as nested fields. Nested fields track <a
href=../evolution#correctness>field IDs</a> and nullability.</p><p>Struct
fields are created using <code>NestedField.optional</code> or
<code>NestedField.required</code>. Map value and list element nullability is
set in [...]
@@ -53,7 +53,7 @@
</span></span><span style=display:flex><span> <span
style=color:#f92672>)</span>
</span></span></code></pre></div><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-java data-lang=java><span style=display:flex><span><span
style=color:#75715e>// array<1 element: int>
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span>ListType list <span style=color:#f92672>=</span>
ListType<span style=color:#f92672>.</span><span
style=color:#a6e22e>ofRequired</span><span style=color:#f92672>(</span>1<span
style=color:#f92672>,</span> IntegerType<span style=color:#f92672>.</span><span
style=color:#a6e22e>get</span><span style=color:#f92672>());</span>
-</span></span></code></pre></div><h2
id=expressions>Expressions</h2><p>Iceberg’s expressions are used to
configure table scans. To create expressions, use the factory methods in <a
href=../../../javadoc/0.13.2/index.html?org/apache/iceberg/expressions/Expressions.html><code>Expressions</code></a>.</p><p>Supported
predicate expressions
are:</p><ul><li><code>isNull</code></li><li><code>notNull</code></li><li><code>equal</code></li><li><code>notEqual</code></li><li><code>lessThan</cod
[...]
+</span></span></code></pre></div><h2
id=expressions>Expressions</h2><p>Iceberg’s expressions are used to
configure table scans. To create expressions, use the factory methods in <a
href=../../../javadoc/0.14.0/index.html?org/apache/iceberg/expressions/Expressions.html><code>Expressions</code></a>.</p><p>Supported
predicate expressions
are:</p><ul><li><code>isNull</code></li><li><code>notNull</code></li><li><code>equal</code></li><li><code>notEqual</code></li><li><code>lessThan</cod
[...]
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>filter</span><span
style=color:#f92672>(</span>Expressions<span style=color:#f92672>.</span><span
style=color:#a6e22e>greaterThanOrEqual</span><span
style=color:#f92672>(</span><span style=color:#e6db74>"x"</span><span
style=color:#f92672>,</span> 5<span style=color:#f92672>))</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>filter</span><span
style=color:#f92672>(</span>Expressions<span style=color:#f92672>.</span><span
style=color:#a6e22e>lessThan</span><span style=color:#f92672>(</span><span
style=color:#e6db74>"x"</span><span style=color:#f92672>,</span>
10<span style=color:#f92672>))</span>
</span></span></code></pre></div><h2 id=modules>Modules</h2><p>Iceberg table
support is organized in library modules:</p><ul><li><code>iceberg-common</code>
contains utility classes used in other modules</li><li><code>iceberg-api</code>
contains the public Iceberg API, including expressions, types, tables, and
operations</li><li><code>iceberg-arrow</code> is an implementation of the
Iceberg type system for reading and writing data stored in Iceberg tables using
Apache Arrow as the in-mem [...]
diff --git a/docs/0.14.0/aws/index.html b/docs/0.14.0/aws/index.html
index 5bc91b78..1fa88978 100644
--- a/docs/0.14.0/aws/index.html
+++ b/docs/0.14.0/aws/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -25,7 +25,7 @@ To choose a different HTTP client library such as <a
href=https://mvnrepository.
see the section <a href=#aws-client-customization>client customization</a> for
more details.</p><p>All the AWS module features can be loaded through custom
catalog properties,
you can go to the documentations of each engine to see how to load a custom
catalog.
Here are some examples.</p><h3 id=spark>Spark</h3><p>For example, to use AWS
features with Spark 3.0 and AWS clients version 2.17.131, you can start the
Spark SQL shell with:</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sh data-lang=sh><span style=display:flex><span><span
style=color:#75715e># add Iceberg dependency</span>
-</span></span><span style=display:flex><span>ICEBERG_VERSION<span
style=color:#f92672>=</span>0.13.2
+</span></span><span style=display:flex><span>ICEBERG_VERSION<span
style=color:#f92672>=</span>0.14.0
</span></span><span style=display:flex><span>DEPENDENCIES<span
style=color:#f92672>=</span><span
style=color:#e6db74>"org.apache.iceberg:iceberg-spark3-runtime:</span>$ICEBERG_VERSION<span
style=color:#e6db74>"</span>
</span></span><span style=display:flex><span>
</span></span><span style=display:flex><span><span style=color:#75715e># add
AWS dependnecy</span>
@@ -46,7 +46,7 @@ Here are some examples.</p><h3 id=spark>Spark</h3><p>For
example, to use AWS fea
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf
spark.sql.catalog.my_catalog.catalog-impl<span
style=color:#f92672>=</span>org.apache.iceberg.aws.glue.GlueCatalog <span
style=color:#ae81ff>\
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf spark.sql.catalog.my_catalog.io-impl<span
style=color:#f92672>=</span>org.apache.iceberg.aws.s3.S3FileIO
</span></span></code></pre></div><p>As you can see, In the shell command, we
use <code>--packages</code> to specify the additional AWS bundle and HTTP
client dependencies with their version as <code>2.17.131</code>.</p><h3
id=flink>Flink</h3><p>To use AWS module with Flink, you can download the
necessary dependencies and specify them when starting the Flink SQL
client:</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-s
[...]
-</span></span><span style=display:flex><span>ICEBERG_VERSION<span
style=color:#f92672>=</span>0.13.2
+</span></span><span style=display:flex><span>ICEBERG_VERSION<span
style=color:#f92672>=</span>0.14.0
</span></span><span style=display:flex><span>MAVEN_URL<span
style=color:#f92672>=</span>https://repo1.maven.org/maven2
</span></span><span style=display:flex><span>ICEBERG_MAVEN_URL<span
style=color:#f92672>=</span>$MAVEN_URL/org/apache/iceberg
</span></span><span style=display:flex><span>wget
$ICEBERG_MAVEN_URL/iceberg-flink-runtime/$ICEBERG_VERSION/iceberg-flink-runtime-$ICEBERG_VERSION.jar
@@ -213,7 +213,7 @@ In this case, a <a
href=https://docs.aws.amazon.com/IAM/latest/UserGuide/id_role
Iceberg provides an AWS client factory <code>AssumeRoleAwsClientFactory</code>
to support this common use case.
This also serves as an example for users who would like to implement their own
AWS client factory.</p><p>This client factory has the following configurable
catalog
properties:</p><table><thead><tr><th>Property</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td>client.assume-role.arn</td><td>null,
requires user input</td><td>ARN of the role to assume, e.g.
arn:aws:iam::123456789:role/myRoleToAssume</td></tr><tr><td>client.assume-role.region</td><td>null,
requires user inp [...]
The Glue, S3 and DynamoDB clients are then initialized with the assume-role
credential and region to access resources.
-Here is an example to start Spark shell with this client factory:</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-shell data-lang=shell><span style=display:flex><span>spark-sql
--packages
org.apache.iceberg:iceberg-spark3-runtime:0.13.2,software.amazon.awssdk:bundle:2.17.131
<span style=color:#ae81ff>\
+Here is an example to start Spark shell with this client factory:</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-shell data-lang=shell><span style=display:flex><span>spark-sql
--packages
org.apache.iceberg:iceberg-spark3-runtime:0.14.0,software.amazon.awssdk:bundle:2.17.131
<span style=color:#ae81ff>\
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf spark.sql.catalog.my_catalog<span
style=color:#f92672>=</span>org.apache.iceberg.spark.SparkCatalog <span
style=color:#ae81ff>\
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf
spark.sql.catalog.my_catalog.warehouse<span
style=color:#f92672>=</span>s3://my-bucket/my/key/prefix <span
style=color:#ae81ff>\ </span>
</span></span><span style=display:flex><span> --conf
spark.sql.catalog.my_catalog.catalog-impl<span
style=color:#f92672>=</span>org.apache.iceberg.aws.glue.GlueCatalog <span
style=color:#ae81ff>\
@@ -227,7 +227,7 @@ More details could be found <a
href=https://docs.aws.amazon.com/athena/latest/ug
Please refer to the <a
href=https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-iceberg-use-cluster.html>official
documentation</a> on how to create a cluster with Iceberg installed.</p><p>For
versions before 6.5.0, you can use a <a
href=https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-bootstrap.html>bootstrap
action</a> similar to the following to pre-install all necessary
dependencies:</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#2728 [...]
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span>
</span></span><span style=display:flex><span>AWS_SDK_VERSION<span
style=color:#f92672>=</span>2.17.131
-</span></span><span style=display:flex><span>ICEBERG_VERSION<span
style=color:#f92672>=</span>0.13.2
+</span></span><span style=display:flex><span>ICEBERG_VERSION<span
style=color:#f92672>=</span>0.14.0
</span></span><span style=display:flex><span>MAVEN_URL<span
style=color:#f92672>=</span>https://repo1.maven.org/maven2
</span></span><span style=display:flex><span>ICEBERG_MAVEN_URL<span
style=color:#f92672>=</span>$MAVEN_URL/org/apache/iceberg
</span></span><span style=display:flex><span>AWS_MAVEN_URL<span
style=color:#f92672>=</span>$MAVEN_URL/software/amazon/awssdk
diff --git a/docs/0.14.0/configuration/index.html
b/docs/0.14.0/configuration/index.html
index afe0c555..a530d053 100644
--- a/docs/0.14.0/configuration/index.html
+++ b/docs/0.14.0/configuration/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse
in"><ul class=sub-menu><li><a id=active
href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/custom-catalog/index.html
b/docs/0.14.0/custom-catalog/index.html
index d31c7dc8..ab630aa9 100644
--- a/docs/0.14.0/custom-catalog/index.html
+++ b/docs/0.14.0/custom-catalog/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/evolution/index.html b/docs/0.14.0/evolution/index.html
index 82df8ec3..3f9cb557 100644
--- a/docs/0.14.0/evolution/index.html
+++ b/docs/0.14.0/evolution/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse
in"><ul class=sub-menu><li><a
href=../configuration/>Configuration</a></li><li><a id=active
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/flink-connector/index.html
b/docs/0.14.0/flink-connector/index.html
index cb3debd2..ced68c08 100644
--- a/docs/0.14.0/flink-connector/index.html
+++ b/docs/0.14.0/flink-connector/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/flink/index.html b/docs/0.14.0/flink/index.html
index 8aa89249..0cb855f1 100644
--- a/docs/0.14.0/flink/index.html
+++ b/docs/0.14.0/flink/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -99,7 +99,7 @@ In our example we’re using
<code>env.add_jars(..)</code> as shown below:</
</span></span><span style=display:flex><span><span
style=color:#f92672>from</span> pyflink.datastream <span
style=color:#f92672>import</span> StreamExecutionEnvironment
</span></span><span style=display:flex><span>
</span></span><span style=display:flex><span>env <span
style=color:#f92672>=</span> StreamExecutionEnvironment<span
style=color:#f92672>.</span>get_execution_environment()
-</span></span><span style=display:flex><span>iceberg_flink_runtime_jar <span
style=color:#f92672>=</span> os<span style=color:#f92672>.</span>path<span
style=color:#f92672>.</span>join(os<span style=color:#f92672>.</span>getcwd(),
<span style=color:#e6db74>"iceberg-flink-runtime-0.13.2.jar"</span>)
+</span></span><span style=display:flex><span>iceberg_flink_runtime_jar <span
style=color:#f92672>=</span> os<span style=color:#f92672>.</span>path<span
style=color:#f92672>.</span>join(os<span style=color:#f92672>.</span>getcwd(),
<span style=color:#e6db74>"iceberg-flink-runtime-0.14.0.jar"</span>)
</span></span><span style=display:flex><span>
</span></span><span style=display:flex><span>env<span
style=color:#f92672>.</span>add_jars(<span
style=color:#e6db74>"file://</span><span style=color:#e6db74>{}</span><span
style=color:#e6db74>"</span><span
style=color:#f92672>.</span>format(iceberg_flink_runtime_jar))
</span></span></code></pre></div><p>Once we reached this point, we can then
create a <code>StreamTableEnvironment</code> and execute Flink SQL statements.
@@ -219,7 +219,7 @@ For an unpartitioned iceberg table, its data will be
completely overwritten by <
</span></span><span style=display:flex><span>
</span></span><span style=display:flex><span><span style=color:#75715e>//
Submit and execute this streaming read job.
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span>env<span style=color:#f92672>.</span><span
style=color:#a6e22e>execute</span><span style=color:#f92672>(</span><span
style=color:#e6db74>"Test Iceberg Streaming Read"</span><span
style=color:#f92672>);</span>
-</span></span></code></pre></div><p>There are other options that we could set
by Java API, please see the <a
href=../../../javadoc/0.13.2/org/apache/iceberg/flink/source/FlinkSource.html>FlinkSource#Builder</a>.</p><h2
id=writing-with-datastream>Writing with DataStream</h2><p>Iceberg support
writing to iceberg table from different DataStream input.</p><h3
id=appending-data>Appending data.</h3><p>we have supported writing
<code>DataStream<RowData></code> and <code>DataStream<Row></c [...]
+</span></span></code></pre></div><p>There are other options that we could set
by Java API, please see the <a
href=../../../javadoc/0.14.0/org/apache/iceberg/flink/source/FlinkSource.html>FlinkSource#Builder</a>.</p><h2
id=writing-with-datastream>Writing with DataStream</h2><p>Iceberg support
writing to iceberg table from different DataStream input.</p><h3
id=appending-data>Appending data.</h3><p>we have supported writing
<code>DataStream<RowData></code> and <code>DataStream<Row></c [...]
</span></span><span style=display:flex><span>
</span></span><span style=display:flex><span>DataStream<span
style=color:#f92672><</span>RowData<span style=color:#f92672>></span>
input <span style=color:#f92672>=</span> <span style=color:#f92672>...</span>
<span style=color:#f92672>;</span>
</span></span><span style=display:flex><span>Configuration hadoopConf <span
style=color:#f92672>=</span> <span style=color:#66d9ef>new</span>
Configuration<span style=color:#f92672>();</span>
@@ -254,7 +254,7 @@ For an unpartitioned iceberg table, its data will be
completely overwritten by <
</span></span><span style=display:flex><span>RewriteDataFilesActionResult
result <span style=color:#f92672>=</span> Actions<span
style=color:#f92672>.</span><span style=color:#a6e22e>forTable</span><span
style=color:#f92672>(</span>table<span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span
style=color:#a6e22e>rewriteDataFiles</span><span style=color:#f92672>()</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>execute</span><span
style=color:#f92672>();</span>
-</span></span></code></pre></div><p>For more doc about options of the rewrite
files action, please see <a
href=../../../javadoc/0.13.2/org/apache/iceberg/flink/actions/RewriteDataFilesAction.html>RewriteDataFilesAction</a></p><h2
id=type-conversion>Type conversion</h2><p>Iceberg’s integration for
Flink automatically converts between Flink and Iceberg types. When writing to a
table with types that are not supported by Flink, like UUID, Iceberg will
accept and convert values from the [...]
+</span></span></code></pre></div><p>For more doc about options of the rewrite
files action, please see <a
href=../../../javadoc/0.14.0/org/apache/iceberg/flink/actions/RewriteDataFilesAction.html>RewriteDataFilesAction</a></p><h2
id=type-conversion>Type conversion</h2><p>Iceberg’s integration for
Flink automatically converts between Flink and Iceberg types. When writing to a
table with types that are not supported by Flink, like UUID, Iceberg will
accept and convert values from the [...]
<script
src=https://iceberg.apache.org/docs/0.14.0//js/jquery.easing.min.js></script>
<script type=text/javascript
src=https://iceberg.apache.org/docs/0.14.0//js/search.js></script>
<script
src=https://iceberg.apache.org/docs/0.14.0//js/bootstrap.min.js></script>
diff --git a/docs/0.14.0/getting-started/index.html
b/docs/0.14.0/getting-started/index.html
index 89e3df95..94384b0f 100644
--- a/docs/0.14.0/getting-started/index.html
+++ b/docs/0.14.0/getting-started/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle
data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
@@ -13,10 +13,10 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations
class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a
href=../jdbc/>JDBC</a></li><li><a
href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul
class=sub-menu><li><a href=../java-api-quickstart/>Java
Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a
href=https://iceberg.apache.org/docs/0.14.0/../ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul
class=sub-menu><li><a href=../java-api-quickstart/>Java
Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a
href=https://iceberg.apache.org/docs/0.14.0/../ [...]
We recommend you to get started with Spark to understand Iceberg concepts and
features with examples.
-You can also view documentations of using Iceberg with other compute engine
under the <strong>Engines</strong> tab.</p><h2
id=using-iceberg-in-spark-3>Using Iceberg in Spark 3</h2><p>To use Iceberg in a
Spark shell, use the <code>--packages</code> option:</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sh data-lang=sh><span style=display:flex><span>spark-shell
--packages org.apache.iceberg: [...]
-</span></span></code></pre></div><div class=info>If you want to include
Iceberg in your Spark installation, add the <a
href=spark-runtime-jar><code>iceberg-spark-runtime-3.2_2.12</code> Jar</a> to
Spark’s <code>jars</code> folder.</div><h3 id=adding-catalogs>Adding
catalogs</h3><p>Iceberg comes with <a
href=../spark-configuration#catalogs>catalogs</a> that enable SQL commands to
manage tables and load them by name. Catalogs are configured using properties
under <code>spark.sql.cata [...]
+You can also view documentations of using Iceberg with other compute engine
under the <strong>Engines</strong> tab.</p><h2
id=using-iceberg-in-spark-3>Using Iceberg in Spark 3</h2><p>To use Iceberg in a
Spark shell, use the <code>--packages</code> option:</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sh data-lang=sh><span style=display:flex><span>spark-shell
--packages org.apache.iceberg: [...]
+</span></span></code></pre></div><div class=info>If you want to include
Iceberg in your Spark installation, add the <a
href=spark-runtime-jar><code>iceberg-spark-runtime-3.2_2.12</code> Jar</a> to
Spark’s <code>jars</code> folder.</div><h3 id=adding-catalogs>Adding
catalogs</h3><p>Iceberg comes with <a
href=../spark-configuration#catalogs>catalogs</a> that enable SQL commands to
manage tables and load them by name. Catalogs are configured using properties
under <code>spark.sql.cata [...]
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf spark.sql.extensions<span
style=color:#f92672>=</span>org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions
<span style=color:#ae81ff>\
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf spark.sql.catalog.spark_catalog<span
style=color:#f92672>=</span>org.apache.iceberg.spark.SparkSessionCatalog <span
style=color:#ae81ff>\
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf spark.sql.catalog.spark_catalog.type<span
style=color:#f92672>=</span>hive <span style=color:#ae81ff>\
diff --git a/docs/0.14.0/hive/index.html b/docs/0.14.0/hive/index.html
index 929675c0..3a9bbb34 100644
--- a/docs/0.14.0/hive/index.html
+++ b/docs/0.14.0/hive/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -69,7 +69,7 @@ The Iceberg table and the corresponding Hive table are
created at the beginning
The data is inserted / committed when the query finishes. So for a transient
period the table already exists but contains no data.</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sql data-lang=sql><span style=display:flex><span><span
style=color:#66d9ef>CREATE</span> <span style=color:#66d9ef>TABLE</span> target
PARTITIONED <span style=color:#66d9ef>BY</span> SPEC (<span style=color:#66d9ef
[...]
</span></span><span style=display:flex><span> <span
style=color:#66d9ef>SELECT</span> <span style=color:#f92672>*</span> <span
style=color:#66d9ef>FROM</span> <span style=color:#66d9ef>source</span>;
</span></span></code></pre></div><h3
id=create-external-table-overlaying-an-existing-iceberg-table>CREATE EXTERNAL
TABLE overlaying an existing Iceberg table</h3><p>The <code>CREATE EXTERNAL
TABLE</code> command is used to overlay a Hive table “on top of” an
existing Iceberg table. Iceberg
-tables are created using either a <a
href=../../../javadoc/0.13.2/index.html?org/apache/iceberg/catalog/Catalog.html><code>Catalog</code></a>,
or an implementation of the <a
href=../../../javadoc/0.13.2/index.html?org/apache/iceberg/Tables.html><code>Tables</code></a>
interface, and Hive needs to be configured accordingly to
+tables are created using either a <a
href=../../../javadoc/0.14.0/index.html?org/apache/iceberg/catalog/Catalog.html><code>Catalog</code></a>,
or an implementation of the <a
href=../../../javadoc/0.14.0/index.html?org/apache/iceberg/Tables.html><code>Tables</code></a>
interface, and Hive needs to be configured accordingly to
operate on these different types of table.</p><h4 id=hive-catalog-tables>Hive
catalog tables</h4><p>As described before, tables created by the
<code>HiveCatalog</code> with Hive engine feature enabled are directly visible
by the
Hive engine, so there is no need to create an overlay.</p><h4
id=custom-catalog-tables>Custom catalog tables</h4><p>For a table in a
registered catalog, specify the catalog name in the statement using table
property <code>iceberg.catalog</code>.
For example, the SQL below creates an overlay for a table in a
<code>hadoop</code> type catalog named <code>hadoop_cat</code>:</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sql data-lang=sql><span style=display:flex><span><span
style=color:#66d9ef>SET</span>
diff --git a/docs/0.14.0/index.html b/docs/0.14.0/index.html
index 136e3131..2e290fe3 100644
--- a/docs/0.14.0/index.html
+++ b/docs/0.14.0/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=./configuration/>Configuration</a></li><li><a
href=./evolution/>Evolution</a></li><li><a
href=./maintenance/>Maintenance</a></li><li><a
href=./partitioning/>Partitioning</a></li><li><a
href=./performance/>Performance</a></li><li><a
href=./reliability/>Reliability</a></li><li><a
href=./schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collapse data- [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/index.xml b/docs/0.14.0/index.xml
index 2a27223d..0e8a64bb 100644
--- a/docs/0.14.0/index.xml
+++ b/docs/0.14.0/index.xml
@@ -1,4 +1,4 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Introduction on Apache
Iceberg</title><link>https://iceberg.apache.org/docs/0.14.0/</link><description>Recent
content in Introduction on Apache Iceberg</description><generator>Hugo --
gohugo.io</generator><language>en-us</language><atom:link
href="https://iceberg.apache.org/docs/0.14.0/index.xml"; rel="self"
type="application/rss+xml"/><item><title>Getting Sta [...]
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0"
xmlns:atom="http://www.w3.org/2005/Atom";><channel><title>Introduction on Apache
Iceberg</title><link>https://iceberg.apache.org/docs/0.14.0/</link><description>Recent
content in Introduction on Apache Iceberg</description><generator>Hugo --
gohugo.io</generator><language>en-us</language><atom:link
href="https://iceberg.apache.org/docs/0.14.0/index.xml"; rel="self"
type="application/rss+xml"/><item><title>Getting Sta [...]
Spark is currently the most feature-rich compute engine for Iceberg
operations. We recommend you to get started with Spark to understand Iceberg
concepts and features with examples. You can also view documentations of using
Iceberg with other compute engine under the Engines tab.
Using Iceberg in Spark 3 To use Iceberg in a Spark shell, use the --packages
option:
spark-shell --packages
org.</description></item><item><title>Hive</title><link>https://iceberg.apache.org/docs/0.14.0/hive/</link><pubDate>Mon,
01 Jan 0001 00:00:00
+0000</pubDate><guid>https://iceberg.apache.org/docs/0.14.0/hive/</guid><description>Hive
Iceberg supports reading and writing Iceberg tables through Hive by using a
StorageHandler.
diff --git a/docs/0.14.0/java-api-quickstart/index.html
b/docs/0.14.0/java-api-quickstart/index.html
index 870aab35..b7e988e2 100644
--- a/docs/0.14.0/java-api-quickstart/index.html
+++ b/docs/0.14.0/java-api-quickstart/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations
class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a
href=../jdbc/>JDBC</a></li><li><a
href=../nessie/>Nessie</a></li></ul></div><li><a class=chevron-toggle
data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul
class=sub-menu><li><a id=active href=../java-api-quickstart/>Java
Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul
class=sub-menu><li><a id=active href=../java-api-quickstart/>Java
Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
You can initialize a Hive catalog with a name and some properties.
(see: <a href=../configuration/#catalog-properties>Catalog
properties</a>)</p><p><strong>Note:</strong> Currently, <code>setConf</code> is
always required for hive catalogs, but this will change in the future.</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-java data-lang=java><span style=display:flex><span><span
style=color:#f92672>import</span> org.apache.iceberg.hive.HiveCatalog<span sty
[...]
</span></span><span style=display:flex><span>
diff --git a/docs/0.14.0/jdbc/index.html b/docs/0.14.0/jdbc/index.html
index bfd10b2e..9bf60bf4 100644
--- a/docs/0.14.0/jdbc/index.html
+++ b/docs/0.14.0/jdbc/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -16,7 +16,7 @@
<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul
class=sub-menu><li><a href=../java-api-quickstart/>Java
Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a
href=https://iceberg.apache.org/docs/0.14.0/../ [...]
The database that JDBC connects to must support atomic transaction to allow
the JDBC catalog implementation to
properly support atomic Iceberg table commits and read serializable
isolation.</p><h3 id=configurations>Configurations</h3><p>Because each database
and database service provider might require different configurations,
-the JDBC catalog allows arbitrary configurations
through:</p><table><thead><tr><th>Property</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td>uri</td><td></td><td>the
JDBC connection
string</td></tr><tr><td>jdbc.<property_key></td><td></td><td>any key value
pairs to configure the JDBC connection</td></tr></tbody></table><h3
id=examples>Examples</h3><h4 id=spark>Spark</h4><p>You can start a Spark
session with a MySQL JDBC connection using the following configurations: [...]
+the JDBC catalog allows arbitrary configurations
through:</p><table><thead><tr><th>Property</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td>uri</td><td></td><td>the
JDBC connection
string</td></tr><tr><td>jdbc.<property_key></td><td></td><td>any key value
pairs to configure the JDBC connection</td></tr></tbody></table><h3
id=examples>Examples</h3><h4 id=spark>Spark</h4><p>You can start a Spark
session with a MySQL JDBC connection using the following configurations: [...]
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf spark.sql.catalog.my_catalog<span
style=color:#f92672>=</span>org.apache.iceberg.spark.SparkCatalog <span
style=color:#ae81ff>\
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf
spark.sql.catalog.my_catalog.warehouse<span
style=color:#f92672>=</span>s3://my-bucket/my/key/prefix <span
style=color:#ae81ff>\
</span></span></span><span style=display:flex><span><span
style=color:#ae81ff></span> --conf
spark.sql.catalog.my_catalog.catalog-impl<span
style=color:#f92672>=</span>org.apache.iceberg.jdbc.JdbcCatalog <span
style=color:#ae81ff>\
diff --git a/docs/0.14.0/maintenance/index.html
b/docs/0.14.0/maintenance/index.html
index cee65fc5..d9603a4d 100644
--- a/docs/0.14.0/maintenance/index.html
+++ b/docs/0.14.0/maintenance/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse
in"><ul class=sub-menu><li><a
href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a id=active
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data [...]
<i class="fa fa-chevron-right"></i>
@@ -13,12 +13,12 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations
class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a
href=../jdbc/>JDBC</a></li><li><a
href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul
class=sub-menu><li><a href=../java-api-quickstart/>Java
Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a
href=https://iceberg.apache.org/docs/0.14.0/../ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul
class=sub-menu><li><a href=../java-api-quickstart/>Java
Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a
href=https://iceberg.apache.org/docs/0.14.0/../ [...]
</span></span><span style=display:flex><span><span
style=color:#66d9ef>long</span> tsToExpire <span style=color:#f92672>=</span>
System<span style=color:#f92672>.</span><span
style=color:#a6e22e>currentTimeMillis</span><span style=color:#f92672>()</span>
<span style=color:#f92672>-</span> <span style=color:#f92672>(</span>1000 <span
style=color:#f92672>*</span> 60 <span style=color:#f92672>*</span> 60 <span
style=color:#f92672>*</span> 24<span style=color:#f92672>);</span> <span
style=co [...]
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span>table<span style=color:#f92672>.</span><span
style=color:#a6e22e>expireSnapshots</span><span style=color:#f92672>()</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span
style=color:#a6e22e>expireOlderThan</span><span
style=color:#f92672>(</span>tsToExpire<span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>commit</span><span
style=color:#f92672>();</span>
-</span></span></code></pre></div><p>See the <a
href=../../../javadoc/0.13.2/org/apache/iceberg/ExpireSnapshots.html><code>ExpireSnapshots</code>
Javadoc</a> to see more configuration options.</p><p>There is also a Spark
action that can run table expiration in parallel for large tables:</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-java data-lang=java><span style=display:flex><span>Table t [...]
+</span></span></code></pre></div><p>See the <a
href=../../../javadoc/0.14.0/org/apache/iceberg/ExpireSnapshots.html><code>ExpireSnapshots</code>
Javadoc</a> to see more configuration options.</p><p>There is also a Spark
action that can run table expiration in parallel for large tables:</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-java data-lang=java><span style=display:flex><span>Table t [...]
</span></span><span style=display:flex><span>SparkActions
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>get</span><span
style=color:#f92672>()</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span
style=color:#a6e22e>expireSnapshots</span><span
style=color:#f92672>(</span>table<span style=color:#f92672>)</span>
@@ -30,7 +30,7 @@ Regularly expiring snapshots deletes unused data
files.</div><h3 id=remove-old-m
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>get</span><span
style=color:#f92672>()</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span
style=color:#a6e22e>deleteOrphanFiles</span><span
style=color:#f92672>(</span>table<span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>execute</span><span
style=color:#f92672>();</span>
-</span></span></code></pre></div><p>See the <a
href=../../../javadoc/0.13.2/org/apache/iceberg/actions/DeleteOrphanFiles.html>DeleteOrphanFiles
Javadoc</a> to see more configuration options.</p><p>This action may take a
long time to finish if you have lots of files in data and metadata directories.
It is recommended to execute this periodically, but you may not need to execute
this often.</p><div class=info>It is dangerous to remove orphan files with a
retention interval shorter than the [...]
+</span></span></code></pre></div><p>See the <a
href=../../../javadoc/0.14.0/org/apache/iceberg/actions/DeleteOrphanFiles.html>DeleteOrphanFiles
Javadoc</a> to see more configuration options.</p><p>This action may take a
long time to finish if you have lots of files in data and metadata directories.
It is recommended to execute this periodically, but you may not need to execute
this often.</p><div class=info>It is dangerous to remove orphan files with a
retention interval shorter than the [...]
might corrupt the table if in-progress files are considered orphaned and are
deleted. The default interval is 3 days.</div><div class=info>Iceberg uses the
string representations of paths when determining which files need to be
removed. On some file systems,
the path can change over time, but it still represents the same file. For
example, if you change authorities for an HDFS cluster,
none of the old path urls used during creation will match those that appear in
a current listing. <em>This will lead to data loss when
@@ -42,13 +42,13 @@ FileSystem API to avoid unintentional deletion.</div><h2
id=optional-maintenance
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>filter</span><span
style=color:#f92672>(</span>Expressions<span style=color:#f92672>.</span><span
style=color:#a6e22e>equal</span><span style=color:#f92672>(</span><span
style=color:#e6db74>"date"</span><span style=color:#f92672>,</span>
<span style=color:#e6db74>"2020-08-18"</span><span
style=color:#f92672>))</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>option</span><span
style=color:#f92672>(</span><span
style=color:#e6db74>"target-file-size-bytes"</span><span
style=color:#f92672>,</span> Long<span style=color:#f92672>.</span><span
style=color:#a6e22e>toString</span><span style=color:#f92672>(</span>500 <span
style=color:#f92672>*</span> 1024 <span style=color:#f92672>*</span> 1024<span
style=color:#f92672>))</span> <spa [...]
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span> <span style=color:#f92672>.</span><span
style=color:#a6e22e>execute</span><span style=color:#f92672>();</span>
-</span></span></code></pre></div><p>The <code>files</code> metadata table is
useful for inspecting data file sizes and determining when to compact
partitions.</p><p>See the <a
href=../../../javadoc/0.13.2/org/apache/iceberg/actions/RewriteDataFiles.html><code>RewriteDataFiles</code>
Javadoc</a> to see more configuration options.</p><h3
id=rewrite-manifests>Rewrite manifests</h3><p>Iceberg uses metadata in its
manifest list and manifest files speed up query planning and to prune unnecessa
[...]
+</span></span></code></pre></div><p>The <code>files</code> metadata table is
useful for inspecting data file sizes and determining when to compact
partitions.</p><p>See the <a
href=../../../javadoc/0.14.0/org/apache/iceberg/actions/RewriteDataFiles.html><code>RewriteDataFiles</code>
Javadoc</a> to see more configuration options.</p><h3
id=rewrite-manifests>Rewrite manifests</h3><p>Iceberg uses metadata in its
manifest list and manifest files speed up query planning and to prune unnecessa
[...]
</span></span><span style=display:flex><span>SparkActions
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>get</span><span
style=color:#f92672>()</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span
style=color:#a6e22e>rewriteManifests</span><span
style=color:#f92672>(</span>table<span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span
style=color:#f92672>.</span><span style=color:#a6e22e>rewriteIf</span><span
style=color:#f92672>(</span>file <span style=color:#f92672>-></span>
file<span style=color:#f92672>.</span><span
style=color:#a6e22e>length</span><span style=color:#f92672>()</span> <span
style=color:#f92672><</span> 10 <span style=color:#f92672>*</span> 1024
<span style=color:#f92672>*</span> 1024<span style=color:#f92672>)</span> <span
style=color:#75 [...]
</span></span></span><span style=display:flex><span><span
style=color:#75715e></span> <span style=color:#f92672>.</span><span
style=color:#a6e22e>execute</span><span style=color:#f92672>();</span>
-</span></span></code></pre></div><p>See the <a
href=../../../javadoc/0.13.2/org/apache/iceberg/actions/RewriteManifests.html><code>RewriteManifests</code>
Javadoc</a> to see more configuration options.</p></div><div id=toc
class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a
href=#recommended-maintenance>Recommended Maintenance</a><ul><li><a
href=#expire-snapshots>Expire Snapshots</a></li><li><a
href=#remove-old-metadata-files>Remove old metadata files</a></li><li><a href=
[...]
+</span></span></code></pre></div><p>See the <a
href=../../../javadoc/0.14.0/org/apache/iceberg/actions/RewriteManifests.html><code>RewriteManifests</code>
Javadoc</a> to see more configuration options.</p></div><div id=toc
class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a
href=#recommended-maintenance>Recommended Maintenance</a><ul><li><a
href=#expire-snapshots>Expire Snapshots</a></li><li><a
href=#remove-old-metadata-files>Remove old metadata files</a></li><li><a href=
[...]
<script
src=https://iceberg.apache.org/docs/0.14.0//js/jquery.easing.min.js></script>
<script type=text/javascript
src=https://iceberg.apache.org/docs/0.14.0//js/search.js></script>
<script
src=https://iceberg.apache.org/docs/0.14.0//js/bootstrap.min.js></script>
diff --git a/docs/0.14.0/nessie/index.html b/docs/0.14.0/nessie/index.html
index 0a99499c..dc0d877c 100644
--- a/docs/0.14.0/nessie/index.html
+++ b/docs/0.14.0/nessie/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -16,8 +16,8 @@
<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul
class=sub-menu><li><a href=../java-api-quickstart/>Java
Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a
href=../custom-catalog/>Java Custom Catalog</a></li><li><a
href=../python-quickstart/>Python Quickstart</a></li><li><a
href=../python-api-intro/>Python API</a></li><li><a
href=../python-feature-support/>Python Feature
Support</a></li></ul></div><li><a
href=https://iceberg.apache.org/docs/0.14.0/../ [...]
This section describes how to use Iceberg with Nessie. Nessie provides several
key features on top of Iceberg:</p><ul><li>multi-table
transactions</li><li>git-like operations (eg branches, tags,
commits)</li><li>hive-like metastore capabilities</li></ul><p>See <a
href=https://projectnessie.org>Project Nessie</a> for more information on
Nessie. Nessie requires a server to run, see
<a href=https://projectnessie.org/try/>Getting Started</a> to start a Nessie
server.</p><h2 id=enabling-nessie-catalog>Enabling Nessie Catalog</h2><p>The
<code>iceberg-nessie</code> module is bundled with Spark and Flink runtimes for
all versions from <code>0.11.0</code>. To get started
-with Nessie and Iceberg simply add the Iceberg runtime to your process. Eg:
<code>spark-sql --packages
org.apache.iceberg:iceberg-spark3-runtime:0.13.2</code>.</p><h2
id=spark-sql-extensions>Spark SQL Extensions</h2><p>From Spark 3.0, Nessie SQL
extensions can be used to manage the Nessie repo as shown below.</p><pre
tabindex=0><code>bin/spark-sql
- --packages
"org.apache.iceberg:iceberg-spark3-runtime:0.13.2,org.projectnessie:nessie-spark-extensions:0.18.0"
+with Nessie and Iceberg simply add the Iceberg runtime to your process. Eg:
<code>spark-sql --packages
org.apache.iceberg:iceberg-spark3-runtime:0.14.0</code>.</p><h2
id=spark-sql-extensions>Spark SQL Extensions</h2><p>From Spark 3.0, Nessie SQL
extensions can be used to manage the Nessie repo as shown below.</p><pre
tabindex=0><code>bin/spark-sql
+ --packages
"org.apache.iceberg:iceberg-spark3-runtime:0.14.0,org.projectnessie:nessie-spark-extensions:0.18.0"
--conf
spark.sql.extensions="org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions,org.projectnessie.spark.extensions.NessieSparkSessionExtensions"
--conf <other settings>
</code></pre><p>Please refer <a
href=https://projectnessie.org/tools/sql/>Nessie SQL extension document</a> to
learn more about it.</p><h2 id=nessie-catalog>Nessie Catalog</h2><p>One major
feature introduced in release <code>0.11.0</code> is the ability to easily
interact with a <a href=../custom-catalog>Custom
@@ -38,7 +38,7 @@ and <a href=../flink#custom-catalog>Flink Configuration</a>
for instructions for
</span></span><span style=display:flex><span><span
style=color:#f92672>from</span> pyflink.table <span
style=color:#f92672>import</span> StreamTableEnvironment
</span></span><span style=display:flex><span>
</span></span><span style=display:flex><span>env <span
style=color:#f92672>=</span> StreamExecutionEnvironment<span
style=color:#f92672>.</span>get_execution_environment()
-</span></span><span style=display:flex><span>iceberg_flink_runtime_jar <span
style=color:#f92672>=</span> os<span style=color:#f92672>.</span>path<span
style=color:#f92672>.</span>join(os<span style=color:#f92672>.</span>getcwd(),
<span style=color:#e6db74>"iceberg-flink-runtime-0.13.2.jar"</span>)
+</span></span><span style=display:flex><span>iceberg_flink_runtime_jar <span
style=color:#f92672>=</span> os<span style=color:#f92672>.</span>path<span
style=color:#f92672>.</span>join(os<span style=color:#f92672>.</span>getcwd(),
<span style=color:#e6db74>"iceberg-flink-runtime-0.14.0.jar"</span>)
</span></span><span style=display:flex><span>env<span
style=color:#f92672>.</span>add_jars(<span
style=color:#e6db74>"file://</span><span style=color:#e6db74>{}</span><span
style=color:#e6db74>"</span><span
style=color:#f92672>.</span>format(iceberg_flink_runtime_jar))
</span></span><span style=display:flex><span>table_env <span
style=color:#f92672>=</span> StreamTableEnvironment<span
style=color:#f92672>.</span>create(env)
</span></span><span style=display:flex><span>
diff --git a/docs/0.14.0/partitioning/index.html
b/docs/0.14.0/partitioning/index.html
index e3569c19..9b3883df 100644
--- a/docs/0.14.0/partitioning/index.html
+++ b/docs/0.14.0/partitioning/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse
in"><ul class=sub-menu><li><a
href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a id=active
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/performance/index.html
b/docs/0.14.0/performance/index.html
index 4dc92e87..0fefa953 100644
--- a/docs/0.14.0/performance/index.html
+++ b/docs/0.14.0/performance/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse
in"><ul class=sub-menu><li><a
href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a id=active
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/python-api-intro/index.html
b/docs/0.14.0/python-api-intro/index.html
index 1b414f4f..653cc950 100644
--- a/docs/0.14.0/python-api-intro/index.html
+++ b/docs/0.14.0/python-api-intro/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/python-feature-support/index.html
b/docs/0.14.0/python-feature-support/index.html
index c290784c..afb1542e 100644
--- a/docs/0.14.0/python-feature-support/index.html
+++ b/docs/0.14.0/python-feature-support/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/python-quickstart/index.html
b/docs/0.14.0/python-quickstart/index.html
index 859f6db1..a7c136cf 100644
--- a/docs/0.14.0/python-quickstart/index.html
+++ b/docs/0.14.0/python-quickstart/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/reliability/index.html
b/docs/0.14.0/reliability/index.html
index d5a49a04..9354ddbf 100644
--- a/docs/0.14.0/reliability/index.html
+++ b/docs/0.14.0/reliability/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse
in"><ul class=sub-menu><li><a
href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a id=active
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/schemas/index.html b/docs/0.14.0/schemas/index.html
index 5a27bddd..9b3f24ac 100644
--- a/docs/0.14.0/schemas/index.html
+++ b/docs/0.14.0/schemas/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse
in"><ul class=sub-menu><li><a
href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a id=active
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/search.json b/docs/0.14.0/search.json
index 3db34035..d599cbc4 100644
--- a/docs/0.14.0/search.json
+++ b/docs/0.14.0/search.json
@@ -1 +1 @@
-[{"categories":null,"content":" Getting Started The latest version of Iceberg
is 0.13.2.\nSpark is currently the most feature-rich compute engine for Iceberg
operations. We recommend you to get started with Spark to understand Iceberg
concepts and features with examples. You can also view documentations of using
Iceberg with other compute engine under the Engines tab.\nUsing Iceberg in
Spark 3 To use Iceberg in a Spark shell, use the --packages
option:\nspark-shell --packages org.apache. [...]
\ No newline at end of file
+[{"categories":null,"content":" Getting Started The latest version of Iceberg
is 0.14.0.\nSpark is currently the most feature-rich compute engine for Iceberg
operations. We recommend you to get started with Spark to understand Iceberg
concepts and features with examples. You can also view documentations of using
Iceberg with other compute engine under the Engines tab.\nUsing Iceberg in
Spark 3 To use Iceberg in a Spark shell, use the --packages
option:\nspark-shell --packages org.apache. [...]
\ No newline at end of file
diff --git a/docs/0.14.0/spark-configuration/index.html
b/docs/0.14.0/spark-configuration/index.html
index 784f2940..eec3c7a7 100644
--- a/docs/0.14.0/spark-configuration/index.html
+++ b/docs/0.14.0/spark-configuration/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle
collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/spark-ddl/index.html b/docs/0.14.0/spark-ddl/index.html
index 6ae0afef..9fbef7d2 100644
--- a/docs/0.14.0/spark-ddl/index.html
+++ b/docs/0.14.0/spark-ddl/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle
data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/spark-procedures/index.html
b/docs/0.14.0/spark-procedures/index.html
index 4df6936c..d7190ed5 100644
--- a/docs/0.14.0/spark-procedures/index.html
+++ b/docs/0.14.0/spark-procedures/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle
data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
@@ -26,8 +26,8 @@ and their files which are no longer needed.</p><p>This
procedure will remove old
the <code>expire_snapshots</code> procedure will never remove files which are
still required by a non-expired snapshot.</p><h4
id=usage-5>Usage</h4><table><thead><tr><th>Argument
Name</th><th>Required?</th><th>Type</th><th>Description</th></tr></thead><tbody><tr><td><code>table</code></td><td>✔️</td><td>string</td><td>Name
of the table to
update</td></tr><tr><td><code>older_than</code></td><td>️</td><td>timestamp</td><td>Timestamp
before which snapshots will be removed (Default: 5 days a [...]
</span></span></code></pre></div><h3
id=remove_orphan_files><code>remove_orphan_files</code></h3><p>Used to remove
files which are not referenced in any metadata files of an Iceberg table and
can thus be considered “orphaned”.</p><h4
id=usage-6>Usage</h4><table><thead><tr><th>Argument
Name</th><th>Required?</th><th>Type</th><th>Description</th></tr></thead><tbody><tr><td><code>table</code></td><td>✔️</td><td>string</td><td>Name
of the table to clean</td></tr><tr><td><code>old [...]
</span></span></code></pre></div><p>Remove any files in the
<code>tablelocation/data</code> folder which are not known to the table
<code>db.sample</code>.</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sql data-lang=sql><span style=display:flex><span><span
style=color:#66d9ef>CALL</span> <span
style=color:#66d9ef>catalog_name</span>.<span
style=color:#66d9ef>system</span>.remove_orphan_fi [...]
-</span></span></code></pre></div><h3
id=rewrite_data_files><code>rewrite_data_files</code></h3><p>Iceberg tracks
each data file in a table. More data files leads to more metadata stored in
manifest files, and small data files causes an unnecessary amount of metadata
and less efficient queries from file open costs.</p><p>Iceberg can compact data
files in parallel using Spark with the <code>rewriteDataFiles</code> action.
This will combine small files into larger files to reduce metadata o [...]
-and <a
href=../../../javadoc/0.13.2/org/apache/iceberg/actions/SortStrategy.html#field.summary><code>SortStrategy</code>
Javadoc</a>
+</span></span></code></pre></div><h3
id=rewrite_data_files><code>rewrite_data_files</code></h3><p>Iceberg tracks
each data file in a table. More data files leads to more metadata stored in
manifest files, and small data files causes an unnecessary amount of metadata
and less efficient queries from file open costs.</p><p>Iceberg can compact data
files in parallel using Spark with the <code>rewriteDataFiles</code> action.
This will combine small files into larger files to reduce metadata o [...]
+and <a
href=../../../javadoc/0.14.0/org/apache/iceberg/actions/SortStrategy.html#field.summary><code>SortStrategy</code>
Javadoc</a>
for list of all the supported options for this action.</p><h4
id=output-6>Output</h4><table><thead><tr><th>Output
Name</th><th>Type</th><th>Description</th></tr></thead><tbody><tr><td><code>rewritten_data_files_count</code></td><td>int</td><td>Number
of data which were re-written by this
command</td></tr><tr><td><code>added_data_files_count</code></td><td>int</td><td>Number
of new data files which were written by this
command</td></tr></tbody></table><h4 id=examples-3>Examples</h4><p>Rew [...]
and also split large files according to the default write size of the
table.</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sql data-lang=sql><span style=display:flex><span><span
style=color:#66d9ef>CALL</span> <span
style=color:#66d9ef>catalog_name</span>.<span
style=color:#66d9ef>system</span>.rewrite_data_files(<span
style=color:#e6db74>'db.sample'</span>)
</span></span></code></pre></div><p>Rewrite the data files in table
<code>db.sample</code> by sorting all the data on id and name
@@ -36,7 +36,7 @@ using the same defaults as bin-pack to determine which files
to rewrite.</p><div
Using the same defaults as bin-pack to determine which files to
rewrite.</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sql data-lang=sql><span style=display:flex><span><span
style=color:#66d9ef>CALL</span> <span
style=color:#66d9ef>catalog_name</span>.<span
style=color:#66d9ef>system</span>.rewrite_data_files(<span
style=color:#66d9ef>table</span> <span style=color:#f92672>=></span> <s [...]
</span></span></code></pre></div><p>Rewrite the data files in table
<code>db.sample</code> using bin-pack strategy in any partition where more than
2 or more files need to be rewritten.</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sql data-lang=sql><span style=display:flex><span><span
style=color:#66d9ef>CALL</span> <span
style=color:#66d9ef>catalog_name</span>.<span style=color:#66d9ef> [...]
</span></span></code></pre></div><p>Rewrite the data files in table
<code>db.sample</code> and select the files that may contain data matching the
filter (id = 3 and name = “foo”) to be rewritten.</p><div
class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sql data-lang=sql><span style=display:flex><span><span
style=color:#66d9ef>CALL</span> <span
style=color:#66d9ef>catalog_name</span>.<sp [...]
-</span></span></code></pre></div><h3
id=rewrite_manifests><code>rewrite_manifests</code></h3><p>Rewrite manifests
for a table to optimize scan planning.</p><p>Data files in manifests are sorted
by fields in the partition spec. This procedure runs in parallel using a Spark
job.</p><p>See the <a
href=../../../javadoc/0.13.2/org/apache/iceberg/actions/RewriteManifests.html><code>RewriteManifests</code>
Javadoc</a>
+</span></span></code></pre></div><h3
id=rewrite_manifests><code>rewrite_manifests</code></h3><p>Rewrite manifests
for a table to optimize scan planning.</p><p>Data files in manifests are sorted
by fields in the partition spec. This procedure runs in parallel using a Spark
job.</p><p>See the <a
href=../../../javadoc/0.14.0/org/apache/iceberg/actions/RewriteManifests.html><code>RewriteManifests</code>
Javadoc</a>
to see more configuration options.</p><div class=info>This procedure
invalidates all cached Spark plans that reference the affected table.</div><h4
id=usage-8>Usage</h4><table><thead><tr><th>Argument
Name</th><th>Required?</th><th>Type</th><th>Description</th></tr></thead><tbody><tr><td><code>table</code></td><td>✔️</td><td>string</td><td>Name
of the table to
update</td></tr><tr><td><code>use_caching</code></td><td>️</td><td>boolean</td><td>Use
Spark caching during operation (defaults to [...]
</span></span></code></pre></div><p>Rewrite the manifests in table
<code>db.sample</code> and disable the use of Spark caching. This could be done
to avoid memory issues on executors.</p><div class=highlight><pre tabindex=0
style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code
class=language-sql data-lang=sql><span style=display:flex><span><span
style=color:#66d9ef>CALL</span> <span
style=color:#66d9ef>catalog_name</span>.<span style=color:#66d9ef>sy [...]
</span></span></code></pre></div><h2 id=table-migration>Table
migration</h2><p>The <code>snapshot</code> and <code>migrate</code> procedures
help test and migrate existing Hive or Spark tables to Iceberg.</p><h3
id=snapshot><code>snapshot</code></h3><p>Create a light-weight temporary copy
of a table for testing, without changing the source table.</p><p>The newly
created table can be changed or written to without affecting the source table,
but the snapshot uses the original table’s [...]
diff --git a/docs/0.14.0/spark-queries/index.html
b/docs/0.14.0/spark-queries/index.html
index 496b130e..c481f306 100644
--- a/docs/0.14.0/spark-queries/index.html
+++ b/docs/0.14.0/spark-queries/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle
data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/spark-structured-streaming/index.html
b/docs/0.14.0/spark-structured-streaming/index.html
index ab9c8c4a..8b302b89 100644
--- a/docs/0.14.0/spark-structured-streaming/index.html
+++ b/docs/0.14.0/spark-structured-streaming/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle
data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
diff --git a/docs/0.14.0/spark-writes/index.html
b/docs/0.14.0/spark-writes/index.html
index f36b8a26..0cb5aeaa 100644
--- a/docs/0.14.0/spark-writes/index.html
+++ b/docs/0.14.0/spark-writes/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.13.2</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/><img
class=top-navbar-logo
src=https://iceberg.apache.org/docs/0.14.0//img/iceberg-logo-icon.png> Apache
Iceberg</a></div><div><input type=search class=form-control id=search-input
placeholder=Search... maxlength=64 data-hotkeys=s/></div><div
class=versions-dropdown><span>0.14.0</span> <i class="fa
fa-chevron-down"></i><div class=versions-dropdown-content><ul><li
class=versions-dropdown-selection><a href=https://iceberg [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul
class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a
href=../evolution/>Evolution</a></li><li><a
href=../maintenance/>Maintenance</a></li><li><a
href=../partitioning/>Partitioning</a></li><li><a
href=../performance/>Performance</a></li><li><a
href=../reliability/>Reliability</a></li><li><a
href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle
data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
