This is an automated email from the ASF dual-hosted git repository.
fokko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git
The following commit(s) were added to refs/heads/master by this push:
new 37f53518a0 Docs: Add warning in tiered storage (#8037)
37f53518a0 is described below
commit 37f53518a09803e4ef6b4669f58fbcc960ea5994
Author: Fokko Driesprong <[email protected]>
AuthorDate: Tue Jul 11 19:01:01 2023 +0200
Docs: Add warning in tiered storage (#8037)
* Docs: Add warning in tiered storage
* Update docs/spark-procedures.md
Co-authored-by: Prashant Singh
<[email protected]>
---------
Co-authored-by: Prashant Singh
<[email protected]>
---
docs/spark-procedures.md | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/docs/spark-procedures.md b/docs/spark-procedures.md
index ad09430bb3..df9896fb40 100644
--- a/docs/spark-procedures.md
+++ b/docs/spark-procedures.md
@@ -514,6 +514,10 @@ will then treat these files as if they are part of the set
of files owned by Ic
`expire_snapshot` calls will be able to physically delete the added files.
This method should not be used if
`migrate` or `snapshot` are possible.
+{{< hint warning >}}
+Keep in mind the `add_files` procedure will fetch the Parquet metadata from
each file being added just once. If you're using tiered storage, (such as
[Amazon S3 Intelligent-Tiering storage
class](https://aws.amazon.com/s3/storage-classes/intelligent-tiering/)), the
underlying, file will be retrieved from the archive, and will remain on a
higher tier for a set period of time.
+{{< /hint >}}
+
#### Usage
| Argument Name | Required? | Type | Description
|
