Hello iceberg community!

I wanted to discuss the proposal for refreshing storage credentials for
staged table creation. The iceberg tables could be created either via
single step creation flow or a two step staged creation flow which is used
for implementing CTAS (Create table as select) statements. Currently, it's
not possible to refresh the credentials for staged tables since they are
not committed on the catalog and hence not visible to loadTable or
credential endpoint.
There has been prior discussion
<https://lists.apache.org/thread/q5n355d89nxbhywtlv3qhq7dchbyb67d> where
the community members have expressed the need for supporting this scenario.

I have started a proposal
<https://docs.google.com/document/d/1R1K6X7qYqvIFkPG3m1neV5Mvy8rwWJvhSFr8DgJgQ-E/edit?tab=t.0>
to
flush out the details to support this scenario building on the
precedence of credential vending support for scan planning.
The OpenAPI changes can be seen in PR #15280
<https://github.com/apache/iceberg/pull/15280>

Looking forward to your feedback.

Thanks,
Maninder

 Proposal: Credential Refresh for Staged Table Creation
<https://drive.google.com/open?id=1R1K6X7qYqvIFkPG3m1neV5Mvy8rwWJvhSFr8DgJgQ-E>

Reply via email to