jkolash opened a new issue, #2514:
URL: https://github.com/apache/iceberg-python/issues/2514
### Feature Request / Improvement
I would like to be able to use the .pyiceberg.yaml but not have hardcoded
credentials.
I want to be able to refer to a secrets manager key/value
Currently I can do
```python
pre_interpolated_config =
pyiceberg.catalog._ENV_CONFIG.get_catalog_config("iceberg_rest")
# Looks up secrets in a secrets manager based on some pattern such as
op://vault/secret/field for 1password.
config = interpolate_configs_and_secrets(pre_interpolated_config)
pyiceberg.catalog.load_catalog("iceberg_rest", **config)
```
But that relies on using _ENV_CONFIG which is internal. How can I do this
via a supported way? I would like to be able to write my own credentials
interpolation function and not have that part of pyiceberg, as that would be
specific to each users secrets manager setup such as hashicorp vault,
1password, aws secrets manager, etc..
I see two potential approaches
1. Allow getting the config before load_catalog() in an officially
supported way, not _ENV_CONFIG.
2. Officially support interpolating credentials via a custom interpolator
that can be registered. It simply remaps each entry in a config map.)
I think approach 1 is the lighter lift.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
