thomas-pfeiffer commented on issue #2841: URL: https://github.com/apache/iceberg-python/issues/2841#issuecomment-3897077349
First of all, thanks to @stats-dev for the fix and apologies for the late reply. Few follow-up questions: As per my understanding of #2948, the new `s3.profile-name` and `client.profile-name` are only supported in `FsspecFileIO`, but not in `PyArrowFileIO`. @stats-dev and @kevinjqliu - Is that your understanding as well? > (My reasoning being that #2948 didn't change `pyiceberg/io/pyarrow.py` and the fact that https://github.com/apache/arrow/issues/47880 is still open.) - If so, do we need to add a remark in the documentation, that `s3.profile-name` and `client.profile-name` are only supported when using `FsspecFileIO` at least for now? - @kevinjqliu Should I create a new, follow-up issue for the `pyArrow` part? Or what's the preferred way to track this? (The issue would be effectively blocked till pyArrow implements the AWS profile feature on their side.) > For PyArrow backend, the AWS profile support is not yet available, but they do have an enhancement ticket for it (see https://github.com/apache/arrow/issues/47880). Once AWS profile is supported in PyArrow it can be implemented in PyIceberg as well, I assume. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
