Fokko commented on code in PR #5687:
URL: https://github.com/apache/iceberg/pull/5687#discussion_r960634776
##########
python/pyiceberg/io/__init__.py:
##########
@@ -239,11 +239,14 @@ def delete(self, location: Union[str, InputFile,
OutputFile]) -> None:
WAREHOUSE = "warehouse"
ARROW_FILE_IO = "pyiceberg.io.pyarrow.PyArrowFileIO"
+FSSPEC_FILE_IO = "pyiceberg.io.fsspec.FsspecFileIO"
# Mappings from the Java FileIO impl to a Python one. The list is ordered by
preference.
# If an implementation isn't installed, it will fall back to the next one.
SCHEMA_TO_FILE_IO: Dict[str, List[str]] = {
- "s3": [ARROW_FILE_IO],
+ "s3": [FSSPEC_FILE_IO, ARROW_FILE_IO],
Review Comment:
Added fsspec as a FileIO for S3, which wraps boto which is widely accepted.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
