Samuel Sanders created ARROW-12296:
--------------------------------------
Summary: S3FileSystem is an Unrecognized filesystem
Key: ARROW-12296
URL: https://issues.apache.org/jira/browse/ARROW-12296
Project: Apache Arrow
Issue Type: Bug
Components: Python
Affects Versions: 3.0.0
Reporter: Samuel Sanders
{code:java}
File "C:\venv\*\lib\site-packages\pyarrow\parquet.py", line 1914, in
write_to_dataset
fs, root_path = legacyfs.resolve_filesystem_and_path(root_path, filesystem)
File "C:\venv\*\lib\site-packages\pyarrow\filesystem.py", line 474, in
resolve_filesystem_and_path
filesystem = _ensure_filesystem(filesystem)
File "C:\venv\*\lib\site-packages\pyarrow\filesystem.py", line 457, in
_ensure_filesystem
raise OSError('Unrecognized filesystem: {}'.format(fs_type))
OSError: Unrecognized filesystem: <class 'pyarrow._s3fs.S3FileSystem'>
{code}
Creating the S3FileSystem these two ways produced the same error when invoking
parquet.write_to_dataset with an s3_filesystem:
{code:java}
s3_filesystem = file_system.S3FileSystem(region='us-east-1')
s3_filesystem, path =
file_system.FileSystem.from_uri("s3://{0}".format(S3_BUCKET))
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
