GitHub user Xuanwo edited a discussion: Crazy Ideas: OpenDAL File System
Can we build a file system with OpenDAL? Ideally, no. OpenDAL and its underlying storage services do not support random writes, which are crucial for file system use cases. To enable this feature, something like JuiceFS with a metadata service is needed. However, there is still a need for a file system that: - Supports both sequential and random reads - Only supports sequential writes - Provides other basic file system operations such as listing and stat (which can be easily cached) There are some projects that fulfill these requirements: - s3fs-fuse: https://github.com/s3fs-fuse/s3fs-fuse - mountpoint-s3: https://github.com/awslabs/mountpoint-s3 - gcsfuse: https://github.com/GoogleCloudPlatform/gcsfuse Perhaps we can implement a fuse via OpenDAL so that users can locally mount storage services and use them as local file systems for specific use cases. Similiar ideas - https://github.com/apache/incubator-opendal/issues/2625 GitHub link: https://github.com/apache/incubator-opendal/discussions/2952 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
