GitHub user clbarnes edited a discussion: Guidance on zip-like stores
I'm interested in making [fjall-rs/sfa](github.com/fjall-rs/sfa) accessible through opendal. It's conceptually similar to a zip file but less complicated - the "file entries" (sections) are basically concatenated, uncompressed, and then there's a footer with their keys along with an offset and length. I may also be interested in zip files themselves. I'd like to be able to read these remotely, e.g. an SFA file on S3. I think that means I should be working on a Layer rather than an Operator, although that might break some assumptions about getting AccessorInfo from the Layer. I'd intend initially to make this accessor read-only and store the index in memory, probably on first read (so put it behind an `RwLock<Option<...>>`). Does this sound like the right track? --- **Mailing list thread:** https://lists.apache.org/thread/4547mv3g2bgp2dv7ykh4zf437skmhwr7 GitHub link: https://github.com/apache/opendal/discussions/7148 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
