siomporas commented on issue #6831: URL: https://github.com/apache/opendal/issues/6831#issuecomment-3588082780
> Hi, this idea seems quiet interesting. I'm willing to accept it as part of opendal. > > So ideally, we can just read all git repos this way, right? It’s not limited to LFS files? Correct, downloading lfs files from the pointers stored in the repository could/would be optional behavior - in order for any of this to function it requires resolving the state of a git repo at a given ref, including file contents at the oid/sha. The core functionality would work with any http-accessible git repo. > [@siomporas](https://github.com/siomporas) This sounds interetsing. May I ask for a clarafication on the call flow? From your descriptin I'm not quite sure is it about using OpenDAL to call git services, or use OpenDAL to provide functions that LFS support needs. Primarily it would be to provide a new OpenDAL service for git repos, including LFS, conceptually similar to how how huggingface works in OpenDAL but not limited to one service provider. It requires using something like gix to resolve a ref to an oid, fetching the repository file contents at the sha, then using the http client for OpenDAL to stream the LFS pointers if present. I'll throw together a demo this weekend or Monday and share it in this thread - if it shows promise and you think it would make a good addition, I'll work on making it a service back end for OpenDAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
