chitralverma commented on issue #6535:
URL: https://github.com/apache/opendal/issues/6535#issuecomment-3254629979

   > Would you like to take on implementing full glob support at the same time
   
   Yes, I was thinking of doing this for core and python bindings in 1 PR
   
   > I'd like to see some native service support first to understand how it 
works
   
   I might be wrong here, but from most of the services supported by opendal, 
   - Only Fs (local filesystem), HDFS (via globStatus, but need to recheck 
because of [this](https://issues.apache.org/jira/browse/HDFS-2461)) and GCS 
(via explicit matchGlob) provide server-side globbing facilities. 
   - S3/ MinIO/ COS/ OSS/ Azure Blob/ etc offer prefix/ delimiter listing only, 
so OpenDAL must list and then filter client-side to emulate glob.   
   - FTP/ SFTP/ WebDAV/ HTTP — behavior depends on server; don’t rely on 
standard glob support.
   - DB backends - no objects so, most like this will be a SQL `LIKE`/ `RLIKE` 
pushdown
   
   So, I was thinking that we can do a "best effort" glob implementation in 
opendal directly like how fsspec did it, and later the service can simply 
override it if required.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@opendal.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to