nikhilsh2003 commented on issue #37445: URL: https://github.com/apache/beam/issues/37445#issuecomment-5536771097
Hi @hjtran, I’d like to work on this issue if no one is currently working on it. From the discussion, it looks like the main problem is with "gs://" paths when the "gcp" extra isn’t installed. "GCSFileSystem" fails during import/registration, so "FileSystems.get_filesystem()" can’t return it, while S3 handles the missing dependency differently. I’m planning to trace how "GCSFileSystem" is imported and registered, figure out why the import fails without the GCP dependency, and see how we can make the filesystem discoverable without changing the behavior when it’s actually used. I’ll also add a regression test for the missing "gcp" dependency case and make sure the existing behavior with the "gcp" extra installed still works. Please let me know if someone is already working on this. Otherwise, I’d be happy to pick it up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
