Abacn commented on issue #37445: URL: https://github.com/apache/beam/issues/37445#issuecomment-4583723855
The real difference for gcs and s3 here is due to that in s3io boto3 has been optional at import time. There is a module variable BOTO3_INSTALLED evaluated: https://github.com/apache/beam/blob/c31f23270416ca446dd4bfcdb896004106149916/sdks/python/apache_beam/io/aws/s3io.py#L43 Then it only prevents s3io object creation at runtime: https://github.com/apache/beam/blob/c31f23270416ca446dd4bfcdb896004106149916/sdks/python/apache_beam/io/aws/s3io.py#L66 I think a proper fix for gcsfilesystem should be in gcsio to make it follow same pattern -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
