cruseakshay opened a new pull request, #64941: URL: https://github.com/apache/airflow/pull/64941
## Summary Decouples `S3ObjectStorageProvider` from `apache-airflow-providers-common-sql` into `apache-airflow-providers-amazon`. **Architecture:** - `common-sql` defines the `ObjectStorageProvider` abstraction and all object storage providers (LocalStorage, S3, future GCS/Azure) are resolved at runtime via `ProvidersManager`. **Key changes:** - Add `object-storage-providers` registration mechanism to `ProvidersManager` (schema, discovery, property) - Move `S3ObjectStorageProvider` to `providers/amazon/aws/datafusion/object_storage.py` - Update `common-sql` to dynamically resolve storage providers via the `ProvidersManager` registry - Add backward-compatible deprecation shim for old `S3ObjectStorageProvider` import path - Remove `amazon` dependency from `common-sql` `pyproject.toml` **Follow-up PRs:** - decouple LocalStorage - Add Azure Blob Storage (az://). - Add Google Cloud Storage (gs://) **Testing:** - E2E integration test: verified with AWS S3 bucket using `AnalyticsOperator` related: #62867 --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes — Cursor following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
