Brunda10 opened a new pull request, #54657: URL: https://github.com/apache/airflow/pull/54657
The XComObjectStorageBackend currently checks compression support using `fsspec.utils.compressions`. This is a static mapping and does not include dynamically available algorithms like **snappy**, even when installed. As a result, pushing XComs with `AIRFLOW__COMMON_IO__XCOM_OBJECTSTORAGE_COMPRESSION=snappy` fails with: `ValueError: Compression snappy is not supported. Make sure it is installed` Fix: - Replaced the check to use `fsspec.available_compressions()`, which dynamically returns the installed compression libraries. - This ensures that `snappy` and other optional compression algorithms are supported. closes : #54182 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
