Sabbir02 opened a new issue, #45861:
URL: https://github.com/apache/airflow/issues/45861

   ### Description
   
   Airflow's GCS integration previously included the delimiter parameter for 
filtering objects and allowed the use of wildcards in source object paths. 
However, these features were not natively supported by GCS and often caused 
confusion or misuse. To address this, the following changes have been proposed:
   1. Deprecation of delimiter parameter: This parameter is being deprecated 
due to its non-standard implementation and lack of native GCS support.
   2. Introduction of match_glob Parameter: A new match_glob parameter will 
allow for more accurate, native GCS filtering based on pattern matching.
   
   ### Use case/motivation
   
   The primary motivation for this change is to ensure Airflow's GCS 
integration aligns with GCS's native capabilities, improving reliability and 
user experience. The match_glob parameter will provide a straightforward, 
intuitive, and supported way to filter objects in GCS, reducing the potential 
for errors and confusion.
   
   ### Related issues
   
   This PR builds on [Issue 
#29115](https://github.com/apache/airflow/issues/29115) to improve Airflow's 
GCS integration. It removes the confusing delimiter parameter and replaces it 
with a new match_glob option for better, native pattern-based filtering. These 
changes make GCS integration simpler and more user-friendly.
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to