potiuk commented on issue #24422: URL: https://github.com/apache/airflow/issues/24422#issuecomment-1154883605
This is the proposal I mentioned in #23874. Apparently the Data Lineage effort will require more "SQL-bound" common functionality. Adding this "common functionality" in Airflow, is not very good, because it will only be released in 2.4 earliest, and it means that providers will be able to depend on those 12 months after. Having a common "SQL" provider which keeps such common code that other providers might depend on, is the way how to make such "common sql" functionality available for multiple providers instantly. We should just make dependency from (say) Presto, Postgres, MySQL , Trino, .... providers to the "sql" provider and we will be able to install and use those providers and the common function on Airflow 2.2 immediately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
