mobuchowski opened a new issue, #38767: URL: https://github.com/apache/airflow/issues/38767
### Body There is need to decide how and where the mapping will take place. Natural space for this is provider - they should "take ownership" of particular AIP-60 URI scheme, and be able to convert between those (with some help of hook code?). It's a part of the task to determine how OpenLineage provider, given AIP-60 dataset would determine which provider the URI scheme is responsible for, and how to successfully use that information to get the converted dataset. There is a possiblity that for some cases direct hook usage will be needed - research those and determine if we need particular instance of hook. Then, the HookLineageCollector would accept pair of Additional complexity is Object Storage - to check if is it possible to use AIP-60 URI scheme in object storage even if the corresponding provider is not present. ### Committer - [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
