uranusjr commented on code in PR #37005: URL: https://github.com/apache/airflow/pull/37005#discussion_r1502216715
########## docs/apache-airflow/authoring-and-scheduling/datasets.rst: ########## @@ -63,10 +63,19 @@ A dataset is defined by a Uniform Resource Identifier (URI): Airflow makes no assumptions about the content or location of the data represented by the URI. It is treated as a string, so any use of regular expressions (eg ``input_\d+.csv``) or file glob patterns (eg ``input_2022*.csv``) as an attempt to create multiple datasets from one declaration will not work. -There are two restrictions on the dataset URI: +A dataset should be created with a valid URI. Airflow core and providers define various URI schemes that you can use, such as ``file`` (core), ``https`` (by the HTTP provider), and ``s3`` (by the Amazon provider). Third-party providers and plugins may also provide their own schemes. These pre-defined schemes have individual semantics that are expected to be followed. Review Comment: Move to #37698. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
