shuhoy opened a new issue #22034: URL: https://github.com/apache/airflow/issues/22034
### Apache Airflow Provider(s) google ### Versions of Apache Airflow Providers `apache-airflow-providers-google==6.3.0` ### Apache Airflow version 2.2.3 ### Operating System Linux ### Deployment Composer ### Deployment details - Composer Environment version: `composer-2.0.3-airflow-2.2.3` ### What happened When I use BigQueryToGCSOperator, I got following error. ``` Invalid dataset ID "MY_PROJECT:MY_DATASET". Dataset IDs must be alphanumeric (plus underscores and dashes) and must be at most 1024 characters long. ``` ### What you expected to happen I guess that it is due to I use colon (`:` ) as the separator between project_id and dataset_id in `source_project_dataset_table `. I tried use dot(`.`) as separator and it worked. However, [document of BigQueryToGCSOperator](https://airflow.apache.org/docs/apache-airflow-providers-google/stable/_api/airflow/providers/google/cloud/transfers/bigquery_to_gcs/index.html) states that it is possible to use colon as the separator between project_id and dataset_id. In fact, at least untill Airflow1.10.15 version, it also worked with colon separator. In Airflow 1.10.*, it separate and extract project_id and dataset_id by colon in bigquery hook. But `apache-airflow-providers-google==6.3.0` doesn't have this process. https://github.com/apache/airflow/blob/d3b066931191b82880d216af103517ea941c74ba/airflow/contrib/hooks/bigquery_hook.py#L2186-L2247 ### How to reproduce You can reproduce following steps. - Create a test DAG to execute BigQueryToGCSOperator in Composer environment(`composer-2.0.3-airflow-2.2.3`). - And give `source_project_dataset_table` arg source BigQuery table path in following format. - Trigger DAG. ``` source_project_dataset_table = 'PROJECT_ID:DATASET_ID.TABLE_ID' ``` ### Anything else _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
