turbaszek commented on a change in pull request #13598:
URL: https://github.com/apache/airflow/pull/13598#discussion_r555751716
##########
File path:
airflow/providers/google/cloud/example_dags/example_bigquery_queries.py
##########
@@ -125,6 +126,39 @@
)
# [END howto_operator_bigquery_select_job]
+ extract_job = BigQueryInsertJobOperator(
+ task_id="extract_to_gcs_job",
+ configuration={
+ "extract": {
+ "sourceTable": {
+ "projectId": PROJECT_ID,
+ "datasetId": DATASET_NAME,
+ "tableId": TABLE_1,
+ },
+ "destinationUris":
["gs://example_bucket/dump/table.*.csv.gz"],
Review comment:
No because this will require gcs test to be run before running bq test.
Creating a bucket is simple like that:
https://github.com/apache/airflow/blob/7c5cdcf30b2967c3e9f3652e58021a8553be1029/tests/providers/google/cloud/operators/test_bigquery_system.py#L38
also, if you need to a file to be uploaded to this bucket you can do:
https://github.com/apache/airflow/blob/7c5cdcf30b2967c3e9f3652e58021a8553be1029/tests/providers/google/cloud/operators/test_dataproc_system.py#L56
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
