shahar1 commented on issue #39127: URL: https://github.com/apache/airflow/issues/39127#issuecomment-2072947867
`BigQueryGetData`'s `generate_query()` method is used for submitting **deferred** jobs, while normally, the operator utilizes the hook's method `list_rows`. The latter utilizes BigQuery's API directly, **which does not support ordering clauses**. There are two options left: 1. Running the explicit query (including the ORDER BY clause) via `BigQueryInsertJobOperator`. 2. Performing the ordering in Python as part of the operator logic, but I'm not sure that there is a real advantage of having it instead of using `BigQueryInsertJobOperator`. @eladkal What do you think? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
