dejii commented on issue #54488: URL: https://github.com/apache/airflow/issues/54488#issuecomment-3186256672
Looking at [Job#JobConfigurationExtract](https://cloud.google.com/bigquery/docs/reference/rest/v2/Job#JobConfigurationExtract), there’s no parameter to control line terminators. Since `BigQueryToGCSOperator` relies directly on this API, the feature can be supported natively. If efficiency is the goal, you might consider streaming data directly from the table using the [BigQuery Storage Read API](https://cloud.google.com/bigquery/docs/reference/storage), formatting it as needed, and then uploading the result to GCS. The upload step can be batched to further improve performance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
