nathadfield opened a new issue #17032:
URL: https://github.com/apache/airflow/issues/17032


   **Description**
   
   `BigQueryInsertJobOperator` requires the submission of a `configuration` 
parameter in the form of a dict.  Unfortunately, if this contains a large SQL 
query - especially one that is formatted with new lines - then this cannot 
currently be rendered very nicely in the UI.
   
   <img width="1670" alt="Screenshot 2021-07-15 at 15 39 33" 
src="https://user-images.githubusercontent.com/967119/125806943-839d57a9-d4a0-492d-b130-06432b095239.png";>
   
   **Use case / motivation**
   
   The issue with this is that it impossible to copy and paste the rendered 
query out of the Airflow UI, into a BigQuery browser and run it without lots of 
manual edits which is time wasted when troubleshooting problems.
   
   **Are you willing to submit a PR?**
   
   Yes.  My current thought process around this would be to add an optional SQL 
parameter to the operator which, if provided, would be added into the 
configuration and could therefore have its own template field and SQL renderer.
   
   e.g.
   
   <img width="1570" alt="Screenshot 2021-07-14 at 14 18 09" 
src="https://user-images.githubusercontent.com/967119/125808200-5f30b8f4-4def-48a7-8223-82afdc65c973.png";>
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to