dacort opened a new issue, #31620:
URL: https://github.com/apache/airflow/issues/31620

   ### Description
   
   Add extra links to the EMR Serverless operator for S3 logs as well as the 
[`GetDashboardForJobRun`](https://docs.aws.amazon.com/emr-serverless/latest/APIReference/API_GetDashboardForJobRun.html)
 API that returns a one-time link to the UI.
   
   ### Use case/motivation
   
   Allow for easier debugging of EMR Serverless jobs. Today, folks have to 
navigate through the AWS console to find the corresponding application and job 
run ID in order to gain access to the Spark UI or stdout/stderr logs. It'd be 
great to have direct links for both of those things.
   
   One potential challenge is that the URL returned by the 
[`GetDashboardForJobRun`](https://docs.aws.amazon.com/emr-serverless/latest/APIReference/API_GetDashboardForJobRun.html)
 API is both short-lived (expires after 1 hour) and one-time (expires on first 
use). I'm concerned about both poor user experience of clicking an expired or 
already used URL and the API impact of generating a URL every time the DAG 
popup is triggered even if it's not used. This may require some additional 
functionality in Airflow to implement.
   
   ### Related issues
   
   #29939
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to