shubham22 commented on issue #23900: URL: https://github.com/apache/airflow/issues/23900#issuecomment-1189362249
Closed by https://github.com/apache/airflow/pull/25142 We (AWS OSS team) ended up going with output and error logs of the Glue driver, instead of fetching and displaying logs from each and every Glue Job. This solution provides more visibility into Glue Jobs and at the same time doesn't introduce complexity of managing logs at the job-level - CloudWatch (or any other tool customers use) will remain the solution for it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
