kunalyogenshah commented on issue #5164: [AIRFLOW-4396] Provide a link to external Elasticsearch logs in UI. URL: https://github.com/apache/airflow/pull/5164#issuecomment-486761108 Bringing this thread back up to share some alternate thoughts. I'd like to advocate for this approach specifically for just logs look up for the following reasons : - Using elasticsearch for now is quite well baked into the log handling, and Kibana is possibly the most common frontend for this. Using that as a frontend for visualizing / searching logs seems like quite a useful central feature to have as compared to a plugin. Semantically we'd use extra links plugin for features that are more specific to each individual Airflow DAG / Task / Provider. - This can be quite easily integrated and extended like the existing download logs / view logs, and seems on the same plane w.r.t. utility. - Also referring to the proposed metrics changes in this PR (https://github.com/apache/airflow/pull/5139), having a standalone endpoint for serving logs allows us to track metrics for just that endpoint better than a common extra links section. (like tracking views and failures, etc). Thoughts?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
