pierrejeambrun commented on PR #54377: URL: https://github.com/apache/airflow/pull/54377#issuecomment-3200168349
If you try to do this with tasks that have big logs (10M) the collapsing will help, but after expanding a couple of them, the page still becomes unresponsive. (Without this, it's unresponsive/crash on load). Yes ideally I think on the 'overview' we only want to show a sample, maybe the last 100 lines of the logs. For now we can just do this truncation in the UI. (for instance custom hook wrapping `useLogs` and truncating response based on a param right after the backend response is received, i.e onSuccess). The long term solution would be to implement a backend feature to be able to paginate logs as well as a read order (start to end, end to start), so we could read the last page of the logs with a size of '100' lines for instance. cc: @jason810496 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
