yatink commented on issue #31105: URL: https://github.com/apache/airflow/issues/31105#issuecomment-1694778625
The way that I'm thinking about solving this issue is to do so in 2 steps: 1. First, stop the webserver from crashing and pop a reasonable error message instead 1. Continue down the path that @killua1zoldyck had started and implement the k way merge to enable it to handle large log files I'm on the fence about whether they should be tracked as separate issues or not. I'll be able to give a more informed opinion after I've made more progress. @potiuk and/or @getaaron, let me know if step 1 is a reasonable short term approach or whether I should just skip it and do step 2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
