potiuk commented on issue #31105: URL: https://github.com/apache/airflow/issues/31105#issuecomment-1537141579
> Haven't worked in airflow before, I could potentially open a PR if someone can describe what the fix should be I think you pretty well described it :) . > What you think should happen instead > Either > The log file should be truncated and an error shown that there's not enough RAM, or > The log file should not be fully realized into RAM and should be streamed to frontend instead One of those seems to be a good solution, just the place where airflow loads the file in memory has to be find and one of the solutions above appied (there are many different ways of loading logs - depending on the view you used and state of the log (for example if there is remote logging or streaming it is different than when local logs are used and different when celery logs are used). I marked it as good-first-issue for you whoever would like to fix it , it's likely a bit more than first issue though and requires quite a bit of digging in the code, but if someone knows a bit about Python/webserver/flask it should not be that difficult to find the right place. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
