jason810496 commented on PR #54445: URL: https://github.com/apache/airflow/pull/54445#issuecomment-3191176765
> The API should stream the log until the end, but there are still some errors with this process. I will work on a fix later. The root cause is that when the FileTaskHandler opens the file, it can only read content that has already been flushed to the file, and cannot access content that is still being written. Regardless of this error, the frontend should adapt to `application/nd-json`, which is the main change in this PR. The previous `application/json` format is very resource-intensive for the API server and may cause OOM issues when logs are large, even after the fix in https://github.com/apache/airflow/pull/49470. This is because JSON serialization requires the entire log content to be stored in a single large dictionary. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
