mungiyo commented on issue #76805: URL: https://github.com/apache/airflow/issues/76805#issuecomment-6784451359
Tested [#73517](https://github.com/apache/airflow/pull/73517) on 9.40.0rc2 with Airflow 3.4.0 (official image, Python 3.13, S3 remote logging against LocalStack, `delete_local_logs = True`). Works as expected. - Core enters `S3RemoteLogIO.stream()` with the RC, `read()` with 9.39.0. - Read a 406.3 MiB / 2,000,000-line task log (multi-byte characters on every line) through `TaskLogReader.read_log_stream`: all lines come back in order and unmodified with both versions. Process max RSS goes 242 → 2,631 MiB on 9.39.0 and 242 → 345 MiB on 9.40.0rc2. - Same log through the api-server (`Accept: application/x-ndjson`) with the RC: 200, all 2,000,000 lines match, api-server RSS peak 407 → 427 MiB. - A task run and uploaded under the RC reads back correctly as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
