jscheffl commented on PR #38021:
URL: https://github.com/apache/airflow/pull/38021#issuecomment-1987367787
> Just a warning - there **might** be some non-trivial performance issue
created by it. But I think it's worth risking it.
Okay, did a test with a DAG and just created ~40.000 and ~400.000 log lines:
- 40k lines: loading time 1-2s in grid view
- 400k lines: loading time of 12-15s, then scrolling and
viewing/folding/unfolding was 100% smooth
- View of same logs in "Legacy" non Grid foll-screen log view took only 6s!
Test on Core i7-1280P / HP Laptop / Firefox (other browsers might be even
faster)
Test on Airflow running via breeze, NOT dev mode (optimized JS compiled!)
Note that production of 400k print lines of LOG in Python 3.11 took 55
seconds to execute - viewing logs in browser after 15s was quite fast for this
:-D - Log file was in total 32MB for 400.000 lines
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
