kadubhumika commented on issue #73721:
URL: https://github.com/apache/airflow/issues/73721#issuecomment-5833404067
Hi maintainers @Zhnz ! I would like to work on this issue and submit a Pull
Request to fix the pagination logic in `os_task_handler.py`.
Proposed Action Plan:
1. Fix Pagination Logic: Update the `_os_read` method in
`os_task_handler.py`. Currently, it hardcodes the pagination offset to `0` and
size to `1000`. I will modify it to iteratively fetch logs in
`MAX_LINE_PER_PAGE` increments until all available log lines (`max_log_line`)
are retrieved.
2. Code Cleanup: Remove the old, unused duplicate copy of `_os_read` inside
the `OpensearchTaskHandler` class to improve overall code clarity.
3. Testing: Verify the fix with test cases covering log chunks larger than
1000 lines.
Could you please assign this issue to me? Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
