bbovenzi opened a new issue, #29405:
URL: https://github.com/apache/airflow/issues/29405

   ### Description
   
   Right now, the `get_log` endpoint at 
`/dags/{dag_id}/dagRuns/{dag_run_id}/taskInstances/{task_id}/logs/{task_try_number}`
 does not have any pagination and therefore we can be forced to load extremely 
large text blocks, which makes everything slow. (see the workaround fix we 
needed to do in the UI: https://github.com/apache/airflow/pull/29390)
   
   In `task_log_reader`, we do have `log_pos` and `offset` (see 
[here](https://github.com/apache/airflow/blob/main/airflow/utils/log/log_reader.py#L80-L83)).
 It would be great to expose those parameters in the REST API in order to break 
apart task instance logs into more manageable pieces.
   
   ### Use case/motivation
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to