wno-xyt opened a new issue, #35408:
URL: https://github.com/apache/airflow/issues/35408

   ### Description
   
   Function `execute_notebook` in papermill accepts named parameter 
`log_output`: 
   ``` execute_notebook(nb, kernel_name, output_path=None, progress_bar=True, 
log_output=False, autosave_cell_every=30, **kwargs)```
   
   Unfortunatelly currently the interface of the provider package does not 
allow setting it to True.
   It would be great to have this possibility to have logs from executed 
notebook visible in airflow's task log. 
   If I understand correctly how this works setting `log_output=True` would 
just make papermill to use configured logger (in this case airflow's) for the 
output of the notebook. 
   
   ### Use case/motivation
   
   I think it would be nice to have logs from notebooks execution visible in 
airflow task log to be able to:
   - monitor progress
   - catch errors coming from inside the notebook easier
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to