The GitHub Actions job "Tests" on airflow.git has failed.
Run started by GitHub user ashb (triggered by ashb).

Head commit for run:
1b18a501fe818079e535838fa4f232b03365fc75 / Daniel Standish 
<[email protected]>
Enable individual trigger logging (#27758)

FileTaskHandler is updated so that it can be used by triggerer job to write 
messages from distinct triggers such that they are visible in web UI task logs. 
 Messages from all relevant sources are merged and interleaved in the same task 
log pane.

Due to variation in FileTaskHandler implementations, we needed some extra 
params set so triggerer job can use them appropriately.  For some we need to 
use QueueListener pattern, for some we need to put many instances (one per 
trigger) behind a wrapper class.  For this purpose we introduce some config 
params you can set on handler instance or class.  Context vars are used so that 
handler can map messages to the correct TI.  And these changes to log handling 
in triggerer job are entirely disableable.

Also add log serving capability to triggerer service for live logs with 
non-streaming handlers.

Added a TaskReturnCode for signaling so that log messages can be more accurate 
when deferring.  And when resuming we now have better messaging i.e. "resuming 
from deferral".

New method in FileTaskHandler which is for reading remote logs.  It's called 
along with other sources in _read and interleaved there.  Meta messages and 
actual log content are now separated so that messages are displayed at top 
after interleaving.

For interleaving we need to parse log timestamp so we make this pluggable in 
case user formatter is weird.

TI.next_kwargs is used to infer "has deferred" for "resuming from deferral 
messaging".

TabWithTooltip class is added in web UI js. It can be used for adding tooltips 
for tabs. We didn't end up needing it, but Brent went through the trouble to 
write it and it may come in handy.

In the chart, we need triggerer to be a service (instead of deployment) in 
order for logs serving to work out of the box.  This is only enabled when 
airflowVersion in your chart values is >= 2.6.0.

---------

Co-authored-by: Tzu-ping Chung <[email protected]>
Co-authored-by: Jed Cunningham <[email protected]>
Co-authored-by: Brent Bovenzi <[email protected]>

Report URL: https://github.com/apache/airflow/actions/runs/4094168065

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to