[GitHub] [airflow] potiuk commented on pull request #25702: Add groups in CI output for parallell tasks

[GitBox]

potiuk commented on PR #25702:
URL: https://github.com/apache/airflow/pull/25702#issuecomment-1215876548

   This one addresses the problem of having nice, usable output of optimized, 
parallel execution of our CI jobs using the new breeze:
   
   * building CI images
   * building PROD images
   * pulling images
   * building constraints
   
   In a follow-up PR I will also switch remaining tests to use it: Docker 
Compose, Helm and finally Regular tests to use it (which should complete Breeze 
converstion to Python.
   
   What we get is:
   
   * no more problems with ci groups overlapping each-other. The output groups 
of Github are non-hierarchical (one level deep) and this change follow it 
nicely (no further grouping if logs are already in a group)
   * nicer command foldable CI output
   
   <img width="666" alt="Screenshot 2022-08-15 at 23 19 10" 
src="https://user-images.githubusercontent.com/595491/1
   
   When folding expanded:
   
   <img width="694" alt="Screenshot 2022-08-15 at 23 20 27" 
src="https://user-images.githubusercontent.com/595491/184720536-728996ae-6492-4dcd-8ee2-1d7bf42e4a7f.png";>
   
   * nice and "smart" progresss output while the parallel execution happens. It 
understands what kind of output is showing real progresss for the types of 
outputs we know (docker build/pull/pytest etc).
   
   <img width="1354" alt="Screenshot 2022-08-15 at 23 31 33" 
src="https://user-images.githubusercontent.com/595491/184722126-1c0f24dc-ae0e-49ad-a720-9d4fea2c5d0a.png";>
   
   Including Pytest "%" progress
   
   <img width="1424" alt="Screenshot 2022-08-15 at 23 32 45" 
src="https://user-images.githubusercontent.com/595491/184722375-868daaf7-f517-4877-8a25-3d5002812439.png";>
   
   
   * Folded "per-parallle-run" output that allows to see easily what happened 
in each run:
   
   Folded:
   
   <img width="563" alt="Screenshot 2022-08-15 at 23 24 40" 
src="https://user-images.githubusercontent.com/595491/184721524-2164f94d-462f-4ce1-95ee-343ebc2dd67c.png";>
   
   
   Unfolded PROD 3.7:
   
   <img width="922" alt="Screenshot 2022-08-15 at 23 26 14" 
src="https://user-images.githubusercontent.com/595491/184721378-127da248-6576-40c0-b0c4-ac15991a74d2.png";>
   
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org