potiuk commented on pull request #13767:
URL: https://github.com/apache/airflow/pull/13767#issuecomment-770428606


   Hey @kaxil @ash @mik-laj  - I got - I think - final version of the provider 
PR finally working and green. It will fail here because it needs to be merged 
to MASTER to succeed but I got it running and "green" in my own fork here:
   
   https://github.com/potiuk/airflow/actions/runs/525666213
   
   The output is now sooo much nicer and shows exactly what's going on so that 
it is easy to grasp it. The logs are nicely folded in groups and all is 
colored. Also errors are much better visible, red and pop-out immediately.
   
   Some screenshots are taken from the CI job, but similar output you get as 
release manager when you are running ./breeze commands to see how many of the 
packages need version bump:
   
   Building PROD image using provider packages:
   
   ![Screenshot from 2021-01-31 
19-09-15](https://user-images.githubusercontent.com/595491/106393513-d5cd3700-63f7-11eb-9545-d8b64cfbe2fc.png)
   
   You can see that first all provider packages are built, then the main 
airflow package and the PROD image is built using those provider packages (by 
unfolding each package build you can see exact commands in each of the steps 
for each package:
   * generating setup files
   * checking if suffixes are fine
   * building the package
   
   Preparing provider documentation:
   
   You can see an example output genmerated by new neo4j proivider (fresh 
provider):
   
   ![Screenshot from 2021-01-31 
19-12-42](https://user-images.githubusercontent.com/595491/106393597-51c77f00-63f8-11eb-8527-bb7688f851d9.png)
   
   Similar output for packages that had some changes but their version has not 
been updated:
   
   
![image](https://user-images.githubusercontent.com/595491/106393635-96531a80-63f8-11eb-8fb8-f2135f8054d8.png)
   
   And another one when when the version is already updatead and package is 
ready for release:
   
   ![Screenshot from 2021-01-31 
19-17-28](https://user-images.githubusercontent.com/595491/106393726-1a0d0700-63f9-11eb-9efc-f39f140245a8.png)
   
   We also build and test ALL provider packages in the CI build separately (in 
PROD image build we only build a subset of those :
   
   
![image](https://user-images.githubusercontent.com/595491/106393821-6f491880-63f9-11eb-9353-6d690ad11561.png)
   
   In the "regular" provider's package. We install all the providers, see if 
everything can be imported and we test all `airflow providers` command to see 
if everything is good:
   
   
![image](https://user-images.githubusercontent.com/595491/106393885-c7801a80-63f9-11eb-8d2f-8df4f8ab1769.png)
   
   For Backport providers  we just check if the backport providers can be 
installed in latest 1.10.* released (1.10.14 now): 
   
   
![image](https://user-images.githubusercontent.com/595491/106393917-03b37b00-63fa-11eb-9e5a-6f4f891e4fd1.png)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to