Re: Travis builds in a queue for hours

2019-07-10 Thread Jarek Potiuk
Hello Everyone, I have some really good news. I just had a call with Google OSS team (Gris, Aizhamal) and they are willing to donate VMs on Google Cloud Platform to run CI for Airflow. In order to simplify the setup (and make sure it is ok according to Apache regulations) we think we should go exa

Re: Travis builds in a queue for hours

2019-07-10 Thread Bolke de Bruin
Awesome! But I hope you are not serious about using Jenkins right? If I need to start a Holy War it would be against Jenkins. B. Verstuurd vanaf mijn iPad > Op 10 jul. 2019 om 22:55 heeft Jarek Potiuk het > volgende geschreven: > > Hello Everyone, > > I have some really good news. I just ha

Re: Travis builds in a queue for hours

2019-07-10 Thread Bolke de Bruin
If you need an alternative why not use a couple of gitlab-ci runners? Much easier to maintain, light weight, and much closer to what we use now. B. Verstuurd vanaf mijn iPad > Op 10 jul. 2019 om 23:27 heeft Bolke de Bruin het > volgende geschreven: > > Awesome! But I hope you are not serious

Re: Travis builds in a queue for hours

2019-07-10 Thread Jarek Potiuk
It does not need to be Jenkins (we will hopefully get VMs that we can put whatever on) - but it seems that (If it works out of course which is something we need to finalise) from "process" point of view following the footsteps of Apache Beam and using the same setup might be one of the best choices

Re: Travis builds in a queue for hours

2019-07-10 Thread Jarek Potiuk
Yeah. Gitlab CI is definitely what I would prefer as well from the "modernity" point of view (and one of my very close friends is Gitlab CI maintainer and actually The person who introduced CI to GitLab offering). I also actually already catalysed discussion between GitLab and Apache infrastructure

Re: Travis builds in a queue for hours

2019-07-10 Thread Aizhamal Nurmamat kyzy
Hi all, I am still working on trying to get approvals for this, so this is not yet a done deal. I'll keep y'all updated. As for the CI solution to use, we have no particular inclination. As long as the community supports it, and it is consistent with any Apache guidelines for CI from their projec

Re: Travis builds in a queue for hours

2019-07-10 Thread Driesprong, Fokko
Regardings the numbers, I believe that INFRA has an overview of the usage per project. I think they are happy to share these numbers with you. Also, it seems like there is also a queue in Jenkins: https://status.apache.org/ Talking about Jenkins. I'm not a big fan of it. For example, Spark uses it

Re: Travis builds in a queue for hours

2019-07-10 Thread Jarek Potiuk
Since more than few people (including myself) are in favour of GitLab CI, and since Apache Infra is talking to GitLab CI, I will make sure to check if we can combine the two approaches - workers from Google and managed, central GitlabCI interface to manage it (likely managed by the Infra team). Air