Hi Raymond: Thanks for asking. Recently, I learned the usage of azure pipeline and referred to how Apache Flink does, which seems to be feasible. I haven't investigated GitHub action, since azure pipeline is feasible.
Besides, Azure do provide free plan for open source project. The same page you mentioned: https://azure.microsoft.com/en-us/pricing/details/devops/azure-devops-services/ At 2020-12-23 16:09:14, "Raymond Xu" <[email protected]> wrote: >Hi @vinoyang @wangxianghu, > >just want to follow up on this work. Any update on the current status? >Particularly, I'm interested in > >1. does Azure provide free plan for open source project? from this page ><https://azure.microsoft.com/en-us/pricing/details/devops/azure-devops-services/> >I see only 1 parallel job allowed for free plan >2. have we explored GitHub Actions for this purpose? looks like it has >similar features as Azure Pipelines and also free to open source ><https://docs.github.com/en/free-pro-team@latest/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions>. >I suppose it is also first class supported by GitHub. I think it could be a >good candidate for all CI/CD work: testing, nightly build, perf benchmark, >etc > >Thanks. > >On Fri, Dec 11, 2020 at 7:28 AM Vinoth Chandar <[email protected]> wrote: > >> No worries. If you could share how far you got and what the next steps are >> and if you still think its the right direction, it ll help the person >> picking this up :) >> >> On Fri, Dec 11, 2020 at 3:52 AM vino yang <[email protected]> wrote: >> >> > Hi, >> > >> > Sorry. >> > Due to busy work, I interrupted this verification work. I will let >> > @wangxianghu continue to follow up this work. >> > >> > Best, >> > Vino >> > >> > Vinoth Chandar <[email protected]> 于2020年12月11日周五 下午3:25写道： >> > >> > > Thanks for kicking this off, Gary! >> > > >> > > Thanks to Raymond, the CI tests are leaner and more parellelized now. >> > But I >> > > do see that we hit travis queuing a lot. >> > > Is that what you are targeting primarily? >> > > >> > > We were exploring a move to Azure CI Pipelines to get more compute >> power >> > > allocated at some point. >> > > @vinoyang , IIRC, you were driving this? Could you please share your >> > > experience? >> > > >> > > On Thu, Dec 10, 2020 at 9:53 PM Gary Li <[email protected]> >> wrote: >> > > >> > > > Hi all, >> > > > >> > > > I am seeing we have a boost on PRs recently. That's great news that >> > more >> > > > developers joined the Hudi community. >> > > > >> > > > On the other hand, the Travis build backlog was growing as well. As >> we >> > > > grow, we need to scale the CI/CD pipeline soon. So I'd like to start >> a >> > > > discussion here. >> > > > >> > > > Do we have any ongoing work on this topic? Anyone from larger open >> > source >> > > > projects like Spark/Flink e.t.c can share experience about how they >> > > handle >> > > > this problem? >> > > > >> > > > Any thoughts are appreciated. >> > > > >> > > > Best, >> > > > >> > > > Gary Li >> > > > >> > > >> > >>
