Hi, Jenkins also now supports pipeline as code and multibranch pipelines. thus you are not so dependent on the UI and you do not need anymore a long list of jobs for different branches. Additionally it has a new UI (beta) called blueocean, which is a little bit nicer. You may also check GoCD. Aside from this you have a huge variety of commercial tools, e.g. Bamboo. In the cloud, I use for my open source github projects Travis-Ci, but there are also a lot of alternatives, e.g. Distelli.
It really depends what you expect, e.g. If you want to Version the build pipeline in GIT, if you need Docker deployment etc. I am not sure if new starters should be responsible for the build pipeline, thus I am not sure that i understand your concern in this area. From my experience, integration tests for Spark can be run on any of these platforms. Best regards > On 13 Mar 2017, at 10:55, Sam Elamin <hussam.ela...@gmail.com> wrote: > > Hi Folks > > This is more of a general question. What's everyone using for their CI /CD > when it comes to spark > > We are using Pyspark but potentially looking to make to spark scala and Sbt > in the future > > > One of the suggestions was jenkins but I know the UI isn't great for new > starters so I'd rather avoid it. I've used team city but that was more > focused on dot net development > > > What are people using? > > Kind Regards > Sam --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
