On Tue, Aug 26, 2014 at 12:42 PM, Roman Shaposhnik <[email protected]> wrote: > On Sat, Aug 23, 2014 at 6:32 PM, David Nalley <[email protected]> wrote: >> These slaves are on-demand. If they aren't setup properly to begin >> with, a lot of the value is lost. > > Question: is there any chance we can start utilizing this service for > Bigtop builds that are currently happening off of ASF Infra: > http://bigtop01.cloudera.org:8080/ > > The only reason we have to run a separate Jenkins (and have > Cloudera sponsor us with EC2 creds) is because we lack two > things: > * an ability to call a docker on our current slaves > * an ability to spin up clean test environments > > If either one of the above (or may be even both!) could be > solved with the new service from RS -- that would be huge > for us. > > Any suggestions on how to make it happen? >
So a couple of comments. 1. Would Cloudera consider sponsoring/allowing us to consume some of those EC2 credits? :) I think Dan's work on image generation would translate well to EC2. 2. While we have a generous grant from the folks at RAX, it's not unlimited, and we are still feeling our way around their cloud credits to make sure we don't have a ton of overages. I am excited that Bigtop would consider moving stuff to builds.a.o - but you also have a lot of jobs, I don't want to suddenly take on so much that we don't have enough executors, so lets work this out in small steps. Andrew and Giri probably have some thoughts here. --David
