Check out jobserver on Spark. Haven't used it myself but would love to know your feedback around it.
On Monday, February 17, 2014, Ognen Duzlevski <[email protected]> wrote: > Hello, > > I am constructing a data pipeline which relies on Spark. As part of this > exercise, I would like to provide my users a web based interface to submit > queries that would translate into Spark jobs. So, something like "user > enters dates and other criteria for e.g. retention analysis" => this ends > up being some kind of a RESTful API call with appropriate json sent to > server => this ends up being some kind of a spark .filter.map.reduceByKey > thing => this ends up sending a json formatted reply back to web interface. > > Is there anything available now to take care of the RESTful step? If not, > how are people going about setting up this "mini" workflow? > > Thanks! > Ognen > -- Sent from Gmail Mobile
