I don’t know a lot about it except from the research side, where the team has done interesting optimization stuff for these types of applications. In terms of the engine, one thing I’m not sure of is whether Stratosphere allows explicit caching of datasets (similar to RDD.cache()) and interactive queries (similar to spark-shell). But it’s definitely an interesting project to watch.
Matei On Nov 22, 2013, at 4:17 PM, Ankur Chauhan <[email protected]> wrote: > Hi, > > That's what I thought but as per the slides on http://www.stratosphere.eu > they seem to "know" about spark and the scala api does look similar. > I found the PACT model interesting. Would like to know if matei or other core > comitters have something to weight in on. > > -- Ankur > On 22 Nov 2013, at 16:05, Patrick Wendell <[email protected]> wrote: > >> I've never seen that project before, would be interesting to get a >> comparison. Seems to offer a much lower level API. For instance this >> is a wordcount program: >> >> https://github.com/stratosphere/stratosphere/blob/master/pact/pact-examples/src/main/java/eu/stratosphere/pact/example/wordcount/WordCount.java >> >> On Thu, Nov 21, 2013 at 3:15 PM, Ankur Chauhan <[email protected]> >> wrote: >>> Hi, >>> >>> I was just curious about https://github.com/stratosphere/stratosphere >>> and how does spark compare to it. Anyone has any experience with it to make >>> any comments? >>> >>> -- Ankur >
