> On Dec. 11, 2014, 1:39 a.m., Chris Mattmann wrote: > >
I put all of the Spark stuff in a spark package so that it is seperated from the rest of the resource manager. It is an inter-dependent set of code. Do you really want me to sort its components out in to the various other subdirectories? If so, I can. - Michael ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28917/#review64662 ----------------------------------------------------------- On Dec. 10, 2014, 9:38 p.m., Michael Starch wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/28917/ > ----------------------------------------------------------- > > (Updated Dec. 10, 2014, 9:38 p.m.) > > > Review request for oodt and Chris Mattmann. > > > Repository: oodt > > > Description > ------- > > This change allows Spark jobs to be run in the resource manager. It > integrates with a generic Spark daemon, so spark can be run locally, as a > test spark cluster, and in mesos (not affiliated with the resouce manager > mesos integration). > > This is a solution to: https://issues.apache.org/jira/browse/OODT-780 > > > Diffs > ----- > > trunk/core/pom.xml 1644524 > > trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/SparkInstance.java > PRE-CREATION > > trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/SparkScheduler.java > PRE-CREATION > > trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/SparkSchedulerFactory.java > PRE-CREATION > > trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/StreamingInstance.java > PRE-CREATION > > trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/examples/NoSparkFilePalindromeExample.java > PRE-CREATION > > trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/examples/PalindromeUtils.java > PRE-CREATION > > trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/examples/SparkFilePalindromeExample.java > PRE-CREATION > > trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/examples/StreamingPalindromeExample.java > PRE-CREATION > trunk/resource/src/main/resources/examples/jobs/exPalindrome.xml > PRE-CREATION > trunk/resource/src/main/resources/examples/jobs/exSparkJob.xml PRE-CREATION > trunk/resource/src/main/resources/examples/jobs/exSparkPalindrome.xml > PRE-CREATION > trunk/resource/src/main/resources/examples/jobs/exStreamingPalindrome.xml > PRE-CREATION > trunk/resource/src/main/resources/resource.properties 1644524 > > trunk/resource/src/main/scala/org/apache/oodt/cas/resource/examples/ScalaHelloWorld.scala > PRE-CREATION > > Diff: https://reviews.apache.org/r/28917/diff/ > > > Testing > ------- > > Demonstration created, demonstration jobs run and benchmarks taken. > > > Thanks, > > Michael Starch > >
