----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28917/ -----------------------------------------------------------
Review request for oodt and Chris Mattmann. Repository: oodt Description ------- This change allows Spark jobs to be run in the resource manager. It integrates with a generic Spark daemon, so spark can be run locally, as a test spark cluster, and in mesos (not affiliated with the resouce manager mesos integration). This is a solution to: https://issues.apache.org/jira/browse/OODT-780 Diffs ----- trunk/core/pom.xml 1644524 trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/SparkInstance.java PRE-CREATION trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/SparkScheduler.java PRE-CREATION trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/SparkSchedulerFactory.java PRE-CREATION trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/StreamingInstance.java PRE-CREATION trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/examples/NoSparkFilePalindromeExample.java PRE-CREATION trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/examples/PalindromeUtils.java PRE-CREATION trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/examples/SparkFilePalindromeExample.java PRE-CREATION trunk/resource/src/main/java/org/apache/oodt/cas/resource/spark/examples/StreamingPalindromeExample.java PRE-CREATION trunk/resource/src/main/resources/examples/jobs/exPalindrome.xml PRE-CREATION trunk/resource/src/main/resources/examples/jobs/exSparkJob.xml PRE-CREATION trunk/resource/src/main/resources/examples/jobs/exSparkPalindrome.xml PRE-CREATION trunk/resource/src/main/resources/examples/jobs/exStreamingPalindrome.xml PRE-CREATION trunk/resource/src/main/resources/resource.properties 1644524 trunk/resource/src/main/scala/org/apache/oodt/cas/resource/examples/ScalaHelloWorld.scala PRE-CREATION Diff: https://reviews.apache.org/r/28917/diff/ Testing ------- Demonstration created, demonstration jobs run and benchmarks taken. Thanks, Michael Starch
