The REPL spins up an org.apache.spark.HttpServer, which provides classes that are generated by the REPL as well as jars from addJar.
Michael On Thu, Apr 17, 2014 at 1:58 PM, Zhan Zhang <zhaz...@gmail.com> wrote: > Please help, I am knew to both Spark and scala. > > I am trying to figure out how spark distribute the task to workers in REPL. > I only found the place where task is serialized and sent, and workers > deserialize and load the task with the class name by ExecutorClassLoader. > But I didn't find how the driver uploaded the REPL generated .class/jar > file > by REPL to file server/hdfs. My understanding is that the worker has to > know > the class as well to instantiate the task. > > Does anybody know where the code is (file or function name) or my > undertanding is wrong? > > Thanks. > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-REPL-question-tp6331.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. >
