You need to use proper url format: file://home/wxhsdp/spark/example/standalone/README.md
On Thu, Apr 24, 2014 at 1:29 PM, wxhsdp <wxh...@gmail.com> wrote: > i think maybe it's the problem of read local file > > val logFile = "/home/wxhsdp/spark/example/standalone/README.md" > val logData = sc.textFile(logFile).cache() > > if i replace the above code with > > val logData = sc.parallelize(Array(1,2,3,4)).cache() > > the job can complete successfully > > can't i read a file located at local file system? anyone knows the reason? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/how-to-set-spark-executor-memory-and-heap-size-tp4719p4740.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
