Sorry wrong format: file:///home/wxhsdp/spark/example/standalone/README.md
An extra / is needed at the start. On Thu, Apr 24, 2014 at 1:46 PM, Adnan Yaqoob <nsyaq...@gmail.com> wrote: > You need to use proper url format: > > file://home/wxhsdp/spark/example/standalone/README.md > > > On Thu, Apr 24, 2014 at 1:29 PM, wxhsdp <wxh...@gmail.com> wrote: > >> i think maybe it's the problem of read local file >> >> val logFile = "/home/wxhsdp/spark/example/standalone/README.md" >> val logData = sc.textFile(logFile).cache() >> >> if i replace the above code with >> >> val logData = sc.parallelize(Array(1,2,3,4)).cache() >> >> the job can complete successfully >> >> can't i read a file located at local file system? anyone knows the reason? >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/how-to-set-spark-executor-memory-and-heap-size-tp4719p4740.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> > >
