Re: spark on yarn is trying to use file:// instead of hdfs://

2014-06-20 Thread bc Wong
Koert, is there any chance that your fs.defaultFS isn't setup right? On Fri, Jun 20, 2014 at 9:57 AM, Koert Kuipers ko...@tresata.com wrote: yeah sure see below. i strongly suspect its something i misconfigured causing yarn to try to use local filesystem mistakenly. *

Re: problem starting the history server on EC2

2014-06-10 Thread bc Wong
What's the permission on /root itself? On Jun 10, 2014 6:29 PM, zhen z...@latrobe.edu.au wrote: I created a Spark 1.0 cluster on EC2 using the provided scripts. However, I do not seem to be able to start the history server on the master node. I used the following command: