RE: can't start spark thrift after Configuring YARN container executor

2019-10-10 Thread Manuel Sopena Ballesteros
Thank you very much Prabhu, Deleting the /d0 folder fixed the issue Manuel From: Prabhu Josephraj [mailto:pjos...@cloudera.com] Sent: Thursday, October 10, 2019 6:17 PM To: Manuel Sopena Ballesteros Cc: user@hadoop.apache.org Subject: Re: can't start spark thrift after Configuring YARN

Re: can't start spark thrift after Configuring YARN container executor

2019-10-10 Thread Prabhu Josephraj
As per the error, spark user does not have permission to create directory under NodeManager Local Directory or the existing spark user directory is with stale uid or gid. *Permission denied Can't create directory /d1/hadoop/yarn/local/usercache/spark/appcache/application_1570681803028_0018* 1.

can't start spark thrift after Configuring YARN container executor

2019-10-10 Thread Manuel Sopena Ballesteros
Dear Hadoop community, I am trying to configure yarn container executor following this document https://www.ibm.com/support/knowledgecenter/en/SSPT3X_4.2.5/com.ibm.swg.im.infosphere.biginsights.install.doc/doc/inst_adv_yarn_config.html I follow all the steps but after restart YARN I can't start