Re: 21/09/27 23:34:03 WARN YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

2021-09-28 Thread davvy benny
Thank you For the answer I have set now these properties as you suggest SparkConf sparkConf = new SparkConf().setAppName("simpleTest2").setMaster("yarn") .set("spark.executor.memory", "1g") .set("deploy.mode",

Re: 21/09/27 23:34:03 WARN YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

2021-09-28 Thread davvy benny
How can I check it? On 2021/09/28 03:29:45, Stelios Philippou wrote: > It might be possible that you do not have the resources on the cluster. So > your job will remain to wait for them as they cannot be provided. > > On Tue, 28 Sep 2021, 04:26 davvy benny, wrote: > > > How can I solve the

Re: 21/09/27 23:34:03 WARN YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

2021-09-27 Thread Stelios Philippou
It might be possible that you do not have the resources on the cluster. So your job will remain to wait for them as they cannot be provided. On Tue, 28 Sep 2021, 04:26 davvy benny, wrote: > How can I solve the problem? > > On 2021/09/27 23:05:41, Thejdeep G wrote: > > Hi, > > > > That would

Re: 21/09/27 23:34:03 WARN YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

2021-09-27 Thread davvy benny
How can I solve the problem? On 2021/09/27 23:05:41, Thejdeep G wrote: > Hi, > > That would usually mean that the application has not been allocated the > executor resources from the resource manager yet. > > On 2021/09/27 21:37:30, davvy benny wrote: > > Hi > > I am trying to run spark

Re: 21/09/27 23:34:03 WARN YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

2021-09-27 Thread Thejdeep G
Hi, That would usually mean that the application has not been allocated the executor resources from the resource manager yet. On 2021/09/27 21:37:30, davvy benny wrote: > Hi > I am trying to run spark programmatically from eclipse with these > configurations for hadoop cluster locally >

21/09/27 23:34:03 WARN YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

2021-09-27 Thread davvy benny
Hi I am trying to run spark programmatically from eclipse with these configurations for hadoop cluster locally SparkConf sparkConf = new SparkConf().setAppName("simpleTest2").setMaster("yarn") .set("spark.executor.memory", "1g")