Hello - i've HDP 2.5.x and i'm trying to launch spark-shell ..
ApplicationMaster gets launched, but YARN is not able to assign containers.

*Command ->*

./bin/spark-shell --master yarn-client --driver-memory 512m
--executor-memory 512m

*Error ->*

[Sun Aug 06 19:33:29 +0000 2017] Application is added to the scheduler and
is not yet activated. Queue's AM resource limit exceeded. Details : AM
Partition = <DEFAULT_PARTITION>; AM Resource Request = <memory:2048,
vCores:1>; Queue Resource Limit for AM = <memory:6144, vCores:1>; User AM
Resource Limit of the queue = <memory:6144, vCores:1>; Queue AM Resource
Usage = <memory:6144, vCores:3>;

Any ideas on what parameters to change ?

Pls note -> In YARN, the parameter -
= 0.9* , AM should have access sufficient to assign container

Reply via email to