Fwd: Dynamic allocation doesn't work on YARN

Sorry,the last configuration is also --conf spark.dynamicAllocation.cachedExecutorIdleTimeout=60s, "--conf" was lost when I copied it to mail. -- Forwarded message -- From: Jy Chen Date: 2016-03-10 10:09 GMT+08:00 Subject: Re: Dynamic allocation doesn't

Fwd: Dynamic allocation doesn't work on YARN

Hello everyone: I'm trying the dynamic allocation in Spark on YARN. I have followed configuration steps and started the shuffle service. Now it can request executors when the workload is heavy but it cannot remove executors. I try to open the spark shell and don’t run any command, no executor is