Would you please send out the configurations of dynamic allocation so we could know better.
On Wed, Mar 9, 2016 at 4:29 PM, Jy Chen <chen.wah...@gmail.com> wrote: > Hello everyone: > > I'm trying the dynamic allocation in Spark on YARN. I have followed > configuration steps and started the shuffle service. > > Now it can request executors when the workload is heavy but it cannot > remove executors. I try to open the spark shell and don’t run any command, > no executor is removed after spark.dynamicAllocation.executorIdleTimeout > interval. > Am I missing something? > > Thanks. > >
