have used these configs in the paths to clean up the executor logs.
>
> .set("spark.executor.logs.rolling.time.interval", "minutely")
> .set("spark.executor.logs.rolling.strategy", "time")
> .set("spark.executor.logs.rolling
Intermittently on spark executors we are seeing blockmgr directories not being
cleaned up after execution and is filling up disk. These executors are using
Mesos dynamic resource allocation and no single app using an executor seems to
be the culprit. Sometimes an app will run and be cleaned up
