The tuning documentations tells us to have 2-3 tasks per CPU core > In general, we recommend 2-3 tasks per CPU core in your cluster.
I’m wondering how you’d actually accomplish this. Setting spark.task.cpus to a fraction like 0.5 or 0.3 does not work. Perhaps I’m misunderstanding, any advice is welcome, Regards, Hans --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
