attilapiros commented on issue #23560: [SPARK-26632][Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-471705817 @zjf2012 I see and thanks for the explanation. But I am still very curious what would be the result on the biggest cluster with 16 and with 30 threads running the old code (if possible and not too much to ask). As right now I have the feeling we are comparing apples and oranges (with the 8). Still I think this separation has very good tuning potential. Have you thought about setting the default value depending on the other specified value (like ed = 3 * dd)? This could be done of course in a separate PR. ping @squito
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
