Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/19881
@rxin I assume you are just trying to not use divisor since its not used
anywhere else? As @jcuquemelle state I don't see a use case for this to be
made more aggressive if you have one please let us know, but otherwise it just
wastes resources.
Personally I still like divisor because that is what you are doing. I
don't think because its not in any other configs is a good reason to not use
it. Looking at I don't see any public configs that have factor in the name of
them either. I am not fond of rate because its not a rate (ie how
quickly/slowly you are allocating), its a limit on max number of executors.
I also think its more natural for people to think of this as a divisor vs a
multiplier. if I want 1/2 of the executors you divide by 2. I think we
should name it based on what is most likely understood by the end user.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
