Github user kayousterhout commented on the pull request:
https://github.com/apache/spark/pull/1124#issuecomment-46529444
So this can make performance worse for folks that set spark.akka.frameSize
in the SparkConf that's on the executor to be higher, right, because this
commit means we effectively ignore that parameter setting? Can we just figure
out what the max frame size actually is for the backend actor system?
Also, this can lead to hung jobs if a user set the frame size to lower than
the default of 10, right? @pwendell said you guys chose to ignore this case
but it would be nice to add a comment explicitly stating this in the code in
case it turns up as a bug later.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
