liupc commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580#issuecomment-455932231 @srowen OK, this config maybe is not needed, I will remove this config, but the I think the log is necessary, for currently the log in TaskSetManager can not detect a large broadcast for a brocasted task is small in most cases. Maybe I should also add some warning logs on the executor side when reading large broacast.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
