liupc opened a new pull request #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580 ## What changes were proposed in this pull request? Currently, some ML library may generate large ml model, thus causing executor may not able to deserialize it and result in OOM failures, user specified closure which refers large data may also have this problem. In order to facilitate the debuging of memory problem caused by large taskBinary broadcast, we may should add same warning logs for it. ## How was this patch tested? NA-Just log changes. Please review http://spark.apache.org/contributing.html before opening a pull request.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
