yaooqinn commented on a change in pull request #815: URL: https://github.com/apache/incubator-kyuubi/pull/815#discussion_r671044026
########## File path: docs/tools/spark_block_cleaner.md ########## @@ -4,90 +4,105 @@ </div> -# Kubernetes tools spark-block-cleaner +# Kubernetes Tools Spark Block Cleaner ## Requirements You'd better have cognition upon the following things when you want to use spark-block-cleaner. * Read this article * An active Kubernetes cluster * [Kubectl](https://kubernetes.io/docs/reference/kubectl/overview/) +* [Docker](https://www.docker.com/) ## Purpose +During using Spark On Kubernetes with client deploy-mode, we encountered this scenario that the disk responsible for storing Shuffle data accumulates so many files cause the disk overflows. Review comment: Do not tell ‘our’ story, say it as a common case -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
