GH-Gloway commented on issue #10225: [SPARK-12196][Core] Store/retrieve blocks from different speed storage devices by hierarchical way URL: https://github.com/apache/spark/pull/10225#issuecomment-615094269 The original getFile(filename: String) method is stateless. Now this method needs to check the disk space first, resulting in inconsistency. For example, when the data is full in the SSD, but the data file of the SSD can no longer be located when the getFile method is called again. could you explain it？
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
