attilapiros commented on pull request #32790: URL: https://github.com/apache/spark/pull/32790#issuecomment-865592587
Your example assumes all the blocks was persisted into disk. In that case when during the run of the application when persist is called again those area will be reused. Even though I have an idea: introducing a new class which wraps the `JHashMap` and when the HashMap is empty we can create remove the reference to it and when it is needed again we can recreate the HashMap. Let me look into that. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
