Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/3524#issuecomment-65329606
I don't understand this, why would it be giving 3 * currentMemory? The
problem is that myMemoryThreshold is what the memory manager thought we were
using so far (what it gave us), and our actual usage has now exceeded that. We
need to acquire at least currentMemory - myMemoryThreshold (our old allocation)
to account for our current usage, but we'll actually get 2 * currentMemory -
myMemoryThreshold to have more leeway. Note that tryToAcquire adds memory
incrementally, it doesn't drop our current stuff and change to a new limit.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
