GitHub user yikf added a comment to the discussion: [VL] Maintanence status of the dynamic off-heap sizing feature?
@zhztheplayer Thanks for your invitation. It has been found that when dynamic memory is enabled, the memory requested by Spark from the resource manager is larger than the available memory. In short, it has restricted itself, and the total amount of requested memory has increased. https://github.com/apache/incubator-gluten/pull/5439#discussion_r1847590308. GitHub link: https://github.com/apache/incubator-gluten/discussions/8600#discussioncomment-11937579 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
