caotranbadat2011 commented on PR #58416: URL: https://github.com/apache/spark/pull/58416#issuecomment-5469043383
Hi @HyukjinKwon since PR #44236 was closed, I’ve revised the approach to avoid driver OOM by doing a bounded distributed set validation ($O(K)$). Would appreciate your feedback when you have time! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
