holdenk commented on pull request #28370: URL: https://github.com/apache/spark/pull/28370#issuecomment-623734294
Ok so I think the CLI test is flaky (looking at it it's awaint a future and timing out so that's not surprising). If you can re-enable your tests @prakharjain09 I think the new code that you already have without the join & and using less heap space for the workers & avoiding the thread leak with parmap should do the trick. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
