HyukjinKwon commented on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631644400
@tgravescs, yeah, I understand the initial intention. The problem I would like to address here is that don't expose `ResourceInformation` under `pyspark` with a minimised change as it became a separate package in the master - it will be difficult to hide it back once it's exposed. To end users, there are no differences. We can even move this file into a separate module for consistency after the reelase. I thought it's worthwhile not worthwhile to do it during RC period, and came up with a minimised fix. If you strongly feel it should be as a package for dev purpose, I wouldn't mind. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
