mccheah commented on issue #23347: allow building spark gpu docker images URL: https://github.com/apache/spark/pull/23347#issuecomment-453708953 One other concern is that adding another option that we say is ready to run out of the box for GPUs, is that we have to maintain this mode and ensure it is tested in CI. Our integration tests cover the use of all the basic Dockerfiles we provide so far, but it can be a poor experience for a user to try to use the GPU option that we haven't tested and they find problems with the GPU integration. Basically this is extra stuff we have to maintain and validate and it's unclear if that's the right direction moving forward, particularly because we're giving GPUs special treatment over other kinds of customizations like OS support.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
