tgravescs commented on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-483718827 I do know there is a company that sells a product to run Spark on FPGAs. I've also seen multiple talks on it. But I don't know how close it is for general user. Personally I think it would be good to just do the generic thing as long as it doesn't add much overhead to the scheduler. I can see people wanting to add in possibly other information like GPU type, memory, etc. I can see a use for virtual GPU's if they want to share a GPU. I was thinking if we put in the generic pieces people could more easily experiment without having to change core pieces.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
