[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163125#comment-14163125 ]
Sean Owen commented on SPARK-3785: ---------------------------------- Sure, but a GPU isn't going to be good at general map, filter, reduce, groupBy operations. It can't run arbitrary functions like the JVM. I wonder how many use cases actually consist of enough computation that can be specialized for the GPU, chained together, that makes the GPU worth it. My suspicious is still that there are really a few wins for this use case but that they are achievable by just calling to the GPU from Java code. I'd love to see that this is in fact a way to transparently speed up a non-trivial slice of mainstream Spark use cases though. > Support off-loading computations to a GPU > ----------------------------------------- > > Key: SPARK-3785 > URL: https://issues.apache.org/jira/browse/SPARK-3785 > Project: Spark > Issue Type: Brainstorming > Components: MLlib > Reporter: Thomas Darimont > Priority: Minor > > Are there any plans to adding support for off-loading computations to the > GPU, e.g. via an open-cl binding? > http://www.jocl.org/ > https://code.google.com/p/javacl/ > http://lwjgl.org/wiki/index.php?title=OpenCL_in_LWJGL -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org