[ 
https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163125#comment-14163125
 ] 

Sean Owen commented on SPARK-3785:
----------------------------------

Sure, but a GPU isn't going to be good at general map, filter, reduce, groupBy 
operations. It can't run arbitrary functions like the JVM. I wonder how many 
use cases actually consist of enough computation that can be specialized for 
the GPU, chained together, that makes the GPU worth it. My suspicious is still 
that there are really a few wins for this use case but that they are achievable 
by just calling to the GPU from Java code. I'd love to see that this is in fact 
a way to transparently speed up a non-trivial slice of mainstream Spark use 
cases though.

> Support off-loading computations to a GPU
> -----------------------------------------
>
>                 Key: SPARK-3785
>                 URL: https://issues.apache.org/jira/browse/SPARK-3785
>             Project: Spark
>          Issue Type: Brainstorming
>          Components: MLlib
>            Reporter: Thomas Darimont
>            Priority: Minor
>
> Are there any plans to adding support for off-loading computations to the 
> GPU, e.g. via an open-cl binding? 
> http://www.jocl.org/
> https://code.google.com/p/javacl/
> http://lwjgl.org/wiki/index.php?title=OpenCL_in_LWJGL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to