e.org>>, Joseph Bradley <jos...@databricks.com
>> <mailto:jos...@databricks.com>>
>> Cc:John Canny <ca...@berkeley.edu <mailto:ca...@berkeley.edu>>,
>> "Evan R. Sparks" <evan.spa...@gmail.com <mailto:evan.spa...@gmail.com
quot;
> <evan.spa...@gmail.com>, Xiangrui Meng <men...@gmail.com>, Sam Halliday
> <sam.halli...@gmail.com>
> Date:2016/01/22 04:20
> Subject:RE: Using CUDA within Spark / boosting linear algebra
>
>
>
> Hi Kazuaki,
>
> Indeed, movi
;Xiangrui Meng" <men...@gmail.com>, "Sam
Halliday" <sam.halli...@gmail.com>
Date: 2016/01/21 21:05
Subject:RE: Using CUDA within Spark / boosting linear algebra
Hi Kazuaki,
Jcuda is actually a wrapper of the **pure** CUDA, as your wiki page shows
that 3.15x pe
, Xiangrui Meng <men...@gmail.com>, Sam Halliday
<sam.halli...@gmail.com>
Date: 2016/01/22 04:20
Subject:RE: Using CUDA within Spark / boosting linear algebra
Hi Kazuaki,
Indeed, moving data to/from GPU is costly and this benchmark summarizes
the costs for moving di
lanov, Alexander" <alexander.ula...@hpe.com>
To:Sam Halliday <sam.halli...@gmail.com>, John Canny
<ca...@berkeley.edu>
Cc:Xiangrui Meng <men...@gmail.com>, "dev@spark.apache.org"
<dev@spark.apache.org>, Joseph Bradley <jos...@databricks.com>
lt;ca...@berkeley.edu>
Cc: Xiangrui Meng <men...@gmail.com>, "dev@spark.apache.org"
<dev@spark.apache.org>, Joseph Bradley <jos...@databricks.com>, "Evan R.
Sparks" <evan.spa...@gmail.com>
Date: 2016/01/21 11:07
Subject:RE: Using CUDA wi
, Alexander
From: Kazuaki Ishizaki [mailto:ishiz...@jp.ibm.com]
Sent: Thursday, January 21, 2016 3:34 AM
To: dev@spark.apache.org; Ulanov, Alexander; Joseph Bradley
Cc: John Canny; Evan R. Sparks; Xiangrui Meng; Sam Halliday
Subject: RE: Using CUDA within Spark / boosting linear algebra
Dear all
...@gmail.com]
Sent: Thursday, March 26, 2015 9:27 AM
To: John Canny
Cc: Xiangrui Meng; dev@spark.apache.org; Joseph Bradley; Evan R. Sparks;
Ulanov, Alexander
Subject: Re: Using CUDA within Spark / boosting linear algebra
John, I have to disagree with you there. Dense matrices come up a lot in
industry
Hi Alex,
Since it is non-trivial to make nvblas work with netlib-java, it would
be great if you can send the instructions to netlib-java as part of
the README. Hopefully we don't need to modify netlib-java code to use
nvblas.
Best,
Xiangrui
On Thu, Mar 26, 2015 at 9:54 AM, Sean Owen
@spark.apache.org; Ulanov, Alexander;
jfcanny
Subject: Re: Using CUDA within Spark / boosting linear algebra
Hi Alex,
Since it is non-trivial to make nvblas work with netlib-java, it would be great
if you can send the instructions to netlib-java as part of the README.
Hopefully we don't need to modify
Message-
From: Ulanov, Alexander
Sent: Wednesday, March 25, 2015 2:31 PM
To: Sam Halliday
Cc: dev@spark.apache.org mailto:dev@spark.apache.org; Xiangrui
Meng; Joseph Bradley; Evan R. Sparks; jfcanny
Subject: RE: Using CUDA within Spark / boosting linear algebra
Hi
-
From: Ulanov, Alexander
Sent: Wednesday, March 25, 2015 2:31 PM
To: Sam Halliday
Cc: dev@spark.apache.org; Xiangrui Meng; Joseph Bradley; Evan R. Sparks;
jfcanny
Subject: RE: Using CUDA within Spark / boosting linear algebra
Hi again,
I finally managed to use nvblas within Spark+netlib
25, 2015 2:31 PM
To: Sam Halliday
Cc: dev@spark.apache.org; Xiangrui Meng; Joseph Bradley; Evan R.
Sparks; jfcanny
Subject: RE: Using CUDA within Spark / boosting linear algebra
Hi again,
I finally managed to use nvblas within Spark+netlib-java. It has
exceptional performance for big
, Alexander
-Original Message-
From: Ulanov, Alexander
Sent: Tuesday, March 24, 2015 6:57 PM
To: Sam Halliday
Cc: dev@spark.apache.org; Xiangrui Meng; Joseph Bradley; Evan R. Sparks
Subject: RE: Using CUDA within Spark / boosting linear algebra
Hi,
I am trying to use nvblas with netlib
@spark.apache.org; Xiangrui Meng; Joseph
Bradley; Evan R. Sparks; jfcanny
*Subject:* Re: Using CUDA within Spark / boosting linear algebra
Alexander,
does using netlib imply that one cannot switch between CPU and GPU blas
alternatives at will at the same time? the choice is always
blas.
Best regards, Alexander
-Original Message-
From: Ulanov, Alexander
Sent: Tuesday, March 24, 2015 6:57 PM
To: Sam Halliday
Cc: dev@spark.apache.org; Xiangrui Meng; Joseph Bradley; Evan R. Sparks
Subject: RE: Using CUDA within Spark / boosting linear algebra
Hi,
I am trying
Sure, I will write a how-to after I re-check the results.
-Original Message-
From: Sam Halliday [mailto:sam.halli...@gmail.com]
Sent: Wednesday, March 25, 2015 3:04 PM
To: Evan R. Sparks; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
If you write
: Wednesday, March 25, 2015 2:55 PM
To: Ulanov, Alexander
Cc: Sam Halliday; dev@spark.apache.org; Xiangrui Meng; Joseph Bradley; Evan R.
Sparks; jfcanny
Subject: Re: Using CUDA within Spark / boosting linear algebra
Alexander,
does using netlib imply that one cannot switch between CPU and GPU blas
/1lWdVSuSragOobb0A_oeouQgHUMx378T9J5r7kwKSPkY/edit?usp=sharing
-Original Message-
From: Ulanov, Alexander
Sent: Wednesday, March 25, 2015 2:31 PM
To: Sam Halliday
Cc: dev@spark.apache.org; Xiangrui Meng; Joseph Bradley; Evan R. Sparks; jfcanny
Subject: RE: Using CUDA within Spark / boosting linear algebra
Hi again,
I
and not to Fortran blas.
Best regards, Alexander
-Original Message-
From: Ulanov, Alexander
Sent: Tuesday, March 24, 2015 6:57 PM
To: Sam Halliday
Cc: dev@spark.apache.org; Xiangrui Meng; Joseph Bradley; Evan R. Sparks
Subject: RE: Using CUDA within Spark / boosting linear algebra
Hi,
I
: [hidden email]; Xiangrui Meng; Joseph Bradley; Evan R. Sparks
Subject: RE: Using CUDA within Spark / boosting linear algebra
Hi,
I am trying to use nvblas with netlib-java from Spark. nvblas
functions should replace current blas functions calls after executing
LD_PRELOAD as suggested in
http
Reyonld,
Prof Canny gives me the slides yesterday I will posted the link to the
slides to both SF BIg Analytics and SF Machine Learning meetups.
Chester
Sent from my iPad
On Mar 12, 2015, at 22:53, Reynold Xin r...@databricks.com wrote:
Thanks for chiming in, John. I missed your meetup
Hi Reynold,
I left Chester with a copy of the slides, so I assume they'll be posted
on the SF ML or Big Data sites. We have a draft paper under review. I
can ask the co-authors about arxiv'ing it.
We have a few heuristics for power-law data. One of them is to keep the
feature set sorted by
this and will appreciate any help
from you ☺
From: Sam Halliday [mailto:sam.halli...@gmail.com]
Sent: Monday, March 09, 2015 6:01 PM
To: Ulanov, Alexander
Cc: dev@spark.apache.org; Xiangrui Meng; Joseph Bradley; Evan R. Sparks
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks so much
, Alexander; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
BTW, is anybody on this list going to the London Meetup in a few weeks?
https://skillsmatter.com/meetups/6987-apache-spark-living-the-post-mapreduce-world#community
Would be nice to meet other people
: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked as duplicate though
the original one discusses slightly different topic. I was able to
link netlib with MKL from BIDMat binaries. Indeed, MKL is
statically linked inside a 60MB library
machine’s RAM?
-Original Message-
From: Ulanov, Alexander
Sent: Tuesday, February 10, 2015 2:12 PM
To: Evan R. Sparks
Cc: Joseph Bradley; dev@spark.apache.org
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked as duplicate
-
From: Xiangrui Meng [mailto:men...@gmail.com]
Sent: Monday, March 02, 2015 11:42 AM
To: Sam Halliday
Cc: Joseph Bradley; Ulanov, Alexander; dev; Evan R. Sparks
Subject: Re: Using CUDA within Spark / boosting linear algebra
On Fri, Feb 27, 2015 at 12:33 PM, Sam Halliday sam.halli
[mailto:men...@gmail.com]
Sent: Monday, March 02, 2015 11:42 AM
To: Sam Halliday
Cc: Joseph Bradley; Ulanov, Alexander; dev; Evan R. Sparks
Subject: Re: Using CUDA within Spark / boosting linear algebra
On Fri, Feb 27, 2015 at 12:33 PM, Sam Halliday sam.halli...@gmail.com wrote:
Also, check
, 2015 2:12 PM
To: Evan R. Sparks
Cc: Joseph Bradley;
dev@spark.apache.orgmailto:dev@spark.apache.org
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked as duplicate though
the
original one discusses slightly different
; Evan R.
Sparks
Subject: Re: Using CUDA within Spark / boosting linear algebra
Btw, I wish people would stop cheating when comparing CPU and GPU
timings for things like matrix multiply :-P
Please always compare apples with apples and include the time it takes
to set up the matrices
, Alexander
From: Sam Halliday [mailto:sam.halli...@gmail.com]
Sent: Thursday, February 26, 2015 1:56 PM
To: Xiangrui Meng
Cc: dev@spark.apache.org; Joseph Bradley; Ulanov, Alexander; Evan R.
Sparks
Subject: Re: Using CUDA within Spark / boosting linear algebra
Btw, I wish
Bradley; Ulanov, Alexander; Evan R.
Sparks
Subject: Re: Using CUDA within Spark / boosting linear algebra
Btw, I wish people would stop cheating when comparing CPU and GPU
timings for things like matrix multiply :-P
Please always compare apples with apples and include the time it takes
Cc: Joseph Bradley; dev@spark.apache.org
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked as duplicate though the
original one discusses slightly different topic. I was able to link
netlib
with MKL from BIDMat binaries. Indeed
@spark.apache.org
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked as duplicate though the
original one discusses slightly different topic. I was able to link
netlib
with MKL from BIDMat binaries. Indeed, MKL is statically linked
inside
copying
to/from machine’s RAM?
-Original Message-
From: Ulanov, Alexander
Sent: Tuesday, February 10, 2015 2:12 PM
To: Evan R. Sparks
Cc: Joseph Bradley; dev@spark.apache.org
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked
Message-
From: Ulanov, Alexander
Sent: Tuesday, February 10, 2015 2:12 PM
To: Evan R. Sparks
Cc: Joseph Bradley; dev@spark.apache.org
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked as duplicate though the
original one
Typo - CPU was 2.5 cheaper (not GPU!)
-Original Message-
From: Ulanov, Alexander
Sent: Thursday, February 26, 2015 2:01 PM
To: Sam Halliday; Xiangrui Meng
Cc: dev@spark.apache.org; Joseph Bradley; Evan R. Sparks
Subject: RE: Using CUDA within Spark / boosting linear algebra
Evan, thank
: Re: Using CUDA within Spark / boosting linear algebra
Btw, I wish people would stop cheating when comparing CPU and GPU timings for
things like matrix multiply :-P
Please always compare apples with apples and include the time it takes to set
up the matrices, send it to the processing unit
: Thursday, February 26, 2015 1:56 PM
To: Xiangrui Meng
Cc: dev@spark.apache.org; Joseph Bradley; Ulanov, Alexander; Evan R. Sparks
Subject: Re: Using CUDA within Spark / boosting linear algebra
Btw, I wish people would stop cheating when comparing CPU and GPU timings for
things like matrix
?
-Original Message-
From: Ulanov, Alexander
Sent: Tuesday, February 10, 2015 2:12 PM
To: Evan R. Sparks
Cc: Joseph Bradley; dev@spark.apache.orgmailto:dev@spark.apache.org
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked
[mailto:evan.spa...@gmail.com]
Sent: Monday, February 09, 2015 6:06 PM
To: Ulanov, Alexander
Cc: Joseph Bradley; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
Great - perhaps we can move this discussion off-list and onto a JIRA
ticket? (Here's one: https
To: Evan R. Sparks
Cc: Joseph Bradley; dev@spark.apache.org
Subject: RE: Using CUDA within Spark / boosting linear algebra
Thanks, Evan! It seems that ticket was marked as duplicate though the original
one discusses slightly different topic. I was able to link netlib with MKL from
BIDMat binaries
: Monday, February 09, 2015 6:06 PM
To: Ulanov, Alexander
Cc: Joseph Bradley; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
Great - perhaps we can move this discussion off-list and onto a JIRA ticket?
(Here's one: https://issues.apache.org/jira/browse/SPARK-5705
*From:* Evan R. Sparks [mailto:evan.spa...@gmail.com]
*Sent:* Friday, February 06, 2015 5:58 PM
*To:* Ulanov, Alexander
*Cc:* Joseph Bradley; dev@spark.apache.org
*Subject:* Re: Using CUDA within Spark / boosting linear algebra
I would build OpenBLAS yourself, since good BLAS
]
Sent: Friday, February 06, 2015 5:58 PM
To: Ulanov, Alexander
Cc: Joseph Bradley; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
I would build OpenBLAS yourself, since good BLAS performance comes from
getting cache sizes, etc. set up correctly for your
To: Ulanov, Alexander
Cc: Joseph Bradley; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
I would build OpenBLAS yourself, since good BLAS performance comes from getting
cache sizes, etc. set up correctly for your particular hardware - this is often
a very tricky
it.
*From:* Evan R. Sparks [mailto:evan.spa...@gmail.com]
*Sent:* Friday, February 06, 2015 5:19 PM
*To:* Ulanov, Alexander
*Cc:* Joseph Bradley; dev@spark.apache.org
*Subject:* Re: Using CUDA within Spark / boosting linear algebra
Getting breeze to pick up the right blas library
: Thursday, February 05, 2015 5:29 PM
To: Ulanov, Alexander
Cc: Evan R. Sparks; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
Hi Alexander,
Using GPUs with Spark would be very exciting. Small comment: Concerning
your question earlier about keeping data
@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
Getting breeze to pick up the right blas library is critical for performance. I
recommend using OpenBLAS (or MKL, if you already have it). It might make sense
to force BIDMat to use the same underlying BLAS library as well.
On Fri
05, 2015 5:29 PM
To: Ulanov, Alexander
Cc: Evan R. Sparks; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
Hi Alexander,
Using GPUs with Spark would be very exciting. Small comment: Concerning your
question earlier about keeping data stored on the GPU rather
From: Joseph Bradley [mailto:jos...@databricks.com]
Sent: Thursday, February 05, 2015 5:29 PM
To: Ulanov, Alexander
Cc: Evan R. Sparks; dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
Hi Alexander,
Using GPUs with Spark would be very exciting. Small
To: Ulanov, Alexander
Cc: dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
I'd expect that we can make GPU-accelerated BLAS faster than CPU blas in many
cases.
You might consider taking a look at the codepaths that BIDMat
(https://github.com/BIDData/BIDMat
, Alexander
*Cc:* dev@spark.apache.org
*Subject:* Re: Using CUDA within Spark / boosting linear algebra
I'd expect that we can make GPU-accelerated BLAS faster than CPU blas in
many cases.
You might consider taking a look at the codepaths that BIDMat (
https://github.com/BIDData/BIDMat) takes
:29 PM
To: Ulanov, Alexander
Cc: dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
I'd be surprised of BIDMat+OpenBLAS was significantly faster than
netlib-java+OpenBLAS, but if it is much faster it's probably due to data layout
and fewer levels of indirection
. Sparks [mailto:evan.spa...@gmail.com]
Sent: Thursday, February 05, 2015 1:29 PM
To: Ulanov, Alexander
Cc: dev@spark.apache.org
Subject: Re: Using CUDA within Spark / boosting linear algebra
I'd be surprised of BIDMat+OpenBLAS was significantly faster than
netlib-java+OpenBLAS
I'd expect that we can make GPU-accelerated BLAS faster than CPU blas in
many cases.
You might consider taking a look at the codepaths that BIDMat (
https://github.com/BIDData/BIDMat) takes and comparing them to
netlib-java/breeze. John Canny et. al. have done a bunch of work optimizing
to make
57 matches
Mail list logo
