Re: CUDA in spark, especially in MLlib?

2014-08-27 Thread Frank van Lankvelt
you could try looking at ScalaCL[1], it's targeting OpenCL rather than CUDA, but that might be close enough? cheers, Frank 1. https://github.com/ochafik/ScalaCL On Wed, Aug 27, 2014 at 7:33 PM, Wei Tan wrote: > Thank you all. Actually I was looking at JCUDA. Function wise this may be > a perf

Historic data and clocks

2014-08-27 Thread Frank van Lankvelt
Hi, In an attempt to keep processing logic as simple as possible, I'm trying to use spark streaming for processing historic as well as real-time data. This works quite well, using big intervals that match the window size for historic data, and small intervals for real-time. I found this discussi

Re: JDBCRDD / Example

2014-07-21 Thread Frank van Lankvelt
you could try looking at the JdbcRDDSuite in the spark sources. cheers, Frank On Mon, Jul 21, 2014 at 3:27 AM, Ahmed Ibrahim wrote: > Hi Guys, > > Any simplistic example for JDBCRDD for a newbie? > > -- > Ahmed Osama Ibrahim > ITSC International Technology Services Corporation > www.itscorpmd.