Re: Matrix multiplication and cluster / partition / blocks configuration

2017-08-08 Thread Phillip Henry
Hi, John. I've had similar problems. IIRC, the driver was GCing madly. I don't know why the driver was doing so much work but I quickly implemented an alternative approach. The code I wrote belongs to my client but I wrote something that should be equivalent. It can be found at:

Matrix multiplication and cluster / partition / blocks configuration

2017-05-11 Thread John Compitello
Hey all, I’ve found myself in a position where I need to do a relatively large matrix multiply (at least, compared to what I normally have to do). I’m looking to multiply a 100k by 500k dense matrix by its transpose to yield 100k by 100k matrix. I’m trying to do this on Google Cloud, so I