Spark Checkpointing behavior

2016-02-27 Thread Tarek Elgamal
Hi, I am trying to understand the behavior of rdd.checkpoint() in Spark. I am running the JavaPageRank example on a 1 GB graph and I am checkpointing the *ranks *rdd inside each

Re: Problem in running MLlib SVM

2015-11-28 Thread Tarek Elgamal
bel == 1) || (score <0 && label == 0)) > { > return 1; //correct classiciation > } > else > return 0; > > > > I suspect score is always between 0 and 1 > > > > On Sat, Nov 28, 2015 at 10:39

Problem in running MLlib SVM

2015-11-27 Thread Tarek Elgamal
Hi, I am trying to run the straightforward example of SVm but I am getting low accuracy (around 50%) when I predict using the same data I used for training. I am probably doing the prediction in a wrong way. My code is below. I would appreciate any help. import java.util.List; import

Contribute code to MLlib

2015-05-18 Thread Tarek Elgamal
code or not. My algorithm can be found under this repository: https://github.com/Qatar-Computing-Research-Institute/sPCA Any help on how to make it suitable for MLlib project will be greatly appreciated. Best Regards, Tarek Elgamal