Re: KMeans with large clusters Java Heap Space

2015-03-19 Thread mvsundaresan
pache-spark-user-list.1001560.n3.nabble.com/KMeans-with-large-clusters-Java-Heap-Space-tp21432p22153.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spar

Re: KMeans with large clusters Java Heap Space

2015-01-30 Thread derrickburns
Vector], k: Int): KMeansModel = { KMeans.train(raw, k, embeddingNames = List(LOW_DIMENSIONAL_RI) } -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/KMeans-with-large-clusters-Java-Heap-Space-tp21432p21437.html Sent from the Apache Spark User List mailin

KMeans with large clusters Java Heap Space

2015-01-29 Thread mvsundaresan
= clusters.predict(data) val srcidx = result.zipWithIndex().map{case(val1, val2) => (val2, val1)} val tktidx = tickets.zipWithIndex().map{case((val1, val2), val3) => (val3, (val1, val2))} val joined = srcidx.join(tktidx).map{case(val1, (val2, (val3, val4))) => (val1, val2, val3, val4)} joined.saveAsTex