Re: Can't filter

2.11" *% *"1.5.1"*, > *"org.apache.spark" *% *"spark-streaming_2.11" *% *"1.5.1"*, > *"org.apache.spark" *% *"spark-mllib_2.11" *% *"1.5.1"* > > > > > > *From:* Бобров Викто

Re: Can't filter

14 = {StackTraceElement@7146} "SimpleApp$.main(test1.scala:26)" > > 15 = {StackTraceElement@7147} "SimpleApp.main(test1.scala)" > > > > *From:* Ndjido Ardo Bar [mailto:ndj...@gmail.com] > *Sent:* Thursday, December 10, 2015 2:20 PM > *To:* Бобров Виктор <ma..

Can't filter

Hi, I can’t filter my rdd. def filter1(tp: ((Array[String], Int), (Array[String], Int))): Boolean= { tp._1._2 > tp._2._2 } val mail_rdd = sc.parallelize(A.toSeq).cache() val step1 = mail_rdd.cartesian(mail_rdd) val step2 = step1.filter(filter1) Get error “Class not found”. What I’m doing

Re: Can't filter

Please send your call stack with the full description of the exception . > On 10 Dec 2015, at 12:10, Бобров Виктор wrote: > > Hi, I can’t filter my rdd. > > def filter1(tp: ((Array[String], Int), (Array[String], Int))): Boolean= { > tp._1._2 > tp._2._2 > } > val mail_rdd =

RE: Can't filter

step2 = step1.filter(filter1) //step1.collect().foreach(println) } } From: Harsh J [mailto:ha...@cloudera.com] Sent: Thursday, December 10, 2015 2:50 PM To: Бобров Виктор <ma...@bk.ru>; Ndjido Ardo Bar <ndj...@gmail.com> Cc: user@spark.apache.org Subject: Re: Can't filter

RE: Can't filter

filter(RDD.scala:330)" 13 = {StackTraceElement@7145} "SimpleApp$GeneratedEvaluatorClass$44$1.invoke(FileToCompile0.scala:30)" 14 = {StackTraceElement@7146} "SimpleApp$.main(test1.scala:26)" 15 = {StackTraceElement@7147} "SimpleApp.main(test1.scala)" From: N

RE: Can't filter

treaming_2.11" % "1.5.1", "org.apache.spark" % "spark-mllib_2.11" % "1.5.1" From: Бобров Виктор [mailto:ma...@bk.ru] Sent: Thursday, December 10, 2015 2:54 PM To: 'Harsh J' <ha...@cloudera.com> Cc: user@spark.apache.org Subject:

Re: Can't filter

er(RDD.scala:330)" >> >> 13 = {StackTraceElement@7145} >> "SimpleApp$GeneratedEvaluatorClass$44$1.invoke(FileToCompile0.scala:30)" >> >> 14 = {StackTraceElement@7146} "SimpleApp$.main(test1.scala:26)" >> >> 15 = {StackTraceElement@7147} "