Option 1:
dataRDD.filter(x=>(x._2 =="apple") || (x._2 =="orange"))
Option 2:
val fruits = Set("apple", "orange", "pear")
dataRDD.filter(x=>fruits.contains(x._2))
Mohammed
-----Original Message-----
From: dizzy5112 [mailto:dave.zee...@gmail.com]
Sent: Tuesday, December 9, 2014 2:16 PM
To: u...@spark.incubator.apache.org
Subject: equivalent to sql in
i have and RDD i want to filter and for a single term all works good:
ie
dataRDD.filter(x=>x._2 =="apple")
how can i use multiple values, for example if i wanted to filter my rdd to take
out "apples" and "oranges" and "pears" with out using &&. This could get long
winded as there may be quite a few. Can you filter using a set or a list?
thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/equivalent-to-sql-in-tp20599.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional
commands, e-mail: user-h...@spark.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
