Re: Split RDD based on criteria

2015-06-10 Thread Sean Owen
> This seems a bit tautological to me, though Spark must be optimizing this > out (?) > > Thanks. > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Split-RDD-based-on-criteria-tp23254.html > Sent from th

Re: Split RDD based on criteria

2015-06-10 Thread Chad Urso McDaniel
> Right now I'm doing > > RDD x = rdd.filter(func); > RDD y = rdd.filter(reverseOfFunc); > > This seems a bit tautological to me, though Spark must be optimizing this > out (?) > > Thanks. > > > > > > -- > View this message in context: > http://apach

Split RDD based on criteria

2015-06-10 Thread dgoldenberg
unc); Right now I'm doing RDD x = rdd.filter(func); RDD y = rdd.filter(reverseOfFunc); This seems a bit tautological to me, though Spark must be optimizing this out (?) Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Split-RDD-based-on-c