Re: difference between ++ and Union of a RDD

2015-12-29 Thread Ted Yu
; at :27 > > val odd_PARTABC_union = > odd_partA_RDD.union(odd_partB_RDD).union(odd_partC_RDD) > odd_PARTABC_union: org.apache.spark.rdd.RDD[Int] = UnionRDD[17] at union at > :27 > > odd_PARTABC_pp.count > res10: Long = 28 > > odd_PARTABC_union.count > res11: Long =

difference between ++ and Union of a RDD

2015-12-29 Thread email2...@gmail.com
: org.apache.spark.rdd.RDD[Int] = UnionRDD[17] at union at :27 odd_PARTABC_pp.count res10: Long = 28 odd_PARTABC_union.count res11: Long = 28 Thanks Gokul -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/difference-between-and-Union-of-a-RDD-tp25830.html Sent from

Re: difference between ++ and Union of a RDD

2015-12-29 Thread Gokula Krishnan D
gt;> val odd_PARTABC_pp = odd_partA_RDD ++(odd_partB_RDD) ++ (odd_partC_RDD) >> odd_PARTABC_pp: org.apache.spark.rdd.RDD[Int] = UnionRDD[15] at $plus$plus >> at :27 >> >> val odd_PARTABC_union = >> odd_partA_RDD.union(odd_partB_RDD).union(odd_partC_RDD) >>

Re: difference between ++ and Union of a RDD

2015-12-29 Thread Ted Yu
t; >>> odd_PARTAB_pp.count >>> res8: Long = 23 >>> >>> odd_PARTAB_union.count >>> res9: Long = 23 >>> >>> val odd_PARTABC_pp = odd_partA_RDD ++(odd_partB_RDD) ++ (odd_partC_RDD) >>> odd_PARTABC_pp: org.apache.spark.rdd.RDD[Int]