Re: number of partitions in join: Spark documentation misleading!

2015-06-16 Thread Davies Liu
ber of partitions of B! > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/number-of-partitions-in-join-Spark-documentation-misleading-tp23316.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > >

number of partitions in join: Spark documentation misleading!

2015-06-15 Thread mrm
s misleading for the Python API where if you do rddA.join(rddB), the output number of partitions is the number of partitions of A plus the number of partitions of B! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/number-of-partitions-in-join-Spark-docu