sunchao commented on code in PR #42194: URL: https://github.com/apache/spark/pull/42194#discussion_r1303195440
########## core/src/main/scala/org/apache/spark/Partitioner.scala: ########## @@ -137,6 +137,21 @@ private[spark] class PartitionIdPassthrough(override val numPartitions: Int) ext override def getPartition(key: Any): Int = key.asInstanceOf[Int] } +/** + * A [[org.apache.spark.Partitioner]] that partitions all records use partition value map. + * The valueMap is a map that contains tuples of (partition value, partition id). It generated + * by [[org.apache.spark.sql.catalyst.plans.physical.KeyGroupedPartitioning]], used to partition + * another side to make sure records with same partition value are in same partition. Review Comment: nit: - "another side" -> "the other side of a join"? - "in same partition" -> "in the same partition". -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
