Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/16677#discussion_r197596253
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchangeExec.scala
---
@@ -247,6 +253,10 @@ object ShuffleExchangeExec {
val projection = UnsafeProjection.create(h.partitionIdExpression
:: Nil, outputAttributes)
row => projection(row).getInt(0)
case RangePartitioning(_, _) | SinglePartition => identity
+ case LocalPartitioning(_, _) =>
+ (row: InternalRow) => {
+ TaskContext.get().partitionId()
--- End diff --
Fixed.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
