jerrypeng commented on code in PR #59523:
URL: https://github.com/apache/spark/pull/59523#discussion_r4429433815
##########
sql/core/src/test/scala/org/apache/spark/sql/execution/exchange/PipelinedShuffleSqlSuite.scala:
##########
@@ -213,7 +218,89 @@ class PipelinedShuffleSqlSuite extends SparkFunSuite
}
}
+ private def distributedSequence(
Review Comment:
Changed the helper to use
`input.select(Column.internalFn("distributed_sequence_id",
lit(cache)).as("index"), col("*"))`. This exercises function resolution and
`ExtractDistributedSequenceID`, including the cache argument and surrounding
`Project`, and removes the `classic` cast and unused session argument.
All 45 tests in `PipelinedShuffleSqlSuite` passed. This covers the
expression/analyzer path used by pandas-on-Spark; the Python wrapper itself was
not executed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
