dongjoon-hyun opened a new pull request #23873: [SPARK-26975][SQL] Support 
nested-column pruning over limit/sample/repartition
URL: https://github.com/apache/spark/pull/23873
 
 
   ## What changes were proposed in this pull request?
   
   As [SPARK-26958](https://github.com/apache/spark/pull/23862/files) benchmark 
shows, nested-column pruning has limitations. This PR aims to remove the 
limitations on `limit/repartition/sample`. Here, repartition means 
`Repartition`, not `RepartitionByExpression`.
   
   ## How was this patch tested?
   
   Pass the Jenkins with newly added test cases.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to