szehon-ho commented on code in PR #46745:
URL: https://github.com/apache/spark/pull/46745#discussion_r1617761469
##########
docs/sql-performance-tuning.md:
##########
@@ -428,3 +428,101 @@ You can control the details of how AQE works by providing
your own cost evaluato
<td>3.2.0</td>
</tr>
</table>
+
+## Storage Partition Join
Review Comment:
Thanks for review. The mechanism works today if DSV2 partitioning
implements KeyGroupedPartitioning.
Unfortunately the initial SPJ implementation did not support it for
ParquetDSV2, so I think there's no data source in Spark code that we can have
an example at the moment (the tests use the InMemoryTable which implements it).
I can potentially investigate implementing for ParquetDSV2 later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
