[ https://issues.apache.org/jira/browse/SPARK-31640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17102746#comment-17102746 ]
Burak Yavuz commented on SPARK-31640: ------------------------------------- Hi [~younggyuchun], I'd take a look at how SHOW PARTITIONS works today: - [https://github.com/apache/spark/blob/36803031e850b08d689df90d15c75e1a1eeb28a8/sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala#L1023] which returns a list of string paths. It would be great that with [DataSourceV2 tables|[https://github.com/apache/spark/blob/36803031e850b08d689df90d15c75e1a1eeb28a8/sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/Table.java#L43]], we can return the list of partitions ([https://github.com/apache/spark/blob/36803031e850b08d689df90d15c75e1a1eeb28a8/sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/Table.java#L60]) where each Transform is a separate column. > Support SHOW PARTITIONS for DataSource V2 tables > ------------------------------------------------ > > Key: SPARK-31640 > URL: https://issues.apache.org/jira/browse/SPARK-31640 > Project: Spark > Issue Type: New Feature > Components: SQL > Affects Versions: 3.0.0 > Reporter: Burak Yavuz > Priority: Major > > SHOW PARTITIONS is supported for V1 Hive tables. We can also support it for > V2 tables, where they return the transforms and the values of those > transforms as separate columns. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org