cloud-fan commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-667044527
Can we turn it into a WIP PR and add more changes to show how we can leverage the API to implement the partition related commands? I'm really curious about the process to resolve and execute partition related commands with this API. For now, I'm a bit unclear about where to define this API: in table level or in catalog level? By design, `Table` represents a logical structured data set, and it's weird to allow it to manage partitions. Furthermore, if we migrate Hive to this API, we will introduce an extra table lookup: `TableCatalog` -> `Table` -> `partition operations`. While right now it's just a simple RPC call to the hive metastore. I think it can help the discussion if we have some real examples of using this API (implement several partition commands). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
