cloud-fan commented on PR #47364: URL: https://github.com/apache/spark/pull/47364#issuecomment-2345183501
Hi all, sorry for the late review as I've been struggling with the user-facing API. I know we have a lot SHOW commands already but there are known issues: - It's not standard, but we don't have a choice as Spark doesn't have information schema yet. - The `SHOW ... LIKE ...` semantic is different from the `LIKE` operator. It's also different from Hive's behavior which we copied from. - No corresponding DataFrame API. - We can't perform transformations with the output, something like `SELECT ... FROM (SHOW ...)` is not allowed. Building information schema is a big effort, but for this SHOW COLLATIONS feature, can we add a builtin TVF like `SELECT ... FROM all_collations()`? Also cc @srielau -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
