cloud-fan commented on issue #26929: [SPARK-30289][SQL] DSv2's partitioning should not accept nested columns URL: https://github.com/apache/spark/pull/26929#issuecomment-574998506 I think Spark should support all kinds of PARTITION BY expressions as long as it can be translated to v2 `Transform`. The catalog implementation should decide if they support it or not. For examaple, Hive catalog doesn't support partition by nested columns. For the particular test failure, I think we should fix `InMemoryTable` that, when flatten the fields, we should keep the full column path not just the name.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
