rdblue commented on issue #585: Fix Iceberg Reader for nested partitions (#575) URL: https://github.com/apache/incubator-iceberg/pull/585#issuecomment-571297674 @aokolnychyi, it isn't clear if that Spark PR is attempting to disable this for just sources that don't support it, or for all sources. I don't think there is a reason to disallow it for all sources. The problem here is just record materialization, which we can fix. The problem on that PR is that some sources don't work and should have checks to reject partitioning by nested columns. There's also a note about HiveQL syntax, but explicitly using partitions in a query is not recommended for Iceberg -- users should instead overwrite by an expression in terms of the data columns.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
