huan233usc commented on issue #2050: URL: https://github.com/apache/iceberg-rust/issues/2050#issuecomment-4609688377
Thank you @CTTY I took a shot on this https://github.com/apache/iceberg-rust/pull/2575. Two open questions: 1. **Non-identity transforms are blocked for now.** DataFusion's `PARTITIONED BY` only accepts plain column names — it can't express transforms like `bucket(16, id)` or `days(ts)` (Spark's native grammar can). So I return a error when a non-identity-partitioned table is given a `PARTITIONED BY` clause Proper support likely needs an upstream proposal — does that path sound right? (left a `TODO` in code). 2. **Escape hatch:** such tables can still be registered read-only by just omitting `PARTITIONED BY` — the spec always comes from the Iceberg metadata. WDYT? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
