qlong commented on PR #15384: URL: https://github.com/apache/iceberg/pull/15384#issuecomment-4760792009
> thanks. in #16133 I've had it working with a different impl of this pr (something copilot did for me, separate from my main work). moving to yours is hitting some problems with spark parsing the normalised path coming down from iceberg, e.g > > good > > ``` > variant_get(nested, '$.varcategory', 'int')"; > ``` > > bad > > ``` > variant_get(nested, ''[$'.'varcategory'], 'int')"; > ``` > > Switch UnboundExtract.path to the raw rather than normalized path and things are happy, but that makes the code brittle to all the things normalisation is meant to stop. @steveloughran Thanks for testing the integration, bracket representation is intentional. In #15385 I also change so describe the path in bracket form. Does this describe change break your tests? Can you assert on bracket form for filters? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
