kbendick commented on pull request #3723: URL: https://github.com/apache/iceberg/pull/3723#issuecomment-992812205
> Hive still writes with same names, so I would say it is a problem for any parquet file generated by writing to a hive table with ParquetHiveSerDe. > -- - Ashis I suggest we consider going with the something similar to the map projection element rename fix that Ryan applied for maps from Parquet 1.11.0 to 1.11.1, where we don't depend on the name at all. PR for context: https://github.com/apache/iceberg/pull/3309 It might not work because that was for projection, but it looks like you're updating similar areas of the code. If we can get something like that where we don't assume names at all from parquet, just element structure and types, that would ideally allow for N levels of nesting etc. and further remove us from individual engines choice of element names for parquet (or changes within the parquet spec itself). cc @SinghAsDev -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
