SinghAsDev commented on pull request #3723: URL: https://github.com/apache/iceberg/pull/3723#issuecomment-992651581
Hive still writes with same names, so I would say it is a problem for any parquet file generated by writing to a hive table with ParquetHiveSerDe. On Mon, Dec 13, 2021 at 6:02 AM Russell Spitzer ***@***.***> wrote: > ***@***.**** commented on this pull request. > ------------------------------ > > In site/docs/spark-procedures.md > <https://github.com/apache/iceberg/pull/3723#discussion_r767783605>: > > > @@ -334,6 +334,10 @@ CALL catalog_name.system.rewrite_manifests('db.sample', false) > > The `snapshot` and `migrate` procedures help test and migrate existing Hive or Spark tables to Iceberg. > > +**Note** Parquet files written with Parquet writers that use names other than `list` and `element` for repeated group > +and element of the list respectively are **read incorrectly** by Iceberg upto 0.12.1 Iceberg versions. Parquet files > +generated by Hive fall in this category. > > Can we try to get a version bound here? Ideally the oss hive version where > this starts and stops being an issue? > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/iceberg/pull/3723#pullrequestreview-830274905>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ABFQCZPI7FO53GWJLMU5M23UQX4FZANCNFSM5J43VMOA> > . > Triage notifications on the go with GitHub Mobile for iOS > <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> > or Android > <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. > > -- - Ashish -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
