SinghAsDev commented on a change in pull request #3723:
URL: https://github.com/apache/iceberg/pull/3723#discussion_r771677391
##########
File path: site/docs/spark-procedures.md
##########
@@ -334,6 +339,13 @@ CALL catalog_name.system.rewrite_manifests('db.sample',
false)
The `snapshot` and `migrate` procedures help test and migrate existing Hive or
Spark tables to Iceberg.
+!!! Note
+ Parquet files written with Parquet writers that use names other than
`list` and `element` for repeated group
+ and element of the list respectively are **read incorrectly as nulls** by
Iceberg upto 0.12.1 Iceberg versions.
+ Most commonly such files are written by follow writers.
Review comment:
Hey @jackye1995 , to ease the cherry-picks we decided to extract out
format change to a separate PR. Will follow up on this right after we get this
PR in.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
