zinking opened a new pull request, #37428: URL: https://github.com/apache/spark/pull/37428
currently, match parquet schema by id fails under certain case no new unit test added ### What changes were proposed in this pull request? in this PR, fixed cases where ParquetSchemaConverter fails match schema by id when converting parquet schema, SparkType is preferred instead of Converted parquet type, chances are SparkType has a name which will then fail the same type validation in later cases when running vectorized nested column read. ### Why are the changes needed? when converting parquet schema, SparkType is preferred instead of Converted parquet type, chances are SparkType has a name which will then fail the same type validation in later cases when running vectorized nested column read. ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? added new ut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
