Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22343
To clarify: this is just a workaround when we hit a problematic(having
case-insensitive duplicated filed names in the parquet file) hive parquet
tables and we want to read it with the native parquet reader. The hive behaivor
is weird but we need to follow it as we are reading a hive table.
Personally I think it's not a big deal. If the hive table is malformed, I
think we don't have to follow hive's bugy behavior. If people are confused by
this patch and think this doesn't worth, I'm ok to just leave it.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
