Github user yucai commented on the issue:
https://github.com/apache/spark/pull/22197
@cloud-fan @HyukjinKwon Seem cannot simply add `originalName` into
`ParquetSchemaType`.
Because we need exact ParquetSchemaType info for type match, like:
```
private val ParquetByteType = ParquetSchemaType(INT_8, INT32, 0, null)
private val ParquetShortType = ParquetSchemaType(INT_16, INT32, 0, null)
private val ParquetIntegerType = ParquetSchemaType(null, INT32, 0, null)
...
private val makeEq: = {
case ParquetByteType | ParquetShortType | ParquetIntegerType =>
```
I use a new case class `ParquetField` to reduce the map.
```
private case class ParquetField(
name: String,
schema: ParquetSchemaType)
```
Let me know if you are OK with this way.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
