Gabor Szadovszky created PARQUET-2037:
-----------------------------------------
Summary: Write INT96 with parquet-avro
Key: PARQUET-2037
URL: https://issues.apache.org/jira/browse/PARQUET-2037
Project: Parquet
Issue Type: Improvement
Components: parquet-avro, parquet-mr
Reporter: Gabor Szadovszky
Assignee: Gabor Szadovszky
This jira is about the write path of PARQUET-1928.
The issue here is how to identify an Avro FIXED type that was an INT96 before.
Of course, this feature would be behind a configuration flag similarly to
PARQUET-1928. But even with this flag it is not obvious to differentiate a
"simple" FIXED[12] byte from one that was an INT96 before.
Two options to solve this issue:
* Write the doc field of the avro schema that the FIXED value was an INT96.
* Instead of implementing a configuration flag let the user specify the names
of the columns to be converted to INT96 via the configuration.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
