Gabor Szadovszky created PARQUET-2017:
-----------------------------------------
Summary: Handle special values of floating point statistics
Key: PARQUET-2017
URL: https://issues.apache.org/jira/browse/PARQUET-2017
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Reporter: Gabor Szadovszky
Assignee: Gabor Szadovszky
Based on PARQUET-1251 we have implemented the suggested workaround but it is
not complete in all situations.
* We handle the special floating point values at row-group level in parquet-mr
but only for the read path. For the write path we still write these values.
* For column indexes we handle these values but only for the write path and not
for the read path.
We should implement the workaround for both read and write paths for all cases
so we not only handle potentially invalid values but also don't write them to
the file.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
