Laurent Goujon created PARQUET-362:
--------------------------------------
Summary: Parquet buffered writer is too sensitive regarding unions
and unknown fields
Key: PARQUET-362
URL: https://issues.apache.org/jira/browse/PARQUET-362
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Affects Versions: 1.8.0, 1.7.0, 1.8.1
Reporter: Laurent Goujon
Parquet does prevent records with unknown union fields to be written as it
would create a TProtocol violation. But it also prevents records with unions
having one their field itself having an unknown field (which is acceptable if
it is a struct).
The recursive check should be removed, and only when a union field is unknown
should the record be deemed invalid.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
