Chris Albright created PARQUET-125:
--------------------------------------
Summary: Enhance the way path checking is done in
ParquetFileWriter.mergeFooters
Key: PARQUET-125
URL: https://issues.apache.org/jira/browse/PARQUET-125
Project: Parquet
Issue Type: Improvement
Components: parquet-mr
Affects Versions: parquet-mr_1.6.0, 1.6.0rc2
Reporter: Chris Albright
Priority: Minor
To ensure a metadata summary is only written to the same path as the files from
which the summary is created, there is a check against the the root path for
each footer's file. Only the path is compared, which leaves a possibility that
the same path on 2 different types of filesystems (hdfs vs. file for example)
could cause some unexpected or erroneous output.
This outcome would be unlikely, but it is not explicitly prevented anywhere
which exposes risk to future changes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
