Steven Phillips created DRILL-2577: -------------------------------------- Summary: Parquet scan fails when directory contains _SUCCESS or _logs Key: DRILL-2577 URL: https://issues.apache.org/jira/browse/DRILL-2577 Project: Apache Drill Issue Type: Bug Reporter: Steven Phillips
_SUCCESS and _logs are often created from map reduce jobs, and typically ignored. This is commonly done using the OutputFilesFilter in hadoop. The new FooterGatherer class, which is used to read parquet footers in parallel, does not use this filter. So it attempts to read these as parquet files and fails. The fix is to use the DrillPathFilter, which extends OutputFilesFilter, in the FooterGather code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)