Prasanth Jayachandran created HIVE-13285:
--------------------------------------------
Summary: Orc concatenation may drop old files from moving to final
path
Key: HIVE-13285
URL: https://issues.apache.org/jira/browse/HIVE-13285
Project: Hive
Issue Type: Bug
Components: ORC
Affects Versions: 2.0.0, 1.1.0, 1.2.0, 1.0.0, 0.14.0, 1.3.0, 2.1.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran
Priority: Critical
ORC concatenation uses combine hive input format for merging files. Under
specific case where all files within a combine split are incompatible for merge
(old files without stripe statistics) then these files are added to
incompatible file set. But this file set is not processed as closeOp() will not
be called (no output file writer will exist which will skip super.closeOp()).
As a result, these incompatible files are not moved to final path.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
