Eugene Koifman created HIVE-16360:
-------------------------------------
Summary: Improve "No delta files or original files found to
compact in" message
Key: HIVE-16360
URL: https://issues.apache.org/jira/browse/HIVE-16360
Project: Hive
Issue Type: Improvement
Components: Transactions
Affects Versions: 1.2.0
Reporter: Eugene Koifman
CompactorMR.run() produces
{noformat}
LOG.error("No delta files or original files found to compact in " +
sd.getLocation() + " for compactionId=" + ci.id);
{noformat}
in some cases even where there are plenty of delta directories in the partition.
The reason is that compactor won't compact anything above the level of an open
transaction. So if there is a very long running txn, it may filter out all
deltas in a partition. This looks very confusing when looking at the logs.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
