[
https://issues.apache.org/jira/browse/HIVE-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367606#comment-17367606
]
David Mollitor edited comment on HIVE-24484 at 6/22/21, 6:40 PM:
-----------------------------------------------------------------
[HADOOP-16458] caused a small regression for Hive.
{code:java|title=InvalidInputException.java (Hadoop)}
if (!probs.isEmpty()) {
initCause(probs.get(0));
}
{code}
{code:java|title=FetchOperator.java (Hive)}
try {
splits = inputFormat.getSplits(job, 1);
} catch (Exception ex) {
Throwable t = ExceptionUtils.getRootCause(ex);
if (t instanceof FileNotFoundException || t instanceof
InvalidInputException) {
LOG.warn("Input path " + currPath + " is empty", t.getMessage());
return;
}
throw ex;
}
{code}
So Hive is looking at the "root cause" and was seeing the
{{InvalidInputException}}. With [HADOOP-16458], the {{InvalidInputException}}
now sets a cause so Hive is finding the underlying cause which happens to be an
{{IOException}}.
I updated my PR to be able to catch the {{InvalidInputException}} and not the
root cause.
was (Author: belugabehr):
[HADOOP-16458] caused a small regression for Hive.
{code:java|title=InvalidInputException.java}
if (!probs.isEmpty()) {
initCause(probs.get(0));
}
{code}
{code:java|title=FetchOperator.java}
try {
splits = inputFormat.getSplits(job, 1);
} catch (Exception ex) {
Throwable t = ExceptionUtils.getRootCause(ex);
if (t instanceof FileNotFoundException || t instanceof
InvalidInputException) {
LOG.warn("Input path " + currPath + " is empty", t.getMessage());
return;
}
throw ex;
}
{code}
So Hive is looking at the "root cause" and was seeing the
{{InvalidInputException}}. With [HADOOP-16458], the {{InvalidInputException}}
now sets a cause so Hive is finding the underlying cause which happens to be an
{{IOException}}.
I updated my PR to be able to catch the {{InvalidInputException}} and not the
root cause.
> Upgrade Hadoop to 3.3.0
> -----------------------
>
> Key: HIVE-24484
> URL: https://issues.apache.org/jira/browse/HIVE-24484
> Project: Hive
> Issue Type: Improvement
> Reporter: David Mollitor
> Assignee: David Mollitor
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
