[
https://issues.apache.org/jira/browse/HIVE-24068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanth Jayachandran updated HIVE-24068:
-----------------------------------------
Description: DAG submission failure can also happen in environments where
AM container died causing DNS issues. DAG submissions are safe to retry as the
DAG hasn't started execution yet. There are retries at getSession and submitDAG
level individually but some submitDAG failure has to retry getSession as well
as AM could be unreachable, this can be handled in re-execution plugin. (was:
ReExecutionOverlayPlugin handles cases where there is a vertex failure. DAG
submission failure can also happen in environments where AM container died
causing DNS issues. DAG submissions are safe to retry as the DAG hasn't started
execution yet.)
> Add re-execution plugin for handling DAG submission failures
> ------------------------------------------------------------
>
> Key: HIVE-24068
> URL: https://issues.apache.org/jira/browse/HIVE-24068
> Project: Hive
> Issue Type: Bug
> Affects Versions: 4.0.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Priority: Major
>
> DAG submission failure can also happen in environments where AM container
> died causing DNS issues. DAG submissions are safe to retry as the DAG hasn't
> started execution yet. There are retries at getSession and submitDAG level
> individually but some submitDAG failure has to retry getSession as well as AM
> could be unreachable, this can be handled in re-execution plugin.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
