Jaume M created HIVE-20853:

             Summary: Expose ShuffleHandler.registerDag in the llap daemon API
                 Key: HIVE-20853
                 URL: https://issues.apache.org/jira/browse/HIVE-20853
             Project: Hive
          Issue Type: Improvement
          Components: llap
    Affects Versions: 3.1.0
            Reporter: Jaume M

Currently DAGs are only registered when a submitWork is called for that DAG. At 
this point the crendentials are added to the ShuffleHandler and it can start 

However Tez might (and will) schedule tasks to fetch from the ShuffleHandler 
before anything of this happens and all this tasks will fail which may results 
in the query failing.

This happens in the scenario in which a LlapDaemon just comes up and tez 
fetchers try to open a connection before a DAG has been registered.

Adding this API will allow to register the DAG against the Daemon when the AM 
notices that a new Daemon is up.

This message was sent by Atlassian JIRA

Reply via email to