xianlongZhang created SPARK-21883:
-------------------------------------

             Summary: when a stage failed,should remove it's child stages's 
pending state on spark UI,and mark  jobs which this stage belongs to failed
                 Key: SPARK-21883
                 URL: https://issues.apache.org/jira/browse/SPARK-21883
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 1.6.1
            Reporter: xianlongZhang


When a stage failed ,we should remove it's child stages on “Pending” tab  on 
spark UI,and mark  jobs which this stage belongs to failed,then response 
client,usually ,this is ok, but with fair-schedule to run spark thrift server, 
multiple sql concurrent inquiries, sometimes ,when  task failed with 
"FetchFailed" state,spark did not abort the failed stage and mark the job 
failed,  the job will hang up



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to