[ 
https://issues.apache.org/jira/browse/HIVE-4531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated HIVE-4531:
-----------------------------

    Attachment: samplestatusdirwithlist.tar.gz
                HIVE-4531-5.patch

Adding a list file to the logs. Attached samplestatusdirwithlist.tar.gz for a 
sample status directory. Here is a sample list file (list.txt):

job: job_201305221327_0068(name=PigLatin:73.pig,status=SUCCEEDED)
  
attempt:attempt_201305221327_0068_m_000000_0(type=map,status=completed,starttime=22-May-2013
 17:10:26,endtime=22-May-2013 17:10:32)
  
attempt:attempt_201305221327_0068_m_000002_0(type=setup,status=completed,starttime=22-May-2013
 17:10:17,endtime=22-May-2013 17:10:26)
  
attempt:attempt_201305221327_0068_m_000001_0(type=cleanup,status=completed,starttime=22-May-2013
 17:10:32,endtime=22-May-2013 17:10:38)

job: job_201305221327_0069(name=PigLatin:73.pig,status=SUCCEEDED)
  
attempt:attempt_201305221327_0069_m_000000_0(type=map,status=completed,starttime=22-May-2013
 17:10:53,endtime=22-May-2013 17:10:59)
  
attempt:attempt_201305221327_0069_r_000000_0(type=reduce,status=completed,starttime=22-May-2013
 17:10:59,endtime=22-May-2013 17:11:11)
  
attempt:attempt_201305221327_0069_m_000002_0(type=setup,status=completed,starttime=22-May-2013
 17:10:44,endtime=22-May-2013 17:10:53)
  
attempt:attempt_201305221327_0069_m_000001_0(type=cleanup,status=completed,starttime=22-May-2013
 17:11:11,endtime=22-May-2013 17:11:17)

job: job_201305221327_0070(name=PigLatin:73.pig,status=SUCCEEDED)
  
attempt:attempt_201305221327_0070_m_000000_0(type=map,status=completed,starttime=22-May-2013
 17:11:32,endtime=22-May-2013 17:11:38)
  
attempt:attempt_201305221327_0070_r_000000_0(type=reduce,status=completed,starttime=22-May-2013
 17:11:38,endtime=22-May-2013 17:11:50)
  
attempt:attempt_201305221327_0070_m_000002_0(type=setup,status=completed,starttime=22-May-2013
 17:11:23,endtime=22-May-2013 17:11:32)
  
attempt:attempt_201305221327_0070_m_000001_0(type=cleanup,status=completed,starttime=22-May-2013
 17:11:50,endtime=22-May-2013 17:11:56)

job: job_201305221327_0071(name=PigLatin:73.pig,status=FAILED)
  
attempt:attempt_201305221327_0071_m_000000_0(type=map,status=completed,starttime=22-May-2013
 17:12:11,endtime=22-May-2013 17:12:17)
  
attempt:attempt_201305221327_0071_m_000001_0(type=map,status=completed,starttime=22-May-2013
 17:12:17,endtime=22-May-2013 17:12:23)
  
attempt:attempt_201305221327_0071_m_000003_0(type=setup,status=completed,starttime=22-May-2013
 17:12:02,endtime=22-May-2013 17:12:11)
  
attempt:attempt_201305221327_0071_m_000002_0(type=cleanup,status=completed,starttime=22-May-2013
 17:13:11,endtime=22-May-2013 17:13:17)
  
attempt:attempt_201305221327_0071_r_000000_0(type=reduce,status=failed,starttime=22-May-2013
 17:12:17,endtime=22-May-2013 17:12:29)
  
attempt:attempt_201305221327_0071_r_000000_1(type=reduce,status=failed,starttime=22-May-2013
 17:12:35,endtime=22-May-2013 17:12:33)
  
attempt:attempt_201305221327_0071_r_000000_2(type=reduce,status=failed,starttime=22-May-2013
 17:12:47,endtime=22-May-2013 17:12:43)
  
attempt:attempt_201305221327_0071_r_000000_3(type=reduce,status=failed,starttime=22-May-2013
 17:12:59,endtime=22-May-2013 17:12:46)

                
> [WebHCat] Collecting task logs to hdfs
> --------------------------------------
>
>                 Key: HIVE-4531
>                 URL: https://issues.apache.org/jira/browse/HIVE-4531
>             Project: Hive
>          Issue Type: New Feature
>          Components: HCatalog
>            Reporter: Daniel Dai
>         Attachments: HIVE-4531-1.patch, HIVE-4531-2.patch, HIVE-4531-3.patch, 
> HIVE-4531-4.patch, HIVE-4531-5.patch, samplestatusdirwithlist.tar.gz
>
>
> It would be nice we collect task logs after job finish. This is similar to 
> what Amazon EMR does.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to