[ 
https://issues.apache.org/jira/browse/HIVE-4531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated HIVE-4531:
-----------------------------

    Release Note: 
In POST pig/hive/jar/steaming request, if statusdir is set and enablelog=true, 
webhcat will create a $statusdir/logs directory after task finish. The attempts 
here include completed attempts and failed attempts. The layout for logs 
directory is:

logs/$job_id (directory for $job_id)
logs/$job_id/job.xml.html
logs/$job_id/$attempt_id (directory for $attempt_id)
logs/$job_id/$attempt_id/stderr
logs/$job_id/$attempt_id/stdout
logs/$job_id/$attempt_id/syslog

NO PRECOMMIT TESTS

  was:
In POST pig/hive/jar/steaming request, if statusdir is set and enablelog=true, 
webhcat will create a $statusdir/logs directory after task finish. The attempts 
here include completed attempts and failed attempts. The layout for logs 
directory is:

logs/$job_id (directory for $job_id)
logs/$job_id/job.xml.html
logs/$job_id/$attempt_id (directory for $attempt_id)
logs/$job_id/$attempt_id/stderr
logs/$job_id/$attempt_id/stdout
logs/$job_id/$attempt_id/syslog

    
> [WebHCat] Collecting task logs to hdfs
> --------------------------------------
>
>                 Key: HIVE-4531
>                 URL: https://issues.apache.org/jira/browse/HIVE-4531
>             Project: Hive
>          Issue Type: New Feature
>          Components: HCatalog
>            Reporter: Daniel Dai
>         Attachments: HIVE-4531-1.patch, HIVE-4531-2.patch, HIVE-4531-3.patch, 
> HIVE-4531-4.patch, HIVE-4531-5.patch, HIVE-4531-6.patch, HIVE-4531-7.patch, 
> HIVE-4531-8.patch, samplestatusdirwithlist.tar.gz
>
>
> It would be nice we collect task logs after job finish. This is similar to 
> what Amazon EMR does.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to