[ 
https://issues.apache.org/jira/browse/HIVE-4513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair updated HIVE-4513:
--------------------------------

    Description: 
HiveHistory log files (hive_job_log_hive_*.txt files) store information about 
hive query such as query string, plan , counters and MR job progress 
information.

There is no mechanism to delete these files and as a result they get 
accumulated over time, using up lot of disk space. 
I don't think this is used by most people, so I think it would better to turn 
this off by default. Jobtracker logs already capture most of this information, 
though it is not as structured as history logs.



  was:
HiveHistory log files (hive_job_log_hive_*.txt files) store information about 
hive query such as query string, plan , counters and MR job progress 
information.

There is no mechanism to delete these files and as a result they get 
accumulated over time, using up lot of disk space. 
I don't think this is used by most people, so I think it would better to turn 
this off by default. Jobtracker logs already capture most of this information, 
though it is not as structured as history logs.

HIVE-4500 is introducing a new config parameter to turn this off, we should use 
that to turn this off by default.


    
> disable hivehistory logs by default
> -----------------------------------
>
>                 Key: HIVE-4513
>                 URL: https://issues.apache.org/jira/browse/HIVE-4513
>             Project: Hive
>          Issue Type: Bug
>          Components: Configuration, Logging
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>         Attachments: HIVE-4513.1.patch, HIVE-4513.2.patch, HIVE-4513.3.patch, 
> HIVE-4513.4.patch
>
>
> HiveHistory log files (hive_job_log_hive_*.txt files) store information about 
> hive query such as query string, plan , counters and MR job progress 
> information.
> There is no mechanism to delete these files and as a result they get 
> accumulated over time, using up lot of disk space. 
> I don't think this is used by most people, so I think it would better to turn 
> this off by default. Jobtracker logs already capture most of this 
> information, though it is not as structured as history logs.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to