[
https://issues.apache.org/jira/browse/HIVE-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977185#action_12977185
]
Mohit Sikri commented on HIVE-1508:
-----------------------------------
Great finding, but how do we curtail(or put the limit to) the number of these
files generated, since I don't see any mechanism of deleting such files (say
deleting the files older than an hour or so), they may eventually pile up to
the extent of consuming significant disk space.
I don't see any significance of these files once session expires or keeping too
old session information within such files.
Kindly suggest.
> Add cleanup method to HiveHistory class
> ---------------------------------------
>
> Key: HIVE-1508
> URL: https://issues.apache.org/jira/browse/HIVE-1508
> Project: Hive
> Issue Type: Bug
> Components: Metastore, Server Infrastructure
> Reporter: Anurag Phadke
> Assignee: Edward Capriolo
> Priority: Blocker
> Fix For: 0.7.0
>
> Attachments: hive-1508-1-patch.txt
>
>
> Running hive server for long time > 90 minutes results in too many open
> file-handles, eventually causing the server to crash as the server runs out
> of file handle.
> Actual bug as described by Carl Steinbach:
> the hive_job_log_* files are created by the HiveHistory class. This class
> creates a PrintWriter for writing to the file, but never closes the writer.
> It looks like we need to add a cleanup method to HiveHistory that closes the
> PrintWriter and does any other necessary cleanup.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
