[ 
https://issues.apache.org/jira/browse/HIVE-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13775848#comment-13775848
 ] 

Eugene Koifman commented on HIVE-4773:
--------------------------------------

[~shuainie] OK, I misread your code.  You only use CustomFilterOutputStream to 
wrap System.out/System.err but not when 'out' = statusdir.  I get it now, so 
your changes do the same thing as I was suggesting in previous comment.

I would suggest calling this wrapper class NonClosableStream, and making 
close() method in it do nothing.  (also make class private).  I think this will 
make it easier to understand.
                
> Templeton intermittently fail to commit output to file system
> -------------------------------------------------------------
>
>                 Key: HIVE-4773
>                 URL: https://issues.apache.org/jira/browse/HIVE-4773
>             Project: Hive
>          Issue Type: Bug
>          Components: WebHCat
>            Reporter: Shuaishuai Nie
>            Assignee: Shuaishuai Nie
>         Attachments: HIVE-4773.1.patch, HIVE-4773.2.patch
>
>
> With ASV as a default FS, we saw instances where output is not fully flushed 
> to storage before the Templeton controller process exits. This results in 
> stdout and stderr being empty even though the job completed successfully.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to