[
https://issues.apache.org/jira/browse/PIG-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olga Natkovich updated PIG-2363:
--------------------------------
I looked at it at some point and it seems that we regressed and create _log
directory in more places than before and instead of doing it lazily we do it
proactively. I think rather than adding more config options, we need to figure
out why this is happenning.
> Provide configuration to disable persistence of _logs for streaming commands
> ----------------------------------------------------------------------------
>
> Key: PIG-2363
> URL: https://issues.apache.org/jira/browse/PIG-2363
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.1
> Reporter: Vivek Padmanabhan
> Attachments: PIG-2363_1.patch
>
>
> For Pig scripts which has streaming commands , the stderr is saved into hdfs
> under _logs folder in the output directory.
> This behavior was not seen with Pig 0.8 by default, but from 0.9 onwards, we
> are seeing _logs folder.
> Hence it would be nice to have a configuration to disable this feature.
> Sample script
> {code}
> DEFINE mycmd `t.pl` ship ('t.pl');
> a = load 'i1' as (f1:chararray,f2:chararray);
> b = stream a through mycmd;
> store b into 'output';
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
