[
https://issues.apache.org/jira/browse/PIG-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172149#comment-13172149
]
[email protected] commented on PIG-2363:
----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3256/
-----------------------------------------------------------
Review request for pig.
Summary
-------
For Pig scripts which has streaming commands , the stderr is saved into hdfs
under _logs folder in the output directory.
This behavior was not seen with Pig 0.8 by default, but from 0.9 onwards, we
are seeing _logs folder.
Hence it would be nice to have a configuration to disable this feature.
Sample script
DEFINE mycmd `t.pl` ship ('t.pl');
a = load 'i1' as (f1:chararray,f2:chararray);
b = stream a through mycmd;
store b into 'output';
This addresses bug PIG-2363.
https://issues.apache.org/jira/browse/PIG-2363
Diffs
-----
Diff: https://reviews.apache.org/r/3256/diff
Testing
-------
Thanks,
Vivek
> Provide configuration to disable persistence of _logs for streaming commands
> ----------------------------------------------------------------------------
>
> Key: PIG-2363
> URL: https://issues.apache.org/jira/browse/PIG-2363
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.1
> Reporter: Vivek Padmanabhan
> Assignee: Vivek Padmanabhan
> Attachments: PIG-2363_1.patch
>
>
> For Pig scripts which has streaming commands , the stderr is saved into hdfs
> under _logs folder in the output directory.
> This behavior was not seen with Pig 0.8 by default, but from 0.9 onwards, we
> are seeing _logs folder.
> Hence it would be nice to have a configuration to disable this feature.
> Sample script
> {code}
> DEFINE mycmd `t.pl` ship ('t.pl');
> a = load 'i1' as (f1:chararray,f2:chararray);
> b = stream a through mycmd;
> store b into 'output';
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
