Provide configuration to disable persistence of _logs for streaming commands
----------------------------------------------------------------------------

                 Key: PIG-2363
                 URL: https://issues.apache.org/jira/browse/PIG-2363
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.9.1
            Reporter: Vivek Padmanabhan


For Pig scripts which has streaming commands , the stderr is saved into hdfs 
under _logs folder in the output directory.
This behavior was not seen with Pig 0.8 by default, but from 0.9 onwards,  we 
are seeing _logs folder.
Hence it would be nice to have a configuration to disable this feature.

Sample script
{code}
DEFINE mycmd `t.pl` ship ('t.pl');
a = load 'i1' as (f1:chararray,f2:chararray);
b = stream a through mycmd;
store b into 'output';
{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to