[
https://issues.apache.org/jira/browse/PIG-3117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13623426#comment-13623426
]
Ido Hadanny commented on PIG-3117:
----------------------------------
If someone's taking this, it would also be great if the temp file names would
be human-readable, e.g. they should contain the name of the last logic pig
alias included in this MR step (or all pig aliases contained in this MR step).
Something that resembles the "alias" column printed in the report pig emits
after the execution is complete.
> A debug mode in which pig does not delete temporary files
> ---------------------------------------------------------
>
> Key: PIG-3117
> URL: https://issues.apache.org/jira/browse/PIG-3117
> Project: Pig
> Issue Type: Wish
> Affects Versions: 0.10.0
> Reporter: Ido Hadanny
> Assignee: Cheolsoo Park
>
> when we debug our pig jobs on pre-production data, we usually find bugs we
> couldn't detect in our UT, as env and data are not quite the same.
> when the final output of a script is not quite what we expect, we start
> divide-and-conquer, running it line by line and inspecting the intermediate
> output of each stage.
> It would be great if we could simply configure pig not to delete the
> intermediate MR outputs, and store them as plaintext instead of snappy format.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
