[ https://issues.apache.org/jira/browse/PIG-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Koji Noguchi updated PIG-3072: ------------------------------ Attachment: pig-3072-v03.txt (Minor changes to previous v02 patch.) * Added comment in TFileRecordReader. "//TFile.Reader reads into buffer so, progress is updated in chunks." * Printing out progress to stderr. * Changed loop size from 1000 to 25000 so that at least progress changes once for codec='none'. 66%->99% For 'gz', it immediately jumps to 99% with this small tfile. * Added one extra check to make sure value is being read by recordReader. (curval == LOOP_SIZE) > Pig job reporting negative progress > ----------------------------------- > > Key: PIG-3072 > URL: https://issues.apache.org/jira/browse/PIG-3072 > Project: Pig > Issue Type: Bug > Components: impl > Affects Versions: 0.10.0 > Reporter: Koji Noguchi > Assignee: Koji Noguchi > Priority: Minor > Fix For: 0.12 > > Attachments: pig-3072-v01.txt, pig-3072-v02.txt, pig-3072-v03.txt > > > Our users pointed out that their jobs reporting negative progress. > 2012-11-02 21:43:11,538 [main] INFO > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - -795% complete > ... > (due to TFileRecordReader) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira