[jira] Commented: (MAPREDUCE-773) LineRecordReader can report non-zero progress while it is processing a compressed stream
[ https://issues.apache.org/jira/browse/MAPREDUCE-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12750656#action_12750656 ] Chris Douglas commented on MAPREDUCE-773: - Filed MAPREDUCE-946 LineRecordReader can report non-zero progress while it is processing a compressed stream Key: MAPREDUCE-773 URL: https://issues.apache.org/jira/browse/MAPREDUCE-773 Project: Hadoop Map/Reduce Issue Type: Bug Components: task Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.21.0 Attachments: 773.2.patch, 773.3.patch, 773.patch, 773.patch Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs (since the end of the filesplit is set to Long.MAX_VALUE for compressed inputs). This can be improved to return a non-zero progress even for compressed streams (though it may not be very reflective of the actual progress). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-773) LineRecordReader can report non-zero progress while it is processing a compressed stream
[ https://issues.apache.org/jira/browse/MAPREDUCE-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12744191#action_12744191 ] Hong Tang commented on MAPREDUCE-773: - Patch looks good. +1. LineRecordReader can report non-zero progress while it is processing a compressed stream Key: MAPREDUCE-773 URL: https://issues.apache.org/jira/browse/MAPREDUCE-773 Project: Hadoop Map/Reduce Issue Type: Bug Components: task Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.21.0 Attachments: 773.2.patch, 773.3.patch, 773.patch, 773.patch Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs (since the end of the filesplit is set to Long.MAX_VALUE for compressed inputs). This can be improved to return a non-zero progress even for compressed streams (though it may not be very reflective of the actual progress). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-773) LineRecordReader can report non-zero progress while it is processing a compressed stream
[ https://issues.apache.org/jira/browse/MAPREDUCE-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12744224#action_12744224 ] Hadoop QA commented on MAPREDUCE-773: - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12416766/773.3.patch against trunk revision 805081. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/486/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/486/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/486/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/486/console This message is automatically generated. LineRecordReader can report non-zero progress while it is processing a compressed stream Key: MAPREDUCE-773 URL: https://issues.apache.org/jira/browse/MAPREDUCE-773 Project: Hadoop Map/Reduce Issue Type: Bug Components: task Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.21.0 Attachments: 773.2.patch, 773.3.patch, 773.patch, 773.patch Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs (since the end of the filesplit is set to Long.MAX_VALUE for compressed inputs). This can be improved to return a non-zero progress even for compressed streams (though it may not be very reflective of the actual progress). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-773) LineRecordReader can report non-zero progress while it is processing a compressed stream
[ https://issues.apache.org/jira/browse/MAPREDUCE-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733301#action_12733301 ] Arun C Murthy commented on MAPREDUCE-773: - I'm guessing this will help with speculative execution... am I right? LineRecordReader can report non-zero progress while it is processing a compressed stream Key: MAPREDUCE-773 URL: https://issues.apache.org/jira/browse/MAPREDUCE-773 Project: Hadoop Map/Reduce Issue Type: Bug Components: task Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.21.0 Attachments: 773.patch Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs (since the end of the filesplit is set to Long.MAX_VALUE for compressed inputs). This can be improved to return a non-zero progress even for compressed streams (though it may not be very reflective of the actual progress). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-773) LineRecordReader can report non-zero progress while it is processing a compressed stream
[ https://issues.apache.org/jira/browse/MAPREDUCE-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733305#action_12733305 ] Hong Tang commented on MAPREDUCE-773: - @devaraj, +1. @arun, yes. LineRecordReader can report non-zero progress while it is processing a compressed stream Key: MAPREDUCE-773 URL: https://issues.apache.org/jira/browse/MAPREDUCE-773 Project: Hadoop Map/Reduce Issue Type: Bug Components: task Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.21.0 Attachments: 773.patch Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs (since the end of the filesplit is set to Long.MAX_VALUE for compressed inputs). This can be improved to return a non-zero progress even for compressed streams (though it may not be very reflective of the actual progress). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-773) LineRecordReader can report non-zero progress while it is processing a compressed stream
[ https://issues.apache.org/jira/browse/MAPREDUCE-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733356#action_12733356 ] Owen O'Malley commented on MAPREDUCE-773: - Chris is asking for this to hold up on HADOOP-4010 to go in first. LineRecordReader can report non-zero progress while it is processing a compressed stream Key: MAPREDUCE-773 URL: https://issues.apache.org/jira/browse/MAPREDUCE-773 Project: Hadoop Map/Reduce Issue Type: Bug Components: task Reporter: Devaraj Das Assignee: Devaraj Das Fix For: 0.21.0 Attachments: 773.patch Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs (since the end of the filesplit is set to Long.MAX_VALUE for compressed inputs). This can be improved to return a non-zero progress even for compressed streams (though it may not be very reflective of the actual progress). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
