LineRecordReader can report non-zero progress while it is processing a
compressed stream
----------------------------------------------------------------------------------------
Key: MAPREDUCE-773
URL: https://issues.apache.org/jira/browse/MAPREDUCE-773
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: task
Reporter: Devaraj Das
Assignee: Devaraj Das
Fix For: 0.21.0
Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs
(since the "end" of the filesplit is set to Long.MAX_VALUE for compressed
inputs). This can be improved to return a non-zero progress even for compressed
streams (though it may not be very reflective of the actual progress).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.