[
https://issues.apache.org/jira/browse/SPARK-4437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-4437.
-------------------------------
Resolution: Fixed
Fix Version/s: 1.3.0
Issue resolved by pull request 3301
[https://github.com/apache/spark/pull/3301]
> Docs for difference between WholeTextFileRecordReader and
> WholeCombineFileRecordReader
> --------------------------------------------------------------------------------------
>
> Key: SPARK-4437
> URL: https://issues.apache.org/jira/browse/SPARK-4437
> Project: Spark
> Issue Type: Documentation
> Components: Documentation
> Reporter: Andrew Ash
> Assignee: Davies Liu
> Fix For: 1.3.0
>
>
> Tracking per this dev@ thread:
> {quote}
> On Sun, Nov 16, 2014 at 4:49 PM, Reynold Xin <[email protected]> wrote:
> I don't think the code is immediately obvious.
> Davies - I think you added the code, and Josh reviewed it. Can you guys
> explain and maybe submit a patch to add more documentation on the whole
> thing?
> Thanks.
> On Sun, Nov 16, 2014 at 3:22 AM, Vibhanshu Prasad <[email protected]>
> wrote:
> > Hello Everyone,
> >
> > I am going through the source code of rdd and Record readers
> > There are found 2 classes
> >
> > 1. WholeTextFileRecordReader
> > 2. WholeCombineFileRecordReader ( extends CombineFileRecordReader )
> >
> > The description of both the classes is perfectly similar.
> >
> > I am not able to understand why we have 2 classes. Is
> > CombineFileRecordReader providing some extra advantage?
> >
> > Regards
> > Vibhanshu
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
