I'm looking at NewHadoopRDD and looks like there is no equivalent of NextIterator there. I'm tempted to go with extending that.
Interestingly, in NewHadoopRDD, there is no concept of caching the configuration if one has not been broadcasted, whereas in HadoopRDD, there is a cache. I'm now tempted to go with extending NewHadoopRDD, and would appreciate some insight from the developers on what was the thinking behind keeping that out. Thanks, Ameet On Fri, Feb 21, 2014 at 2:26 PM, Ameet Kini <ameetk...@gmail.com> wrote: > On that same token, HadoopPartition. > > Yes, I can copy them verbatim and change them as they are small enough. > But sub-classing would have been nicer. > > Ameet > > > On Fri, Feb 21, 2014 at 2:16 PM, Ameet Kini <ameetk...@gmail.com> wrote: > >> >> I'm looking to subclass HadoopRDD and was hoping to subclass NextIterator >> in compute(). >> >> Thanks, >> Ameet >> > >
