, June 19, 2012 6:03 PM
To: common-user@hadoop.apache.org
Subject: Creating MapFile.Reader instance in reducer setup
Hello, I'm tring to use MapFile (stored on HDFS) in my reduce task,
which processes some text data.
When I try to initialize MapFile.Reader in reducer configure() method,
app t
Hi,
> But creating instance of Reader for each reduce() call creates big slow
> down.
It wouldn't, if you wrapped it properly:
if (reader != null) {
// Initialize reader
reader = new MapFile.Reader(…)
}
This way it only initializes/reads/etc. once.
On Tue, Jun 19, 2012 at 6:03 PM, Ondřej K
instance in reducer setup
Hello, I'm tring to use MapFile (stored on HDFS) in my reduce task,
which processes some text data.
When I try to initialize MapFile.Reader in reducer configure() method,
app throws NullPointerException, when the same approach is used for each
reduce() method call
Hello, I'm tring to use MapFile (stored on HDFS) in my reduce task,
which processes some text data.
When I try to initialize MapFile.Reader in reducer configure() method,
app throws NullPointerException, when the same approach is used for each
reduce() method call with the same parameters, eve
