Sending the entire file content as value to the mapper

2013-07-11 Thread Kasi Subrahmanyam
Hi Team, I have a file which has semi structured text data with no definite start and end points. How can i send the entire content of the file at once as key or value to the mapper instead of line by line. Thanks, Subbu

RE: Sending the entire file content as value to the mapper

2013-07-11 Thread Charles Baker
Hi Subbu. Sounds like you'll have to implement a custom non-splittable InputFormat which instantiates a custom RecordReader which in turn consumes the entire file when it's next(K,V) method is called. Once implemented, you specify the input format to the JobConf object: