I had a similar issue and I believe the solution was to put the IP:port
combination in the exclude file instead of using hostnames.
-Chuck
-Original Message-
From: Mapred Learn [mailto:mapred.le...@gmail.com]
Sent: Thursday, August 01, 2013 6:24 PM
To: cdh-u...@cloudera.org; Airtel
Hi Subbu. Sounds like you'll have to implement a custom non-splittable
InputFormat which instantiates a custom RecordReader which in turn consumes
the entire file when it's next(K,V) method is called. Once implemented, you
specify the input format to the JobConf object:
regards
Arko
On Thu, Feb 14, 2013 at 8:16 PM, Charles Baker cba...@sdl.com wrote:
Hey Arko. Glad to hear it worked out for you. Just make sure that your
NN's image and edit files aren't also (perhaps inadvertently) stored
in that directory structure. The NameNode image/edit dir contains
Hey Arko. Glad to hear it worked out for you. Just make sure that your NN's
image and edit files aren't also (perhaps inadvertently) stored in that
directory structure. The NameNode image/edit dir contains the following:
drwxr-xr-x 2 hdfs hdfs 4096 Feb 14 17:48 current
drwxr-xr-x 2 hdfs hdfs 4096
, Arko Provo Mukherjee
arkoprovomukher...@gmail.com wrote:
Hi,
Yeah, my NameNode is also seconding as a DataNode.
I would like to turn off this feature.
Request help regarding the same.
Thanks regards
Arko
On Wed, Feb 13, 2013 at 1:38 PM, Charles Baker cba...@sdl.com
Hi Arko. Sounds like you may be running a DataNode on the NameNode which is
not recommended practice. Normally, the only files the NN stores are the
image and edits files. It does not store any actual HDFS data. If you must
run a DN on the NN, try turning down the logging in
