Hi Sharad,
Thanks for the hint - that looks indeed like what I need. We'll be
moving to 0.19 shortly now that Hbase has caught up.
Craig
sharad agarwal wrote:
Any suggestions, short of deleting them after the job completes?
which version of hadoop you are using? hadoop 0.19 has an api called
JobConf.setOutputCommitter see
http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/mapred/OutputCommitter.html
via which you can do the clean up work at the end of the job.
|*
<http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/mapred/JobConf.html#setOutputCommitter%28java.lang.Class%29>*|
