Allow to disable automatic shipping of dependency jars for mapreduce jobs
-------------------------------------------------------------------------
Key: HBASE-3076
URL: https://issues.apache.org/jira/browse/HBASE-3076
Project: HBase
Issue Type: Improvement
Components: mapreduce
Reporter: Bruno Dumon
Priority: Minor
Attachments: tablemapreduceutil-optional-adddependencies-patch.txt
Since HBASE-3001, TableMapReduceUtil.initTableMap/ReduceJob will automatically
upload the HBase jars needed to execute a map reduce job.
In my case I am building a job jar using Maven's assembly plugin, this way all
the necessary dependencies are in the job jar. So in such case the default
behavior of HBase causes some needless upload work. It also uploads hadoop-core
itself which is not necessary.
Therefore I propose to add a variant of the initTableMap/ReduceJob methods with
an extra boolean argument to disable the automatic adding of dependency jars.
I will attach a patch with the proposed change.
Note that everything works as is, this is just an optimization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
