Hi all,
I'm trying to launch a process to map our log data into hive tables and I
was trying to assign this job to a specific pool name. This is our
configuration file:
--------- allocations.xml --------
<?xml version="1.0"?>
<allocations>
<pool name="log2hive">
<minMaps>14</minMaps>
<minReduces>6</minReduces>
<maxRunningJobs>1</maxRunningJobs>
<minSharePreemptionTimeout>300</minSharePreemptionTimeout>
<weight>1.0</weight>
</pool>
<defaultMinSharePreemptionTimeout>600</defaultMinSharePreemptionTimeout>
<fairSharePreemptionTimeout>600</fairSharePreemptionTimeout>
</allocations>
--------- mapred-site.xml --------------
<property>
<name>mapred.jobtracker.taskScheduler</name>
<value>org.apache.hadoop.mapred.FairScheduler</value>
</property>
<property>
<name>mapred.fairscheduler.allocation.file</name>
<value>/hadoop/conf/allocations.xml</value>
</property>
My question is how can I use this new pool to launch jobs? I'm using `hadoop
jar` command but I would be also interested in assign pools from my code.
Thanks in advance,