Thanks Richard, but i still have a question, if i'm using hadoop jar to submit
a job, how can i set the priority for each job? I do see something like this
"mapred.job.priority", but when i put it in my Job's configuration like this:
conf.set("mapred.job.priority", "HIGH"), it seems it doesn't work. Thanks
Cheers Ramon
> Date: Sun, 20 Nov 2011 09:42:43 -0800
> From: [email protected]
> Subject: Re: How to manage hadoop job submit?
> To: [email protected]
>
> Ramon,
>
> You might issue an ./hadoop -list all to get the jobs and then -set-priority
> <id> <priority>. I know that someone from that Ocean Sync
> (http://www.oceansync.com) Hadoop management project is working with
> interacting with MapReduce jobs through a GUI, to set priorities through
> that, but they are still in beta.
>
>
> job
> Command to interact with Map Reduce Jobs.
> Usage: hadoop job [GENERIC_OPTIONS] [-submit <job-file>] | [-status
> <job-id>] | [-counter <job-id> <group-name> <counter-name>] | [-kill
> <job-id>] | [-events <job-id> <from-event-#> <#-of-events>] | [-history
> [all] <jobOutputDir>] | [-list [all]] | [-kill-task <task-id>] | [-fail-task
> <task-id>] | [-set-priority <job-id> <priority>]
>
>
> ----- Original Message -----
> From: WangRamon <[email protected]>
> To: [email protected]
> Cc:
> Sent: Sunday, November 20, 2011 4:44 AM
> Subject: How to manage hadoop job submit?
>
>
> Hi All
> I'm new to hadoop, I know I can use "haddop jar" to submit my M/R job, but we
> need to submit a lot of jobs in my real environment, there is priority
> requirement for each jobs, so is there any way to manage how to submit jobs?
> Any Java API? Or we can only use the hadoop command line with shell or python
> to do the job submit?
> Thanks Ramon
