Hi Wangda, Thank you for the idea, it worked!
On 8 April 2016 at 03:19, Wangda Tan <[email protected]> wrote: > Hi Mihal, > > Configuration specified by job will not pass to RM. > > The only way you can do is to add a new field to > ApplicationSubmissionContext so scheduler can see it. > > HTH, > - Wangda > > > > On Thu, Apr 7, 2016 at 4:27 AM, Mihai Varga <[email protected]> wrote: > > > Hello, > > > > I hope this is the right place to ask this. I'm trying to write a new > > scheduler that takes into consideration a deadline for a job and I'm not > > sure how to pass the job specific deadline to the scheduler (say > > > > > hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/FifoScheduler.java). > > > > I know that additional parameters can be passed through > > > > Configuration conf = new Configuration(); > > conf.set("test", "123"); > > > > or with the -D command when submitting a job, but I'm not sure how to > > retrieve those parameters in the scheduler where I only have an > > ApplicationID. > > > > I'm using Hadoop 2.7.2 and this is a school project and does not need to > go > > into production, so any hack would do. Any idea on how to do this? > > > > Thanks in advance! > > > > Best regards, > > Mihai > > >
