[
https://issues.apache.org/jira/browse/YARN-10634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sushanta Sen updated YARN-10634:
--------------------------------
Description:
Execute the below job by Passing this config
-Dmapreduce.job.num-opportunistic-maps-percent ,which actually represents the
number of containers to be launched as Opportunistic, not in % of the total
mappers requested , i think this configuration name should be modified
accordingly and also {color:#de350b}the same gets printed in AM logs which also
needs to be corrected accordingly.{color}
Job Command: hadoop jar
HDFS/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1-hw-ei-310001-SNAPSHOT.jar
pi -{color:#de350b}Dmapreduce.job.num-opportunistic-maps-percent{color}="20"
20 99
In AM logs this message is displayed. it should be {color:#de350b}20 , not 20%
{color}?
“2021-02-10 20:23:23,023 | INFO | main | {color:#de350b}20% of the
mappers{color} will be scheduled using OPPORTUNISTIC containers |
RMContainerAllocator.java:257”
Job Command: hadoop jar
HDFS/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1-hw-ei-310001-SNAPSHOT.jar
pi {color:#de350b}-Dmapreduce.job.num-opportunistic-maps-percent{color}="100"
20 99
In AM logs this message is displayed. It should be {color:#de350b}100, not
100%{color} ?
2021-02-10 20:28:16,016 | INFO | main | {color:#de350b}100% of the
mapper{color}s will be scheduled using OPPORTUNISTIC containers |
RMContainerAllocator.java:257
was:
Execute the below job by Passing this config
-Dmapreduce.job.num-opportunistic-maps-percent ,which actually represents the
number of containers to be launched as Opportunistic, not in % of the total
mappers requested , i think this configuration name should be modified
accordingly and also {color:#de350b}the same gets printed in AM logs{color}
Job Command: hadoop jar
HDFS/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1-hw-ei-310001-SNAPSHOT.jar
pi -{color:#de350b}Dmapreduce.job.num-opportunistic-maps-percent{color}="20"
20 99
In AM logs this message is displayed. it should be {color:#de350b}20 , not 20%
{color}?
“2021-02-10 20:23:23,023 | INFO | main | {color:#de350b}20% of the
mappers{color} will be scheduled using OPPORTUNISTIC containers |
RMContainerAllocator.java:257”
Job Command: hadoop jar
HDFS/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1-hw-ei-310001-SNAPSHOT.jar
pi {color:#de350b}-Dmapreduce.job.num-opportunistic-maps-percent{color}="100"
20 99
In AM logs this message is displayed. It should be {color:#de350b}100, not
100%{color} ?
2021-02-10 20:28:16,016 | INFO | main | {color:#de350b}100% of the
mapper{color}s will be scheduled using OPPORTUNISTIC containers |
RMContainerAllocator.java:257
> The config parameter "mapreduce.job.num-opportunistic-maps-percent" is
> confusing when requesting Opportunistic containers in YARN job
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-10634
> URL: https://issues.apache.org/jira/browse/YARN-10634
> Project: Hadoop YARN
> Issue Type: Bug
> Components: applications
> Reporter: Sushanta Sen
> Assignee: Bilwa S T
> Priority: Minor
>
> Execute the below job by Passing this config
> -Dmapreduce.job.num-opportunistic-maps-percent ,which actually represents the
> number of containers to be launched as Opportunistic, not in % of the total
> mappers requested , i think this configuration name should be modified
> accordingly and also {color:#de350b}the same gets printed in AM logs which
> also needs to be corrected accordingly.{color}
> Job Command: hadoop jar
> HDFS/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1-hw-ei-310001-SNAPSHOT.jar
> pi -{color:#de350b}Dmapreduce.job.num-opportunistic-maps-percent{color}="20"
> 20 99
> In AM logs this message is displayed. it should be {color:#de350b}20 , not
> 20% {color}?
> “2021-02-10 20:23:23,023 | INFO | main | {color:#de350b}20% of the
> mappers{color} will be scheduled using OPPORTUNISTIC containers |
> RMContainerAllocator.java:257”
> Job Command: hadoop jar
> HDFS/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1-hw-ei-310001-SNAPSHOT.jar
> pi
> {color:#de350b}-Dmapreduce.job.num-opportunistic-maps-percent{color}="100" 20
> 99
> In AM logs this message is displayed. It should be {color:#de350b}100, not
> 100%{color} ?
> 2021-02-10 20:28:16,016 | INFO | main | {color:#de350b}100% of the
> mapper{color}s will be scheduled using OPPORTUNISTIC containers |
> RMContainerAllocator.java:257
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
