[
https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16342328#comment-16342328
]
Jian He commented on YARN-7792:
-------------------------------
Some comments regarding config, (Don't know where to post these comments, so
just paste here)
- yarn.resourcemanager.placement-constraints.algorithm.pool-size
- yarn.resourcemanager.placement-constraints.scheduler.pool-size
The naming "pool-size" confused me at first sight. I understand it after
looking at the description/code. How about call it thread-pool-size to be more
explicit ?
- I must be doing something wrong, I tried to run distributed shell as below
but it fails
{code:java}
hadoop-common jhe$ hadoop jar
$HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-$VERSION.jar
-jar
$HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-$VERSION.jar
-shell_command sleep -shell_args 10000 --placement_spec spec
Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
18/01/26 23:05:46 INFO distributedshell.Client: Initializing Client
18/01/26 23:05:46 INFO distributedshell.PlacementSpec: Parsing Placement Specs:
[spec]
18/01/26 23:05:46 INFO distributedshell.PlacementSpec: Parsing Spec: [spec]
18/01/26 23:05:46 ERROR distributedshell.Client: Error running Client
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.hadoop.yarn.applications.distributedshell.PlacementSpec.parse(PlacementSpec.java:85)
at
org.apache.hadoop.yarn.applications.distributedshell.Client.init(Client.java:431)
at
org.apache.hadoop.yarn.applications.distributedshell.Client.main(Client.java:248)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:239)
at org.apache.hadoop.util.RunJar.main(RunJar.java:153)
{code}
where the spec is a file which has the content copied from the document
"zk=3,NOTIN,NODE,zk:hbase=5,IN,RACK,zk"
> Merge work for YARN-6592
> ------------------------
>
> Key: YARN-7792
> URL: https://issues.apache.org/jira/browse/YARN-7792
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Sunil G
> Priority: Blocker
> Attachments: YARN-6592.001.patch, YARN-7792.002.patch,
> YARN-7792.003.patch
>
>
> This Jira is to run aggregated YARN-6592 branch patch against trunk and check
> for any jenkins issues.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
