[
https://issues.apache.org/jira/browse/YARN-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020698#comment-17020698
]
Mingliang Liu commented on YARN-9768:
-------------------------------------
I saw errors like this on {{trunk}} branch:
{quote}
$ mvn clean package -DskipTests -q
Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
Maven home: /usr/local/Cellar/maven/3.6.3/libexec
Java version: 1.8.0_162, vendor: Oracle Corporation, runtime:
/Library/Java/JavaVirtualMachines/jdk1.8.0_162.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.15.2", arch: "x86_64", family: "mac"
[ERROR] COMPILATION ERROR :
[ERROR]
/Users/mingliang.liu/Workspace/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewer.java:[1675,7]
cannot find symbol
symbol: method
submitApp(int,java.lang.String,java.lang.String,java.util.HashMap<org.apache.hadoop.yarn.api.records.ApplicationAccessType,java.lang.String>,boolean,java.lang.String,int,org.apache.hadoop.security.Credentials)
location: variable rm of type
org.apache.hadoop.yarn.server.resourcemanager.MockRM
[ERROR]
/Users/mingliang.liu/Workspace/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewer.java:[1741,7]
cannot find symbol
symbol: method
submitApp(int,java.lang.String,java.lang.String,java.util.HashMap<org.apache.hadoop.yarn.api.records.ApplicationAccessType,java.lang.String>,boolean,java.lang.String,int,org.apache.hadoop.security.Credentials)
location: variable rm of type
org.apache.hadoop.yarn.server.resourcemanager.MockRM
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project hadoop-yarn-server-resourcemanager:
Compilation failure: Compilation failure:
[ERROR]
/Users/mingliang.liu/Workspace/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewer.java:[1675,7]
cannot find symbol
[ERROR] symbol: method
submitApp(int,java.lang.String,java.lang.String,java.util.HashMap<org.apache.hadoop.yarn.api.records.ApplicationAccessType,java.lang.String>,boolean,java.lang.String,int,org.apache.hadoop.security.Credentials)
[ERROR] location: variable rm of type
org.apache.hadoop.yarn.server.resourcemanager.MockRM
[ERROR]
/Users/mingliang.liu/Workspace/apache/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewer.java:[1741,7]
cannot find symbol
[ERROR] symbol: method
submitApp(int,java.lang.String,java.lang.String,java.util.HashMap<org.apache.hadoop.yarn.api.records.ApplicationAccessType,java.lang.String>,boolean,java.lang.String,int,org.apache.hadoop.security.Credentials)
[ERROR] location: variable rm of type
org.apache.hadoop.yarn.server.resourcemanager.MockRM
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :hadoop-yarn-server-resourcemanager
{quote}
Is this broken by this commit? [~elgoiri] and [[email protected]] Thanks
> RM Renew Delegation token thread should timeout and retry
> ---------------------------------------------------------
>
> Key: YARN-9768
> URL: https://issues.apache.org/jira/browse/YARN-9768
> Project: Hadoop YARN
> Issue Type: Improvement
> Reporter: CR Hota
> Assignee: Manikandan R
> Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-9768.001.patch, YARN-9768.002.patch,
> YARN-9768.003.patch, YARN-9768.004.patch, YARN-9768.005.patch,
> YARN-9768.006.patch, YARN-9768.007.patch, YARN-9768.008.patch
>
>
> Delegation token renewer thread in RM (DelegationTokenRenewer.java) renews
> HDFS tokens received to check for validity and expiration time.
> This call is made to an underlying HDFS NN or Router Node (which has exact
> APIs as HDFS NN). If one of the nodes is bad and the renew call is stuck the
> thread remains stuck indefinitely. The thread should ideally timeout the
> renewToken and retry from the client's perspective.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
