[ https://issues.apache.org/jira/browse/TWILL-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633305#comment-16633305 ]
Hongyuan Li commented on TWILL-262: ----------------------------------- seems other errorss follows. 2018-09-30T10:35:37,439Z ERROR o.a.t.i.y.AbstractYarnTwillService [node3] [message-callback] AbstractYarnTwillService:handleSecureStoreUpdate(AbstractYarnTwillService.java:110) - Failed to update secure store. java.lang.NoSuchMethodError: org.apache.hadoop.hdfs.HAUtil.cloneDelegationTokenForLogicalUri(Lorg/apache/hadoop/security/UserGroupInformation;Ljava/net/URI;Ljava/util/Collection;)V at org.apache.twill.internal.yarn.YarnUtils.cloneHaNnCredentials(YarnUtils.java:222) at org.apache.twill.internal.yarn.AbstractYarnTwillService.handleSecureStoreUpdate(AbstractYarnTwillService.java:104) at org.apache.twill.internal.container.TwillContainerService.onReceived(TwillContainerService.java:107) at org.apache.twill.internal.AbstractTwillService.handleMessage(AbstractTwillService.java:333) at org.apache.twill.internal.AbstractTwillService.access$900(AbstractTwillService.java:85) at org.apache.twill.internal.AbstractTwillService$4.onSuccess(AbstractTwillService.java:284) at org.apache.twill.internal.AbstractTwillService$4.onSuccess(AbstractTwillService.java:264) at com.google.common.util.concurrent.Futures$6.run(Futures.java:799) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) > YarnUtils#cloneHaNnCredentials uses DFSUtil#getHaNnRpcAddresses, which is > removed from DFSUtils from hadoop-2.8 > ---------------------------------------------------------------------------------------------------------------- > > Key: TWILL-262 > URL: https://issues.apache.org/jira/browse/TWILL-262 > Project: Apache Twill > Issue Type: Bug > Components: yarn > Affects Versions: 0.8.0, 0.9.0, 0.11.0, 0.12.0, 0.13.0 > Reporter: Hongyuan Li > Priority: Major > Attachments: errors.txt > > > YarnUtils#cloneHaNnCredentials uses DFSUtil#getHaNnRpcAddresses, which is > removed from DFSUtils from hadoop-2.8 > current code > {code} > public static void cloneHaNnCredentials(Configuration config) throws > IOException { > …… > // Loop through all name services. Each name service could have multiple > name node associated with it. > for (Map.Entry<String, Map<String, InetSocketAddress>> entry : > DFSUtil.getHaNnRpcAddresses(config).entrySet()) { > String nsId = entry.getKey(); > Map<String, InetSocketAddress> addressesInNN = entry.getValue(); > if (!HAUtil.isHAEnabled(config, nsId) || addressesInNN == null || > addressesInNN.isEmpty()) { > continue; > } > …… > } > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)