[
https://issues.apache.org/jira/browse/TWILL-262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633305#comment-16633305
]
Hongyuan Li commented on TWILL-262:
-----------------------------------
seems other errorss follows.
2018-09-30T10:35:37,439Z ERROR o.a.t.i.y.AbstractYarnTwillService [node3]
[message-callback]
AbstractYarnTwillService:handleSecureStoreUpdate(AbstractYarnTwillService.java:110)
- Failed to update secure store.
java.lang.NoSuchMethodError:
org.apache.hadoop.hdfs.HAUtil.cloneDelegationTokenForLogicalUri(Lorg/apache/hadoop/security/UserGroupInformation;Ljava/net/URI;Ljava/util/Collection;)V
at
org.apache.twill.internal.yarn.YarnUtils.cloneHaNnCredentials(YarnUtils.java:222)
at
org.apache.twill.internal.yarn.AbstractYarnTwillService.handleSecureStoreUpdate(AbstractYarnTwillService.java:104)
at
org.apache.twill.internal.container.TwillContainerService.onReceived(TwillContainerService.java:107)
at
org.apache.twill.internal.AbstractTwillService.handleMessage(AbstractTwillService.java:333)
at
org.apache.twill.internal.AbstractTwillService.access$900(AbstractTwillService.java:85)
at
org.apache.twill.internal.AbstractTwillService$4.onSuccess(AbstractTwillService.java:284)
at
org.apache.twill.internal.AbstractTwillService$4.onSuccess(AbstractTwillService.java:264)
at com.google.common.util.concurrent.Futures$6.run(Futures.java:799)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
> YarnUtils#cloneHaNnCredentials uses DFSUtil#getHaNnRpcAddresses, which is
> removed from DFSUtils from hadoop-2.8
> ----------------------------------------------------------------------------------------------------------------
>
> Key: TWILL-262
> URL: https://issues.apache.org/jira/browse/TWILL-262
> Project: Apache Twill
> Issue Type: Bug
> Components: yarn
> Affects Versions: 0.8.0, 0.9.0, 0.11.0, 0.12.0, 0.13.0
> Reporter: Hongyuan Li
> Priority: Major
> Attachments: errors.txt
>
>
> YarnUtils#cloneHaNnCredentials uses DFSUtil#getHaNnRpcAddresses, which is
> removed from DFSUtils from hadoop-2.8
> current code
> {code}
> public static void cloneHaNnCredentials(Configuration config) throws
> IOException {
> ……
> // Loop through all name services. Each name service could have multiple
> name node associated with it.
> for (Map.Entry<String, Map<String, InetSocketAddress>> entry :
> DFSUtil.getHaNnRpcAddresses(config).entrySet()) {
> String nsId = entry.getKey();
> Map<String, InetSocketAddress> addressesInNN = entry.getValue();
> if (!HAUtil.isHAEnabled(config, nsId) || addressesInNN == null ||
> addressesInNN.isEmpty()) {
> continue;
> }
> ……
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
