[
https://issues.apache.org/jira/browse/KNOX-88?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maksim Kononenko updated KNOX-88:
---------------------------------
Attachment: KNOX-88_initial_patch_with_not_complete_functionality.patch
Remained issues:
1) HaProcessor initialization during every Knox start with information about HA
services and information about HA configuration, like failover strategy, retry
count, etc.;
2) HaFilter - in doFilter need to add code for rewriting request's URL with new
after failover;
3) HaFilter - in doFilter need to analyze whether need to wrap request,
response for resending request after failover;
4) WebHdfsServiceHaProcessor.isHaSupported
need to verify whether post request to DataNode is passed in this method. Ff
yes - then reject - HA should be supported just for NameNode requests.
5) DefaultHaProcessor.handleResult - add logic for analyzing response,
exception for triggering failover.
Each missing point I commented with TODO in the code.
Ha provider configuration in topology.xml:
<provider>
<role>ha</role>
<name>Default</name>
<enabled>true</enabled>
<param><name>WEBHDFS.ha</name><value>retryCount=3;failoverStrategy=RoundRobin</value></param>
</provider>
Service section:
<service>
<role>WEBHDFS</role>
<url>http://localhost1:50070/webhdfs</url>
<url>http://localhost2:50070/webhdfs</url>
</service>
> Support HDFS HA
> ---------------
>
> Key: KNOX-88
> URL: https://issues.apache.org/jira/browse/KNOX-88
> Project: Apache Knox
> Issue Type: Improvement
> Components: Server
> Affects Versions: 0.2.0
> Reporter: Kevin Minder
> Fix For: 0.5.0
>
> Attachments:
> KNOX-88_initial_patch_with_not_complete_functionality.patch, KNOX_HA.docx
>
>
> In Hadoop 2 DFS client will retry the calls to the various nodes configured
> to be part of namenode HA. Thought needs to be given to if this should be
> supported in the gateway or on the client. In addition if this is supported
> in the gateway there needs to be though given to a one-off HDFS mechanism vs
> a generic gateway capability.
> Design wiki:
> https://cwiki.apache.org/confluence/display/KNOX/KNOX-88:+Support+HDFS+HA
--
This message was sent by Atlassian JIRA
(v6.2#6252)
