Apoorv Naik created ATLAS-2444: ---------------------------------- Summary: HDFS NameNode Federation support Key: ATLAS-2444 URL: https://issues.apache.org/jira/browse/ATLAS-2444 Project: Atlas Issue Type: Bug Reporter: Apoorv Naik
With Hadoop 3, HDFS is introducing namespace/nameServiceId for data segregation. A cluster with hadoop 3 deployment can have multiple name nodes under a single name space and multiple namespace/nameserviceIds as well. This metadata can be captured for other interested application/parties, eg. Ranger can use this to enforce policies per Namespace. Changes: # HDFS model to include a new attribute called nameServiceId, default will be empty # hdfs path's qualified name will include the cluster info as well # All Hooks dealing with HDFS path will resolve the host:port to the respective nameServiceId -- This message was sent by Atlassian JIRA (v7.6.3#76005)