star created RANGER-2658:
----------------------------

             Summary: Support million policies in ranger.
                 Key: RANGER-2658
                 URL: https://issues.apache.org/jira/browse/RANGER-2658
             Project: Ranger
          Issue Type: Improvement
          Components: Ranger
    Affects Versions: 1.2.0
            Reporter: star
            Assignee: star


We have nearly a million policies in Tencent. We found many problems by 
deploying ranger(1.2.0) in such a large scale. It seems that ranger is 
originally not designed to support large scale policies.

If we would like to support a million policies, the following issues should be 
emphasized.

   1. Policy import is very slow. It takes us a couple of days to import those 
policies .

   2. It takes a long time (more than 10s) to search policies by name or 
user/group in ranger admin. Because it directly go through all policies in 
cache instead of search from index of database.

   3. It will consume 8GB memory in user process. 

Above problems are relieved in 2.x, but it is not enough.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to