[ 
https://issues.apache.org/jira/browse/FALCON-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286986#comment-14286986
 ] 

Pallavi Rao commented on FALCON-1004:
-------------------------------------

it is most likely that the configuration store initialization takes the 
longest. The reason for that is that all the configuration files stored on HFDS 
files are read and an in memory data structure is populated. With increased 
number of entities, it is bound to take longer to read files serially. Two 
possible ways to solve it:
1. Short term - Read the files and load the config in parallel, rather than 
sequentially.
2. Long term - Choose a config store that is better optimized for 
lookups/updates.

> Prism server takes longer to start with increased number of entities
> --------------------------------------------------------------------
>
>                 Key: FALCON-1004
>                 URL: https://issues.apache.org/jira/browse/FALCON-1004
>             Project: Falcon
>          Issue Type: Bug
>            Reporter: Pallavi Rao
>            Assignee: Pallavi Rao
>
> What was reported by InMobi Ops team - "With increase in feeds and process, 
> the prism start time is taking long.
> We need to improve on prism start time, as with cluster update, or prism 
> bounce the wait time it increasing, before we start using the services. we 
> have 2K+ Feeds, and 400+ Process as of now, and prism takes around 25mins to 
> start the service."



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to