[ 
https://issues.apache.org/jira/browse/HBASE-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067661#comment-15067661
 ] 

Ashish Singhi commented on HBASE-14938:
---------------------------------------

I am planning to add a new configuration 
{{hbase.replication.max.znodes.per.request}} which will control the number of 
znodes we send for create/delete to ZK in a single request default being 5000.
For now we do not have any control on the number of znodes we can request from 
ZK in one request. There is a open jira in ZK(ZOOKEEPER-2260) and work is in 
progress, once that is complete we can control this part also, I will just add 
a TODO for this.

Any concern with above approach or do you have any other thoughts ?

> Limit to and fro requests size from ZK in bulk loaded hfile replication
> -----------------------------------------------------------------------
>
>                 Key: HBASE-14938
>                 URL: https://issues.apache.org/jira/browse/HBASE-14938
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Ashish Singhi
>            Assignee: Ashish Singhi
>
> In ZK the maximum allowable size of the data array is 1 MB. Until we have 
> fixed HBASE-10295 we need to handle this.
> Approach to this problem will be discussed in the comments section.
> Note: We have done internal testing with more than 3k nodes in ZK yet to be 
> replicated.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to