Marius Petria created SLING-3968:
------------------------------------

             Summary: Define replication strategy for big number of replication 
requests
                 Key: SLING-3968
                 URL: https://issues.apache.org/jira/browse/SLING-3968
             Project: Sling
          Issue Type: Improvement
          Components: Replication
            Reporter: Marius Petria


An extreme case for replication is the replication of many paths (millions of 
paths). This typically arrises when one wants to replicates only a fraction of 
a big tree but this fraction still has a lot of nodes.  This issue is 
complementary to SLING-3967.

We should have a strategy that can cope with big number of requests.

Options:
- batch the requests (put 1000 requests in one package) - cannot put too many 
as it might hit the limit of the vlt package filtering
- 1-10 million nodes grouped in batches of 1000 still leads to 1-10K packages 
which might put a lot of pressure on the queues. Maybe we can define a better 
strategy to group the requests.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to