Robert Joseph Evans created STORM-882:
-----------------------------------------

             Summary: Dist Cache: Have HDFS blob store download starting at a 
random block
                 Key: STORM-882
                 URL: https://issues.apache.org/jira/browse/STORM-882
             Project: Apache Storm
          Issue Type: Improvement
            Reporter: Robert Joseph Evans


To reduce the possibility of overloading a datanode when downloading large dist 
cache items we should start downloading the blob at a random block, and then 
loop back to the beginning of the file to finish.  STORM-881 provides 
randomizing the order of the files downloaded, but on an update of a large blob 
this may become important.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to