Yogi Devendra created APEXMALHAR-2237:
-----------------------------------------

             Summary: Dynamic partitioning support for FSInputModule
                 Key: APEXMALHAR-2237
                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2237
             Project: Apache Apex Malhar
          Issue Type: Improvement
            Reporter: Yogi Devendra
            Assignee: Yogi Devendra


Currently, FSInputModule exposes readersCount property which is used for static 
partitioning of BlockReader.

To support dynamic partitioning, following additional properties will be 
exposed.
1. minReaders = minimum number of readers for dynamic partitioning.
2. maxReaders = maximum number of readers for dynamic partitioning.
3. repartitionCheckInterval = time in seconds for checking if repartition is 
required.

minReaders, maxReaders will set respective property on BlockReader.
repartitionCheckInterval will set intervalMillis property on BlockReader after 
converting from seconds to milliseconds. 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to