jeongyooneo opened a new pull request #72: [Nemo-59] Skewed data-aware executor 
allocation
URL: https://github.com/apache/incubator-nemo/pull/72
 
 
   JIRA: [NEMO-59: Skewed data-aware executor 
allocation](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-59)
   
   **Major changes:**
   - SkewnessAwareSchedulingProperty to mark vertices subject to skew handling
   - SkewnessAwareSchedulingConstraint that distribute partitions with skewed 
keys to different executors
   - HashRange with isSkewed value that marks the given HashRange as skewed
   
   **Minor changes to note:**
   - ExecutorRepresenter manages Task instead of Task ids, so that scheduling 
constraints can use running task-related information from executor
   
   **Tests for the changes:**
   - SkewnessAwareSchedulingConstraintTest for testing the scheduling constraint
   - Modified DataSkewCompositePassTest for testing 
SkewnessAwareSchedulingProperty
   
   **Other comments:**
   N/A
   
   resolves 
[NEMO-59](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-59)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to