polarcoke2 opened a new pull request #292: [NEMO-434]Logical DAG modification for Dynamic sampling of task metrics during the execution of a stage URL: https://github.com/apache/incubator-nemo/pull/292 JIRA: [NEMO-434: Logical DAG modification for Dynamic sampling of task metrics during the execution of a stage](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-434) **Major changes:** - Added new mechanism for launching runtime pass - For runtime passes which need to gather information by itself, use MessageGeneratorVertex and MessageAggregatorVertex - For runtime passes which need Metric information, use SignalVertex - Added SignalVertex and SignalTransform to launch runtime pass without collecting any runtime information - New Compile time pass for DTS which changes DAG - New TaskSizeSplitterVertex to distinguish and manage sampled data and the rest in vertex level(extended from LoopVertex) - Added inserting TaskSizeSplitterVertex method in IRDAG **Minor changes to note:** - Changed the name of TriggerVertex to MessageGeneratorVertex. Since the combination of TriggerVertex and MAV triggers runtime pass, not trigger vertex alone, the name 'Trigger' can be misleading. - erased duplicate assignments in EmptyComponents class - new methods in LoopVertex **Tests for the changes:** - IRDAGTest and SkewCompositePassTest has been modified by the class name refactoring **Other comments:** - SamplingTaskSizingPass.java contains methods that are not supported in Java8. Therefore, this PR needs to be merged after #291 is merged in master Closes #GITHUB_PR_NUMBER
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
