jaehwan0214 opened a new pull request #299: URL: https://github.com/apache/incubator-nemo/pull/299
JIRA: [NEMO-392: Support combine in streaming] (https://issues.apache.org/jira/projects/NEMO/issues/NEMO-392) **Major changes:** - Added GBKStreamingTransform to support streaming processing for GroupByKey and Combine operation. - Each time an element arrives, GBKStreamingTransform invokes runner to process a single element and stores its state, instead of waiting to process it until the time to emit it to downstream. - Removed GroupByKeyAndWindowDoFnTransform since GBKStreamingTransform can perform both Combine.Perkey and GroupByKeyAndWindow operation. **Minor changes to note:** - N/A **Tests for the changes:** - Added GBKStreamingTransformTest to test the correctness of GBKStreamingTransform. - Modified GroupByKeyAndWindowDoFnTransformTest to test GBKStreamingTransform. **Other comments:** - Mostt of the work is done by TaeGun Um Closes #GITHUB_PR_NUMBER ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
