johnyangk opened a new pull request #113: [NEMO-15] Run Spark ALS in distributed mode URL: https://github.com/apache/incubator-nemo/pull/113 JIRA: [NEMO-15: Run Spark ALS in distributed mode](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-15) **Major changes:** - Removes 'sideinput' from IRDAG, and instead introduces BroadcastVariableProperty - InMasterBroadcastVariables/BroadcastManagerWorker: Components that deal with broadcast variables - New RPC messages for exchanging broadcast variables between client->driver, and driver<->executor **Minor changes to note:** - Explicit scala lambdas (update_ms, update_us) to get around serialization errors **Tests for the changes:** - SparkScala#testALS **Other comments:** - This PR also closes: [NEMO-14] Re-investigate Broadcast and SideInputs Closes #GITHUB_PR_NUMBER
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
