This is an automated email from the ASF dual-hosted git repository.
wylee pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-nemo.git.
from 6bdf2db [Nemo-794] Add SparkSQL Examples and Integration Tests. (#795)
add a7721ac [NEMO-787] Pack Block Location Request Messaging (#796)
add a887423 [Minor] Correct default path for executor configuration (#797)
add ee830d5 [Nemo-772] Reuse Duplicate data (#790)
No new revisions were added by this update.
Summary of changes:
...operty.java => DuplicateEdgeGroupProperty.java} | 20 +-
.../DuplicateEdgeGroupPropertyValue.java | 99 ++++
.../ir/executionproperty/ExecutionProperty.java | 1 +
.../edu/snu/nemo/common/ir/vertex/LoopVertex.java | 14 +
.../edu/snu/nemo/common/test/ExampleTestUtil.java | 50 ++
.../nemo/compiler/frontend/spark/sql/Dataset.java | 12 +-
.../compiler/frontend/spark/sql/SparkSession.java | 16 +-
.../annotating/DuplicateEdgeGroupSizePass.java | 66 +++
.../composite/LoopOptimizationCompositePass.java | 4 +-
.../compiletime/reshaping/LoopUnrollingPass.java | 1 +
conf/src/main/java/edu/snu/nemo/conf/JobConf.java | 2 +-
.../nemo/examples/beam/AlternatingLeastSquare.java | 25 +-
.../beam/AlternatingLeastSquareITCase.java | 35 +-
examples/resources/test_output_als | 627 +++++++++++++++++++++
.../edu/snu/nemo/examples/spark/SparkITCase.java | 15 +-
.../plan/physical/PhysicalPlanGenerator.java | 35 ++
.../runtime/executor/data/BlockManagerWorker.java | 46 +-
.../runtime/executor/datatransfer/InputReader.java | 23 +-
.../executor/datatransfer/OutputWriter.java | 17 +-
.../nemo/runtime/master/BlockManagerMaster.java | 143 +++--
.../edu/snu/nemo/runtime/master/BlockMetadata.java | 27 +-
.../optimizer/policy/PolicyBuilderTest.java | 6 +-
.../executor/datatransfer/DataTransferTest.java | 181 ++++++
.../runtime/master/BlockManagerMasterTest.java | 31 +-
24 files changed, 1355 insertions(+), 141 deletions(-)
copy
common/src/main/java/edu/snu/nemo/common/ir/edge/executionproperty/{MetricCollectionProperty.java
=> DuplicateEdgeGroupProperty.java} (66%)
create mode 100644
common/src/main/java/edu/snu/nemo/common/ir/edge/executionproperty/DuplicateEdgeGroupPropertyValue.java
create mode 100644
compiler/optimizer/src/main/java/edu/snu/nemo/compiler/optimizer/pass/compiletime/annotating/DuplicateEdgeGroupSizePass.java
create mode 100644 examples/resources/test_output_als
--
To stop receiving notification emails like this one, please contact
[email protected].
