tobiasrieger opened a new pull request #1131:
URL: https://github.com/apache/systemds/pull/1131
This PR includes the closed PR #1113 and all changes proposed in its
comments. It was rebased on master and consolidated to make it easier to merge
Changes list:
- Added four new federated data partitioning schemes
- ShuffleFederatedScheme
- SubsampleToMinFederatedScheme
- BalanceToAvgFederatedScheme
- ReplicateToMaxFederatedScheme
- Added runtime balancing parameter to parameter server (has a default
parameter and is optional for the federated case)
- Different runtime balancing schemes
- RUN_MIN
- CYCLE_AVG
- CYCLE_MAX
- Simplified the federated control thread to accommodate the coming N-batch
frequency
- There is now only one UDF, which computes a given number of batches.
If more batches than the local epoch are specified it will cycle. This one
function is sufficient for batch, N-Batch or Epoch Frequencies.
- Provided a convenient way to create federated test matrices in the
Automated Test Base
- .getFedMapping() of FederationMap was refactored to getFRangeFDataMap to
avoid confusion with the method of MatrixObject with the same name.
- Updated and improved CNN.dml and TwoNN.dml scripts
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
