ywcb00 commented on PR #2524: URL: https://github.com/apache/systemds/pull/2524#issuecomment-5088392983
Thank you @nirvanjhurreepriv. :) Compression should be applied to every matrix that is transferred over the network. In your example `Z = X %*% B`, assuming `B` is transferred to the federated workers, `B` should be compressed before transmission and decompressed directly after reception. If the result `Z` is then written to disk on the coordinator, and thus it gets pulled from the federated workers to the central coordinator, it should also be compressed in the same fashion. In short, whenever we transfer data between the federated workers and the coordinator (both directions), compression should be applied if enabled. I hope this clarifies your question and wish you all the best, David -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
