ywcb00 opened a new pull request #1521: URL: https://github.com/apache/systemds/pull/1521
Hi, this PR introduces the _FederatedReadCache_ for the federated worker. The _FederatedReadCache_ is basically a map that maps from filename to a data object. In order to allow and optimize for concurrent READ_VAR requests on the federated site, the data object is wrapped inside a placeholder (_ReadCacheEntry_) so that only one thread reads the object from fs while the other threads wait for the data to be placed inside the placeholder. In addition, this PR enables multithreaded processing of requests at the federated worker with a maximal threadpool size of 4 times the number of cpu processors. Thanks for review :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
