Baunsgaard opened a new pull request #1166: URL: https://github.com/apache/systemds/pull/1166
This addition allows taking an overlapping matrix, and collapsing it into a compressed matrix. Initial experiments show promise, but it is still a little expensive. The key observation in this collapsed representation is that individual columns in the output have values that compress very nicely in lossy compression for individual columns, since each column after a matrix multiplication have values that are in the same ranges. This makes it possible to maintain the values to a 99% same values, while compressing using our 8 bit lossy maps. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
