Baunsgaard commented on PR #1880:
URL: https://github.com/apache/systemds/pull/1880#issuecomment-1682404319
And now with single threaded execution fixes, we can report these values as
well, futhermore the values now also correctly indicate how much is written to
disk a sec.
Single thread:
669MiB a sec compressed writing
```txt
Serialize Repetitions: 1500 ConstMatrix ( Rows:10000, Cols:100,
Spar:1.0, Unique: 4) threads: 1
Serialize, 4.085+- 0.066 ms, 1958553044+-
31007119 Byte/s, 1958518036+- 31006564 Byte/s
StandardDisk, 16.699+- 0.741 ms, 479074510+-
20665474 Byte/s, 491385354+- 21196518 Byte/s
Compress Normal, 18.321+- 0.214 ms, 436663603+-
5002905 Byte/s, 38695520+- 443339 Byte/s
Compress Normal Serialize, 18.481+- 0.173 ms, 432879634+-
3966299 Byte/s, 38169573+- 349732 Byte/s
Compress StandardIO, 23.159+- 0.234 ms, 345447203+-
3439765 Byte/s, 30803115+- 306720 Byte/s
Update&Apply Scheme Fused, 9.887+- 0.401 ms, 809155714+-
33166438 Byte/s, 46418763+- 1902656 Byte/s
Update&Apply Scheme Fused Serialize, 10.837+- 0.206 ms, 738199877+-
14382973 Byte/s, 42023167+- 818773 Byte/s
Update&Apply Standard IO, 11.953+- 0.521 ms, 669319430+-
29564362 Byte/s, 38764906+- 1712276 Byte/s
```
Parallel: 2GiB a sec compressed writing. These results a a bit slower than
the last reported values because my computer was hot:
```txt
Serialize Repetitions: 1500 ConstMatrix ( Rows:10000, Cols:100,
Spar:1.0, Unique: 4) threads: 16
Serialize, 5.189+- 0.568 ms, 1541824285+-
155223818 Byte/s, 1541796726+- 155221043 Byte/s
StandardDisk, 18.312+- 0.992 ms, 436891339+-
23294883 Byte/s, 441838821+- 23558681 Byte/s
Compress Normal, 6.357+- 0.612 ms, 1258542122+-
118458337 Byte/s, 111527367+- 10497341 Byte/s
Compress Normal Serialize, 6.710+- 0.585 ms, 1192213605+-
99070533 Byte/s, 105124567+- 8735638 Byte/s
Compress StandardIO, 10.455+- 1.115 ms, 765215442+-
71066049 Byte/s, 67206398+- 6157964 Byte/s
Update&Apply Scheme Fused, 2.169+- 0.121 ms, 3689126824+-
215759110 Byte/s, 211633807+- 12377433 Byte/s
Update&Apply Scheme Fused Serialize, 2.590+- 0.084 ms, 3089128610+-
102204861 Byte/s, 175853414+- 5818169 Byte/s
Update&Apply Standard IO, 3.918+- 0.159 ms, 2042115006+-
77696920 Byte/s, 109587347+- 4860114 Byte/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
