Baunsgaard commented on PR #1880:
URL: https://github.com/apache/systemds/pull/1880#issuecomment-1680368747
With better IO start, isolated dictionary writing, slicing of sub rows
inside writing tasks, and single pass update and encoding.
```txt
Serialize Repetitions: 1000 ConstMatrix ( Rows:10000, Cols:100,
Spar:1.0, Unique: 4) threads: 16
Serialize, 3.555+- 0.115 ms, 2250210702+-
70104470 Byte/s, 2250170480+- 70103217 Byte/s
StandardDisk, 15.334+- 0.860 ms, 521730319+-
27725252 Byte/s, 521761883+- 27726929 Byte/s
Compress Normal, 6.664+- 2.232 ms, 1200494359+-
300677755 Byte/s, 106383388+- 26644955 Byte/s
Compress Normal Serialize, 5.912+- 0.698 ms, 1353258662+-
148101799 Byte/s, 119324868+- 13059017 Byte/s
Compress StandardIO, 8.020+- 0.658 ms, 997483498+-
73930038 Byte/s, 61658745+- 4483419 Byte/s
Update&Apply Scheme Fused, 1.965+- 0.049 ms, 4071051957+-
100537669 Byte/s, 233543671+- 5767535 Byte/s
Update&Apply Scheme Fused Serialize, 2.327+- 0.038 ms, 3438309852+-
56253829 Byte/s, 195731095+- 3202336 Byte/s
Update&Apply Standard IO, 3.823+- 0.148 ms, 2092482764+-
76584230 Byte/s, 57112163+- 3120851 Byte/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
