0lai0 commented on PR #1462: URL: https://github.com/apache/mahout/pull/1462#issuecomment-5232318793
Thanks @viiccwen and @rich7420 Added beanch mark `make -C qdp bench_streaming_buffer` (before = frozen pre-change producer; after = shipped `StreamingProducer`) Buffer-only (refill chunk 65536), Xeon w3-2435, `--release`: | batch:chunk | before | after | speedup | |---|---|---|---| | 1:16 | 782 ns | 504 ns | 1.55x | | 1:4 | 3370 ns | 2480 ns | 1.36x | | 1:1 | 9668 ns | 9716 ns | 1.00x | | 4:1 | 54176 ns | 54469 ns | 0.99x | E2E via Parquet: ~1.01–1.02x (decode dominates). Win only when batch ≪ chunk; at 1:1+ both do the same work. Happy to reword the PR around #1436's O(1) advance / constant-capacity criteria rather than throughput -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
