Abacn commented on PR #26893: URL: https://github.com/apache/beam/pull/26893#issuecomment-1563554627
It appears that read from SyntheticSource is still slower than read from ReShuffle service. For kafka xlang test: read from SyntheticSource (lcg) write_runtime Value: 403 s that is 6.7 min read from ReShuffle service, write_runtime is now < 5 min Unrelated but there is an improvement on May 13 where the run time for both write and read reduced significantly. Before that write time is 6.5 min <img width="716" alt="image" src="https://github.com/apache/beam/assets/8010435/27f24057-d48e-4891-8fdf-a2bcd2c2fdcf";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
