SEZ9 commented on issue #11598: URL: https://github.com/apache/seatunnel/issues/11598#issuecomment-5203022761
Thanks for the well-motivated proposal. Since this is a STIP, please ensure the design is also shared on the dev@ mailing list for broader visibility and consensus before implementation begins. Could you clarify the intended execution environment for benchmarks (dedicated hardware vs. GitHub Actions runners) and how run-to-run variance will be controlled? This strongly affects whether regression detection thresholds are reliable. Suggest defining the initial baseline (e.g., current 2.x Zeta release) and a small set of representative workloads (single-table, multi-table, checkpoint-heavy) as the first subtasks, so each 3.0 PR listed here can be measured against a stable reference. <!-- streview-comment:57 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
