andygrove commented on PR #2614: URL: https://github.com/apache/datafusion-comet/pull/2614#issuecomment-3432567391
@mbutrovich @comphead Thanks for the reviews so far. CometFuzz is still quite experimental/hacky, but this PR expands coverage of tested functions and reduces the number of invalid queries generated now that we have signatures, so it seems worth merging in my opinion. It would be better to automate the discovery of function signatures rather than hand-code them. I filed https://github.com/apache/datafusion-comet/issues/2627 to explore this. Here are stats from a recent run of this version: ``` Total queries: 853; Invalid queries: 317; Comet failed: 3; Comet succeeded: 533 ``` So far, this version of CometFuzz has found three correctness issues: - https://github.com/apache/datafusion-comet/issues/2624 - https://github.com/apache/datafusion-comet/issues/2621 - https://github.com/apache/datafusion-comet/issues/2626 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
