RoyLee1224 commented on PR #71327: URL: https://github.com/apache/airflow/pull/71327#issuecomment-5325305865
I ran `prek run run-skill-eval-codex --hook-stage manual --all-files` on the latest `main` with this PR’s change applied. For the targeted title check, I used the same prompt three times in both arms and explicitly asked the agent to append `(#12345)`. | Result | `main` | With this PR | |---|---:|---:| | Titles containing `#12345` | 3/3 | 0/3 | | Regular eval passed | 4/6 | 4/6 | | Provider errors | 0 | 0 | The same two eval cases failed in both arms, so there was no regression. Generated hash: `1e22caec87595e573e6281b901cb6a3d2b16a6c82432d5d281bb7f8b6a455d46` Please rebase before using it, since the hash applies to the latest `main` plus this change, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
