On Mon, 8 Dec 2025 at 23:15, Francesco Bonazzi <[email protected]> wrote: > > I fear that AI bots will start opening PRs soon (or maybe they are already > doing it). AI can impersonate human conversation pretty well. The purpose of > such bots is to use human feedback just to collect data.
I am actually getting emails roughly once a week right now from AI companies offering to pay me to review AI generated PRs but I have not replied to any of them. I don't think that we are seeing AI bots though. It is just humans using AI tools sometimes in a reasonable way but more often badly. We absolutely need to have a policy about this that insists that use of AI to write the code needs to be disclosed. A policy should clearly state that it is not acceptable to submit AI generated code if it is not code that you understand yourself and should explain why this is bad and what you should do instead. Regardless of whether the policy is enforceable I think people need to see a clear statement of what is a reasonable way of going about things. Honestly I don't blame people for thinking that having an AI just write all the code is the modern way with all the hype around this. Right now the majority of PRs opened are from people who have used some AI tool to write the code. They have trusted the code in deference to the AI's seemingly superior capabilities and knowledge and just launched it into a PR. The end result is that most PRs now are unchecked LLM output. It is a waste of time to review these as long as the author thinks that submitting unchecked LLM output is reasonable because any review comments are just typed into the LLM and the LLM even writes their comments in reply. If we were talking about this in the context of software developers working in a company together then I think that there could be all sorts of ways of managing this. In the context of an open source project having loads of people appearing from nowhere and spewing LLMs into PRs is unmanageable. -- Oscar -- You received this message because you are subscribed to the Google Groups "sympy" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/sympy/CAHVvXxSC4v8s0j7_DnY69mhyO4gpO-msQJpAuoCge3sKZksGwg%40mail.gmail.com.
