GitHub user Jefffrey created a discussion: Policy on uptick of LLM PRs from new contributors
I've been seeing cases where a first time contributor starts submitting multiple PRs at once, especially across a variety of components in the codebase. It leads me to believe people are getting LLMs to auto-create PRs from issues and are mass sending them, in some cases not even checking if there is already a PR linked to the issue. This gives low confidence that the PR author has actually reviewed and understood the changes, especially if they are creating PRs to other repos at the same time. I wonder if we should have a policy on how many open PRs a first time contributor should be allowed to have, similar to what polars has: https://docs.pola.rs/development/contributing/#first-time-contributions There was a recent discussion in the arrow mailing list, though its more about a setting to apply to all non-committers: https://lists.apache.org/thread/fsfply47z9rb6bz0x50b2whlhg6hnflr Though this reply from that mailing list is quite relevant: > A thing I've noticed is that an issue opened by a regular contributor with > the intent of immediately working on it will sometimes get a PR opened > against it within an hour or two. The newly opened PR will typically come > from a new contributor and is likely AI-generated GitHub link: https://github.com/apache/datafusion/discussions/24413 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
