Aside: I have been building a self-hosted AI code review system that I
think does a better job of finding bugs in PRs than Copilot does:
https://www.roborev.io/. You can install and try it locally to compare
its reviews with Copilot side-by-side (I recommend using codex +
gpt-5.5 for reviews).

It might be tricky to get Infra to create a GitHub application
(https://www.roborev.io/integrations/github/), but it could be worth a
try. Reviews generally cost $0.20 - $2 (depending on the size of the
change) if you are paying API rates for GPT-5.5, it might not be a bad
use of sponsorship funds.

On Mon, May 25, 2026 at 4:35 PM Sutou Kouhei <[email protected]> wrote:
>
> Hi,
>
> In apache/arrow, we don't have enough PR review resources
> for now. GitHub Copilot review may help this
> situation. GitHub Copilot and a PR author may fix trivial
> problems before human reviews.
>
> I'm trying GitHub Copilot review recently for this
> propose. For example:
> https://github.com/apache/arrow/pull/49813
>
> I start GitHub Copilot review manually for now. I received a
> feedback that the following workflow bothers a PR author:
>
> 1. PR author pushes
> 2. I trigger GitHub Copilot review half a day later because
>    of timezone difference
> 3. PR author addresses review comments
> 4. 2.
> 5. 3.
> 6. ...
>
> https://github.com/apache/arrow/pull/49813#discussion_r3289753445
>
> I thought that I may be able to improve this workflow by
> automating the 2. step.
>
>
> Recently, .asf.yaml added support for GitHub Copilot
> configuration:
>
> * https://github.com/apache/infrastructure-asfyaml/pull/89
> * https://github.com/apache/infrastructure-asfyaml#copilot_code_review
>
>
> So I've enabled auto GitHub Copilot review:
>
> https://github.com/apache/arrow/pull/50023
>
> It may help us or bother us. Could you share your insights
> with GitHub Copilot review? I want to reduce maintenance
> cost.
>
> FYI: Here are some feedback from Alenka:
> https://github.com/apache/arrow/pull/50023#issuecomment-4535261566
>
> We may improve GitHub Copilot auto review by adding custom
> instructions:
> https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/add-custom-instructions/add-repository-instructions
>
>
> Thanks,
> --
> kou

Reply via email to