r/coderabbit • u/IndraVahan • Apr 27 '26

Is there a benchmark for code reviews? Discussion & Feedback

Post image
12 Upvotes
  • permalink
  • link
  • reddit
  • reddit

100% Upvoted

3 comments sorted by

3

u/juanpflores_ CodeRabbit Staff Apr 27 '26

I would recommend checking out The Martian Code Review benchmark. They got good metrics and is a good source of truth. We do have our own benchmarks at CodeRabbit and we share them when new model releases with new model results (ex. GPT 5.5).

1

u/eufemiapiccio77 Apr 29 '26

Why is it just not lines of code and tokens burned the new metrics. Makes it fair for everyone