Release31d ago
GitHub open-sources ReviewBench, a 219-PR benchmark for AI code review: Copilot, Devin and Qodo lead; Cursor's grounded recall is 9.6%
GitHub's blog post ReviewBench (Oct 5, 2026) launches an offline AI code-review benchmark as a research preview. It has 219 PRs from 187 open-source repos in 19 languages, sampled to match the distribution of 103.9M GitHub PRs. The golden set combines human reviewers, several frontier LLMs and static analysis. Claude Sonnet 5 is the judge, and senior engineers agreed with its labels 96.6% of the time. On the leaderboard, grounded recall is 26.0% for Copilot Code Review (Balanced), 23.8% for Devin, 22.1% for Qodo and 9.6% for Cursor. The dataset, judge prompt and runner are MIT-licensed on GitHub.
Release8d ago
Microsoft FY27 Q1: Azure growth accelerates to 48%, Foundry revenue more than triples, and Agent 365 now governs 50M agents
On Oct 28, Microsoft reported results for its fiscal Q1 2027, the quarter ended Sep 30: revenue of $92.3B (+19%), Microsoft Cloud revenue of $63.9B (+30%), Azure growth accelerating from 42% last quarter to 48%, and commercial remaining performance obligation of $677B (+73%). CEO Satya Nadella added AI figures on X: Foundry revenue more than tripled year over year, revenue from open source models grew 10x, Copilot daily users grew nearly 50% quarter over quarter, and Agent 365 now holds over 50M agents. Separately, TechCrunch, citing Microsoft's regulatory filing, reports $10B of revenue from OpenAI-related commercial arrangements this quarter.
Tooling9d ago
GitHub Octoverse 2026: agents start over 40% of pull requests, pushes hit 17.9 billion, and Copilot users tapped 47 models
On Oct 28 GitHub published its Octoverse 2026 report: developers pushed code 17.9 billion times in the past 12 months, more than 2024 and 2025 combined, with 34.3 billion commits and 1.3 billion merged pull requests (3.5 million a day). By September more than 40% of pull requests started with an agent draft, up from 17% in March; 55% of Copilot monthly active users use agentic features, and paid Copilot users used 47 distinct models in September.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.