FrontierPhysics Launches: 56 End-to-End Physics Tasks by 42 Physicists; Claude Opus 5.5 Tops ~27.4% Pass; Failures Center on Rigorous Reasoning
On November 5, the BenchFlow team publicly launched FrontierPhysics (arXiv:2611.06910): 56 end-to-end physics-research tasks authored by 42 physicists from their own work across nine domains. Agents must do literature review, planning, research/experiments, deterministic artifacts, and a manuscript. Across 22 models in 26 configurations, no setup passed more than 46 of 168 rollouts; the best reported Pass@1 is about 27.4% for Claude Opus 5.5 in Claude Code. Expert trajectory review finds the main gaps are rigorous reasoning and expert intuition, not missing physics facts. Artificial Analysis said it will partner to host the evaluation.

Key Takeaways
- Scale: 56 tasks by 42 authors at 26 institutions across 9 physics domains; 56 accepted from 182 submissions; 18 based on published papers (including 4 Nature)
- Grading: deterministic verifiers plus expert rubrics (blockers/non-blockers); a pass needs all verifiers and blockers
- Results: 22 models / 26 configs; no configuration passed more than 46 of 168 rollouts; best Pass@1 ~27.4% for Claude Opus 5.5 in Claude Code (paper)
- Failures: rigorous reasoning ~48%, expert intuition ~34%, literature synthesis ~27%; missing physics knowledge is not the main cause (manual audit of GPT-6 Astra)
- Ecosystem: run via BenchFlow; Artificial Analysis will partner to host; paper arXiv:2611.06910








