@ArtificialAnlys evaluated StepFun Step 5 Preview (600B-total / 27B-active MoE): Artificial Analysis Intelligence Index 44, matching Kimi K3 (max) at about $0.72 per Index task (~2.8x cheaper). Pricing is about $1/$2.70 per 1M input/output tokens with $0.05/M cached input; 1M context; open weights planned for October 15. It still lags peers on agentic evals such as GDPval-AA and Terminal-Bench 4.0.
Key Takeaways
- ✓AA Intelligence Index 44, tied with Kimi K3 (max); ~$0.72/task (~2.8x cheaper).
- ✓Pricing ~$1/$2.70 per 1M in/out with $0.05/M cached input; 600B/27B MoE; 1M context.
- ✓Open weights planned Oct 15; still trails peers on GDPval-AA and Terminal-Bench 4.0.

Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.