Release10d ago
Apple ships 27.2 updates: Siri AI adds French, Japanese, Korean, Portuguese and Spanish, and can now recall past conversations
On Oct 26 Apple released iOS, iPadOS, macOS, watchOS and visionOS 27.2, and Siri AI (beta), the assistant rebuilt on Apple Intelligence, now supports French, Japanese, Korean, Portuguese and Spanish in addition to English. Apple says Traditional Chinese, Norwegian, Turkish and Vietnamese will follow by the end of the year. Per the iOS 27.2 release notes, Siri AI can now recall past conversations and draw on more sources such as photos in Messages, Calendar attendees and voicemails. Siri AI is still unavailable in the EU on iOS, iPadOS and watchOS and in mainland China, and server-side features have daily usage limits; Apple says expanded access will be offered for a fee in the future.
Benchmark15d ago
FrontierRefactor Introduces First Code Performance Benchmark: 41% of Agent Patches Pass Tests with Zero Gain or Regressions
Published in arXiv:2610.25834, FrontierRefactor establishes the industry's first evaluation benchmark targeting autonomous coding agents on multi-scale, performance-oriented codebase refactoring. Unlike traditional benchmarks like SWE-bench that measure only functional pass rates, FrontierRefactor spans seven programming languages and 60 Amdahl-qualified tasks ranging from kernels to full repositories (10^1 to 10^4+ LOC). Initial evaluations reveal that over 41% of agent patches pass functional equivalence suites yet yield zero verified speedup—with 19.3% triggering severe runtime performance regressions, highlighting the vital need for multi-turn profiling feedback.
Benchmark38d ago
WideSWE: First Multi-Repository Benchmark for Coding Agents Spans 103 Ecosystems, Top Success Capped at 42.5%
Addressing the fundamental limitation of benchmarks like SWE-bench that assess coding agents strictly within isolated repositories, researchers from Zhejiang University introduced WideSWE. Mining changes across 103 real-world software ecosystems, WideSWE establishes 120 cross-repository tasks (balanced between 60 bug fixes and 60 feature developments) with comprehensive regression test suites. Across seven frontier agent configurations, full task success tops out at just 42.50%, exposing systemic failures in cross-repo dependency tracking and coordinated verification.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.