AI Coding Live News

Artificial Analysis: Tencent Hy4 Scores 35 on Intelligence Index v5, Ranked No.2 Among China Labs, 31% on FrontierCode 2.0

Independent evaluator Artificial Analysis published Tencent Hunyuan Hy4 results on the Intelligence Index v5 on November 5 (08:28 UTC): a composite score of 35, tying Grok 4.7 (xhigh) and one point behind Claude Haiku 5.5 (max). Among China-based labs it ranks second only to Kimi K3.1 Pro (46). On agentic coding it scores 31% on FrontierCode 2.0 and 37% on Terminal-Bench 4.0; cost per Intelligence Index task is about $0.78, roughly one-tenth of same-score Grok 4.7.

Artificial Analysis: Tencent Hy4 Scores 35 on Intelligence Index v5, Ranked No.2 Among China Labs, 31% on FrontierCode 2.0

Key Takeaways

  • Intelligence Index v5 composite 35: ties Grok 4.7 (xhigh), one point behind Haiku 5.5 (max, 36); No.2 China-lab model behind Kimi K3.1 Pro (46)
  • FrontierCode 2.0 at 31% (leads China labs; DeepSeek V4.1 Flash 1017 max 28%, Kimi K3.1 Pro 25%); Terminal-Bench 4.0 at 37%
  • AA-Omniscience v1.1 accuracy 50% but hallucination rate 89% (Kimi K3.1 Pro hallucination 37%); HLE-Diamond 33%
  • About $0.78 per Intelligence Index task: ~10x cheaper than same-score Grok 4.7, ~13x cheaper than Qwen3.8 Max (34), nearly 2x Haiku 5.5
  • Pricing about $0.834/$2.501 per 1M input/output tokens, cache reads $0.042; 1M context; text and image input
Read full story

RoboColosseum Opens Real-Robot Evaluation: 100+ Robots at 124 Sites, Claude Opus 5.5 and GPT-6 Astra Rival Specialized VLA Policies Zero-Shot

Hugging Face, BitRobot, the Singapore Embodied AI Centre, NUS and others launched RoboColosseum on November 4, a distributed real-robot evaluation framework covering four embodiments: SO-101, Franka, Bimanual-YAM and the Unitree G1 humanoid. The first study ran 5,699 blinded pairwise comparisons at 124 sites across 5 VLA policies and 3 frontier models. Claude Opus 5.5 and GPT-6 Astra beat their VLA counterparts on average task progress by 12.1 and 11.0 points, while Grok 4.7 trailed by 7.5. All rollouts are open on Hugging Face, and the project pledges 10,000 free evaluation hours to academic labs.

RoboColosseum Opens Real-Robot Evaluation: 100+ Robots at 124 Sites, Claude Opus 5.5 and GPT-6 Astra Rival Specialized VLA Policies Zero-Shot

Key Takeaways

  • Two tracks: the Open Track runs blinded zero-shot pairwise comparisons, and the Fine-tune Track gives each VLA the same 100 demonstrations per task across 20 tasks.
  • The VLAs tested are GR00T N1.7, pi0.5, MolmoAct2, G0.5 and LingBot-VLA v2; the frontier models are GPT-6 Astra, Claude Opus 5.5 and Grok 4.7.
  • After fine-tuning, GR00T N1.7 leads on SO-101 and pi0.5 leads on Franka and Bimanual-YAM; on the G1 humanoid no policy completes any task, with average progress of 13.3% to 23.2%.
  • Rankings agree only weakly across robots (Kendall W = 0.24), and zero-shot rankings poorly predict rankings after fine-tuning.
Read full story

X Discussion: Grok Bot Engineer poteto Calls Adversarial Agent Code Reviews "Mostly a Waste of Tokens" and Argues for Empirical Plus Formal Verification Instead

On November 3, @poteto (lauren), whose bio says she works on Grok @bot at SpaceXSI, is on the React Compiler core team, and previously worked at Cursor, Meta and Netflix, posted what she called "maybe a hot take": she now considers adversarial reviews mostly a waste of tokens and thinks those tokens are far better spent on empirical combined with formal verification. She says she has updated her agent skill pack pstack to use its interrogate (multi-model adversarial review) skill less and may eventually remove it. She adds that she has found very little value in code review in the abstract, because agents tend to get lost in nitpicks and YAGNIs. The post drew about 906K views, 9,227 likes and 5,538 bookmarks. It is a personal opinion that sparked debate over the value of AI code review.

Key Takeaways

  • Opinion (personal, not an official finding): adversarial reviews are "mostly a waste of tokens"; empirical plus formal verification is the better use of them
  • Action: the author says she has made pstack use the interrogate skill less and may remove it; at fetch time the public pstack folder in GitHub cursor/plugins had no commits after October 27, so the change is not visible there yet
  • What interrogate is: per its public SKILL.md, it spawns one read-only reviewer per configured model (defaults Claude Opus 5.5 xhigh and Grok 4.7 xhigh fast) to attack the diff, then sorts findings into Act on, Consider, Noted and Dismissed without auto-applying fixes
  • Author (per her X and GitHub bios): engineer on Grok Bot at SpaceXSI, React Compiler core team, previously at Cursor, Meta and Netflix
  • Reach: about 906K views, 9,227 likes, 5,538 bookmarks, 668 replies, 356 reposts and 210 quotes
Read full story

Grok Bot Rolls Out a New Shopping Experience: Find the Best Deal, Compare Product Cards, and Track Orders After You Approve the Buy

On November 3, the official Grok Bot account @bot posted a video promoting a new shopping experience: have the Bot find the best deal, compare items, and track all your orders. The features come from the official changelog for version 0.78.1 (which includes 0.78.0), dated October 27: products appear as cards with photo, rating, price and store plus up to two badges, and three or four results scroll in a carousel. Product pages list in-stock options first, and Buy now starts an order you approve. After purchase the Bot tracks shipping and delivery, with shipment cards showing carrier and stage. Shop Pay can be connected in the Vault Payments tab and set as the preferred method.

Grok Bot Rolls Out a New Shopping Experience: Find the Best Deal, Compare Product Cards, and Track Orders After You Approve the Buy

Key Takeaways

  • The official post went out at 21:50 UTC on November 3 with a 17-second demo video; about 1,687 likes, 122 reposts, 292 replies and 112K views at fetch time
  • Source of the features: the official 0.78.1 changelog entry (October 27, includes 0.78.0), titled Shopping cards and subscription templates
  • Product cards: photo, rating, price and store, up to 2 badges such as Top rated, 3 or 4 results in a carousel; product pages list in-stock options first and disable options no store has
  • Ordering and tracking: orders started with Buy now need your approval; afterward the Bot reports shipping and arrival, and shipment cards show carrier and stage
  • Payments: the Vault has had a Payments tab since 0.77.0 (October 26); 0.78.1 lets you connect Shop Pay and make it the method Bots use first
Read full story
Linked Models & Agents:
ADSponsored

X Discussion: Jason Calacanis Says Under $40K a Year in AI Subscriptions Delivers $2M+ in Value and Has Automated at Least Seven Full-Time Jobs

Angel investor and This Week in Startups host Jason Calacanis posted on X on November 2 that he spends under $40K a year on tokens and subscriptions from Anthropic, Lovable, Grok Bot, ElevenLabs and other AI products, yet gets more than $2M in value at LAUNCH and This Week in Startups. He said they have automated at least seven full-time jobs and become 100% faster at the average task, and that the last 90 days changed more than the previous two years. Within about 9 hours the post drew about 2,200 likes and 230K views, with debate centered on AI ROI and job replacement. All figures are his own claims and have not been independently verified.

Key Takeaways

  • This is Calacanis's personal post, not official data or an announcement from any AI company; the $40K, $2M, seven jobs and 100% faster figures are self-reported with no public breakdown.
  • The original post (2026-11-02 05:27 UTC) had about 2,201 likes, 106 reposts, 244 replies, 42 quotes, 230K views and 715 bookmarks at fetch time.
  • Tools he named include Anthropic, Lovable, Grok Bot and ElevenLabs plus a long tail of other products; he also said anyone who has not used the last 90 days of products for at least 30 hours a week has no idea how profound this software is.
  • Supporters: entrepreneur Steven Cohn (@spcohn) quoted it saying his team has seen the same level of ROI; Farzad (@farzyness), with about 400K followers, quoted it saying "The ROI for AI is mind-boggling," drawing about 157 likes.
  • Skeptics: one user mocked posting "we automated seven full-time jobs" with a siren emoji like a product launch, noting that 30 hours a week of usage is itself like a new full-time job.
Read full story

X Discussion: Elon Musk Says Grok Bot Serving Costs Were Unsustainably High Relative to Revenue; Replit CEO Amjad Masad Warns Subsidized AI Subscriptions Face a Rug Pull

After users on X complained that their Grok Bot usage ran out early this cycle, Elon Musk replied that "the cost of serving Grok Bot was unsustainably high relative to revenue", a reply with about 13K likes and 5.5M views. Replit CEO Amjad Masad then quoted the news, saying people enjoying subsidized AI subscriptions should "get ready to get rug pulled", sparking a debate over whether flat-rate AI plans can last. This is an X discussion with personal views; xAI has not published a formal pricing or limit announcement.

Key Takeaways

  • Trigger: user @DogecoinNorway said their Grok Bot usage hit 100% with 4 days left until reset, a post with about 1.24M views.
  • Musk replied that the cost of serving Grok Bot was unsustainably high relative to revenue, with about 13.2K likes, 5.51M views and 1,900+ quotes.
  • Amjad Masad (Replit CEO) quoted it, warning subsidized AI subscriptions are about to get rug pulled, with about 2,347 likes and 146K views; in replies he said Replit never subsidized.
  • xAI has not published a formal limit or pricing change; rely on official notices for specifics.
Read full story

Benji Taylor, head of design at X and SpaceXSI, open-sources Stageshow, an agent skill for realistic faux product UI and animated demos

On Oct 31, Benji Taylor, head of design at X and SpaceXSI, released Stageshow on X: an open-source skill (MIT license) for coding agents that helps them produce faux product UI that looks real, including stills, cursor demo animations, and bento grids, delivered as ordinary React components. It installs with one command, and he says it works with Grok Build, Claude Code, Codex, Gemini, and others. The launch post drew about 4,500 likes and 6,500 bookmarks. He notes it rarely nails a demo in one shot and most still take a few rounds of feedback.

Benji Taylor, head of design at X and SpaceXSI, open-sources Stageshow, an agent skill for realistic faux product UI and animated demos

Key Takeaways

  • Install: npx skills add benjitaylor/skills --skill stageshow; the author says it works with Grok Build, Claude Code, Codex, Gemini, and other agents (author's post)
  • Contents: a seven-step workflow in SKILL.md, reference rule docs, dozens of gold examples, a React kit, and self-check scripts such as film.mjs (GitHub)
  • License: the stageshow folder is MIT licensed; the repo was created Oct 26 and had about 61 stars at writing time
  • Reach: the launch post had about 4,521 likes, 6,561 bookmarks, and 213k views as of Nov 1, 08:00 SGT
  • Quality claims are the author's own: the same prompts did better with the skill, but no quantitative evaluation was published
Read full story
x
xAIdocs.x.ai·
👀67
🔥82

xAI will add an invisible watermark to Grok API text by default from Nov 7, covering grok-4.7 and six other models, with per-model admin opt-out

On Oct 31, xAI (signed as SpaceXSI in its docs) added an "Output Watermarking" page to its API docs: starting November 7, 2026, text generated by grok-4.7, grok-4.6, grok-4.5, grok-4.3, and the reasoning, non-reasoning, and multi-agent versions of grok-4.20 will carry an invisible watermark by default, to comply with the EU AI Act. It covers ordinary text, structured outputs, and tool call arguments on both the Responses and Chat Completions APIs, and works by slightly shaping token choice without adding any characters. Developers can read the x-watermark response header to check; team admins can opt out per model in the Console, but must confirm a legal exception applies, and some models may be locked on.

Key Takeaways

  • Timing: on by default from November 7, 2026, with no code change and no request parameter (xAI docs)
  • Scope: 7 model IDs (grok-4.7, 4.6, 4.5, 4.3, and grok-4.20 reasoning, non-reasoning, and multi-agent) on the global and regional endpoints, across both Responses and Chat Completions
  • Coverage: ordinary text, structured outputs, and tool call arguments; the response header x-watermark: true marks a watermarked output
  • Opt-out: team admins switch it off per model, effective for new requests within 5 minutes and logged in the audit log; admins must confirm a legal exception applies, and some models are locked on
  • xAI's position: no effect on quality or speed; detection is statistical with three outcomes (watermarked, not watermarked, uncertain), and the detection API is by application
Read full story

xAI adds a guidelines field to the Grok API for per-request moderation of NSFW, violence and profanity

On Oct 28 xAI announced on the official @grok account that all API customers can now add a guidelines array to text requests and set the nsfw, violence and profanity categories to decline, so Grok tightens that content while it writes rather than through after-the-fact filtering. The field works on the Responses API, Chat Completions and the xAI Python SDK; multi-agent models and deferred completions are not supported, and invalid values are rejected with 400 or 422 before the model runs.

xAI adds a guidelines field to the Grok API for per-request moderation of NSFW, violence and profanity

Key Takeaways

  • Three categories: nsfw, violence and profanity; the only behavior today is decline, and unlisted categories keep the default (docs)
  • Works on the Responses API, Chat Completions and chat.create in the xAI Python SDK; with the OpenAI Python SDK pass it via extra_body
  • Applies only to the request that carries it, so send it on every turn; the xAI SDK chat object stores it for you
  • Not supported on multi-agent models such as grok-4.20-multi-agent or deferred completions; duplicate categories return 400 and unknown values return 422
  • The official post had about 592K views and 271 likes when this was written
Read full story
Linked Models & Agents:

Shopify Fall ’26 Edition bets on agentic commerce: Shop.md shopping skill, Shop.dev single connection, and Shop Pay inside Muse, Claude Duet, Grok Bot and other personal agents

On Oct 28 Shopify shipped its 10th Edition (Fall ’26, theme Exponential, 150+ updates including 57 for developers), centered on opening its catalog, cart and checkout to any agent. Shop.dev gives one connection to Shopify Catalog (1B+ products), sign-in with Shop, cart, checkout and Shop Pay; Shop.md is a customizable skill that turns ChatGPT, Claude or other agents into personal shoppers; Shop Pay now works inside Meta’s Muse, Claude Duet and Instinct, and Claude Duet, Grok Bot and Instinct can also use it for brands not on Shopify. Every Liquid and Hydrogen storefront and checkout now exposes WebMCP tools.

Shopify Fall ’26 Edition bets on agentic commerce: Shop.md shopping skill, Shop.dev single connection, and Shop Pay inside Muse, Claude Duet, Grok Bot and other personal agents

Key Takeaways

  • Scale (vendor figures): Shopify Catalog has 1B+ products and Shop Pay 400M+ shoppers; the Edition has 150+ updates, 57 of them for developers
  • Shop.dev is one connection for Catalog, sign-in with Shop, cart, checkout and Shop Pay; the underlying Shop MCP server is mcp.shop.com and search needs no API key
  • Shop Pay in personal agents starts with Muse from Meta, Claude Duet and Instinct; Claude Duet, Grok Bot and Instinct can also buy from brands off Shopify, with the card never shared with the agent and tokens from Mastercard, Visa and Discover (Amex coming)
  • WebMCP tools ship on every Liquid and Hydrogen storefront and checkout so browser agents can search, update the cart and check out after buyer approval
  • For developers: a one-command app security check in the Shopify CLI AI Toolkit, and a rebuilt Hydrogen plus the open-source Next.js Vercel Shop template are now generally available
Read full story
ADSponsored

Cognition launches FrontierCode 2.0 coding benchmark: it asks whether a PR should be merged, and top model Claude Opus 5.5 scores just 45.5%

Cognition, the maker of Devin, released FrontierCode 2.0 on Oct 27. It keeps the method of maintainer-written tasks graded on whether the code is actually mergeable, but draws tasks from more repositories, adds security patches and performance work, uses deliberately underspecified prompts and adds many thoroughness criteria. In Cognition's results Claude Opus 5.5 leads at 45.5%, GPT-6 Astra follows at 42.8%, and Grok 4.7 and Gemini 4 Argon drop into the 20s, leaving the benchmark far from saturated.

Cognition launches FrontierCode 2.0 coding benchmark: it asks whether a PR should be merged, and top model Claude Opus 5.5 scores just 45.5%

Key Takeaways

  • Claude Opus 5.5 leads at 45.5% (54.6% on v1.1) and GPT-6 Astra scores 42.8% (53.3% on v1.1), per Cognition (vendor-reported)
  • Grok 4.7 scores 28.6%, Gemini 4 Argon 26.3%, Muse Wonder 1.0 24.3%, SWE-2 23.9%, DeepSeek V4.1 Flash 19.3% and Kimi K3 17.7%, showing a wide gap for open models
  • Versus v1.1, reference solutions touch 67% more files and 89% more lines in codebases 25% larger; tasks come from 55% more repositories with 43% more blocking criteria
  • Thoroughness blockers grew from 168 to 501, about 3x; in 80% of tasks the reference solution improves on the upstream PR, and an audit agent found and reported an upstream security vulnerability
  • On the cost-score Pareto frontier, Opus 5.5 sits at the high end and Luna, Haiku and Sol at the low-cost end, with GPT-6.1 Sol called out for strong value (official blog)
Read full story

Grok Bot can now phone people and businesses for you: Elon Musk says it makes the request, takes notes and sends a call summary (0.77 prerelease)

On Oct 25 SpaceXSI CEO Elon Musk (@elonmusk) posted on X that Grok Bot can now call someone or a business for you, make a request on your behalf, take notes on the response and send you a summary of the conversation. The post quoted a third-party rundown of the Grok Bot 0.77 prerelease: it dials, sits on hold, presses keys, gets transferred and shows a live transcript. As of Oct 25 SpaceXSI had not published release notes or docs for the feature, and supported regions, plans and AI disclosure to the callee are not announced.

Key Takeaways

  • Source: Elon Musk's own X post (post), Oct 25 14:35 UTC
  • Capability: calls a person or business for you, makes the request, takes notes and sends a call summary
  • Prerelease rundown (third-party @alexmichaelio): dialing, waiting on hold, key presses, transfers and a live transcript
  • Per CellCog and The Tech Signal, the official changelog and docs did not cover the feature as of Oct 25
  • At capture the post had about 14.4K likes, 1,399 reposts, 3,332 bookmarks and 2.31M views
Read full story
Linked Models & Agents:

X discussion: Grok Imagine's official account posts Episode 1 of an AI-made Odyssey series (about 7 minutes, 4K), drawing 2.4M views and a debate over whether AI video can carry a long story

At 19:23 UTC on 2026-10-23, the official Grok Imagine account (@imagine) posted Episode 1 of its Odyssey series (post), saying it was made with Grok Imagine in a creative collaboration with Wonder Studios (@WonderStudiosX) and director Dev Walker (@glumlot_). The video runs about 7 minutes 12 seconds and is served in a 3840x2160 version. When we pulled it, the post had about 12,055 likes, 1,275 reposts, 433 quotes, 974 replies and 2.4M views, and the account asked whether people want a full breakdown of how it was made. Discussion on X kept growing over the past half day: supporters see it as AI video moving from short clips to whole episodes, while critics point to uneven acting and visible AI artifacts. This is an X discussion presented as opinions, not a verdict on the film's quality.

Key Takeaways

  • Main post: official Grok Imagine post, published 19:23 UTC on 10-23, with about 12,055 likes, 1,275 reposts, 433 quotes, 974 replies, 6,361 bookmarks and 2.4M views when we pulled it
  • What the account says: made with Grok Imagine, in collaboration with Wonder Studios and director Dev Walker; the video is about 7 minutes 12 seconds and comes in a 4K (3840x2160) version
  • The account asked whether people want a full breakdown of how it was made; no workflow, clip count or cost has been published yet
  • Opinions are split: some say AI video can now ship by the episode and that directing and storyboarding matter more than the model; others criticize uneven acting and visual artifacts
  • Treated as an X discussion; production-day and asset counts circulating online are not confirmed by the official account, so we do not use them
Read full story
Linked Models & Agents:

Letta releases FrontierMemory 1.0, a benchmark that scores agent memory by downstream task success; Opus 5.5 and GLM-5.3 tie for first at 73.3%

On October 21 Letta released FrontierMemory 1.0. Instead of quizzing agents on facts such as birthdays or hobbies, it gives an agent a set of past trajectories, has it write memory or skills, and scores that memory by how many coding and knowledge-work tasks a task agent then solves. Version 1.0 has 15 tasks adapted from public benchmarks such as DeepSWE, SkillsBench and APEX-Agents. On the model board (memory written in Letta Dream, tasks run in Letta Code) Opus 5.5 and GLM-5.3 both score 73.3% and Grok 4.7 scores 33.3%; on the harness board Letta's own Letta Dream ranks first. All numbers are Letta's own.

Letta releases FrontierMemory 1.0, a benchmark that scores agent memory by downstream task success; Opus 5.5 and GLM-5.3 tie for first at 73.3%

Key Takeaways

  • Model board (vendor-run, top effort): Opus 5.5 73.3% (about $2.80 per task), GLM-5.3 73.3% ($3.58), Kimi K3 66.7%, GPT-6.1 Sol 60.0% ($0.77, cheapest), Gemini 4 Argon 60.0%, Muse Wonder 46.7%, Grok 4.7 33.3%
  • Harness board: Letta Dream 73.3%, Prime Agent 60.0%, OpenAI Agents SDK 40.0%, Claude Managed Agents 33.3%, Hermes Agent 26.7%
  • Version 1.0 has 15 tasks; only 219 of 665 source trajectories are relevant, so the agent has to find the useful experience itself
  • Letta says 53% of the source tasks it kept had broken verifiers, which it repaired; memory generation is capped at 6 hours with no web access
  • Memory comes in three kinds (task conventions, user preferences, environment facts); outside models and harnesses can be submitted
Read full story

Grok Bot can now build reports, memos and dashboards as pages you edit together or let it keep up to date

On Oct 21 the official Grok Bot account announced that Bots can now build reports, memos and dashboards as pages that users edit together with the Bot or have it keep up to date. Pages already supported renaming, find-in-page and shared PDF download since 0.70.2; this extends them into deliverable reports and dashboards.

Grok Bot can now build reports, memos and dashboards as pages you edit together or let it keep up to date

Key Takeaways

  • New: ask a Bot for a page and it builds a report, memo or dashboard
  • Two modes: edit it together with the Bot, or let the Bot keep it up to date
  • Page basics (0.70.2 official changelog): Cmd/Ctrl+F find in page, rename from the title, shared pages with Download (PDF) and Share
  • The official post drew about 445K views and about 4,252 likes within roughly 2.5 hours (public X metrics)
  • No version number or plan limits have been published yet
Read full story
Linked Models & Agents: