AI Coding Live News — Real-Time 𝕏/Twitter Updates & Breakthroughs

SlowMist@SlowMist_Team·Collected 14d ago

👀62

🔥98

LiteLLM Gateway Compromised in v1.107.0 Supply-Chain Attack: Emergency Rollback to 1.106.2 and Credential Rotation Issued

LiteLLM, a widely deployed unified proxy gateway powering millions of LLM and autonomous agent pipelines worldwide (including LangChain and OpenHands), suffered a critical supply-chain compromise. Attackers breached its automated CI/CD release pipeline, pushing a poisoned v1.107.0 release to PyPI and Docker Hub tags ('latest' and 'main-stable') equipped with a credential-harvesting payload targeting system environment variables and cloud API keys. Coordinated with security firms including SlowMist, the maintainers quickly contained the incident, yanked v1.107.0, restored PyPI to 1.106.2, and urged all operators to pin dependency versions and rotate API credentials immediately.

Key Takeaways

LiteLLM release pipeline compromised, publishing trojanized v1.107.0 packages across PyPI and Docker Hub tags
Payload secretly exfiltrated host environment variables, harvesting model API keys, database credentials, and cloud secrets
Maintainers yanked the malicious package within hours, rolling PyPI and official Docker containers back to stable 1.106.2
Urges all agent and LLM platform operators to verify pinned package versions and execute immediate credential rotation

Read full story

Linked Models & Agents:

🤖 LiteLLM 🤖 OpenHands 🤖 LangChain 🌐 BerriAI 🌐 SlowMist

#LiteLLM#Security#Supply Chain Attack#Cybersecurity#API Key#DevOps

AikidoAikidoSecurity·Collected 15d ago

👀58

🔥88

View on 𝕏 ↗

LiteLLM 1.107.0 hit by a supply-chain compromise: PyPI wheels and Docker images shipped a credential stealer and backdoor; LiteLLM says it is contained and advises pinning 1.106.2

On October 21 the release pipeline of the popular LLM gateway LiteLLM was compromised. A malicious 1.107.0 was live on PyPI for about two hours (11:39 to 13:23 UTC), and the Docker tags v1.107.0, latest, main-latest and main-stable pointed to a poisoned image from 11:46 to 14:20 UTC. LiteLLM's incident report says the payload steals cloud, SSH, AI-tool and proxy keys on every Python start; the artifacts are pulled, OSS users should pin 1.106.2 and rotate secrets, and the private enterprise registry was not affected.

Key Takeaways

Scope (vendor figures): all 7 PyPI wheels of litellm==1.107.0, live 11:39:51 to 13:23 UTC; 4 Docker Hub and GHCR tags poisoned from 11:46:56 UTC
Attack chain: the attacker held 3 sets of developer GitHub CLI credentials, one belonging to an org owner, used it to disable branch protection and force-push, then had the release workflow build and sign from the lookalike repo Berri-AI/litellm
Payload: cook.pth, cook.py and sitecustomize.py run on any Python start and survive uninstalling litellm; a second loader fetches remote code hourly
Fix: delete the 3 files and matching .pyc first, then pin litellm==1.106.2 or rebuild from scratch, and rotate every provider key in the proxy DB, the master key and the database password
This is LiteLLM's second supply-chain incident of 2026 (versions 1.82.7/1.82.8 in March); the GitHub source tag v1.107.0 itself is clean

Read full story

Linked Models & Agents:

🤖 LiteLLM Proxy 🤖 Claude Code 🌐 BerriAI 🌐 PyPI 🌐 Docker 🌐 GitHub

#LiteLLM#supply chain attack#PyPI#Security#LLM gateway

LangChain × ScaleDown@LangChainAI·Collected 23d ago

👀220

🔥86

ScaleDown ships Constrained Decoding Models: 1M-token task models for summarize, compress, extract and classify, with LangChain Deep Agents middleware

On Oct 13 ScaleDown launched Constrained Decoding Models (CDMs): each model is trained for a single task and only returns answers that task allows (a label or spans of the input) instead of free-form token-by-token generation. LangChain shipped a langchain-scaledown integration and LangSmith LLM Gateway support the same day, with middleware for history summarization, tool-result compression and structured extraction. ScaleDown claims 200x faster and 467x cheaper than frontier models on these narrow tasks; Extract and Summarize are on OpenRouter at $0.04 per million input tokens.

Key Takeaways

Four single-task models (Summarize, Compress, Extract, Classify), each taking up to 1M input tokens; Extract, Summarize and Classify accept images and scanned PDFs
Vendor-reported: vs the average of GPT-5.5, GPT-5.4 Mini and GPT-5.4 Nano, Summarize is 41x cheaper and 2.7x faster, Compress 138x cheaper and 1.8x faster, both with higher accuracy
Classify vs Jev: Jev is text-only with 32K tokens of state per question; Classify takes 1M tokens plus images and adds a one-sentence reason per decision
LangChain's trace example compresses a docs page from 18,402 to 3,110 characters; if a ScaleDown call fails the middleware leaves history untouched and the agent keeps running
On OpenRouter, Extract and Summarize cost $0.04/M input tokens with 1M context; Summarize caps output at 4,000 tokens and neither supports tools or response_format

Read full story

Linked Models & Agents:

⚡ ScaleDown Classify-1⚡ ScaleDown Extract⚡ ScaleDown Summarize⚡ ScaleDown Compress🤖 LangChain Deep Agents 🌐 ScaleDown 🌐 LangChain 🌐 OpenRouter

#ScaleDown#CDM#LangChain#Deep Agents#OpenRouter

BerriAI@Berri_AI·Collected 40d ago

👀125

🔥94

LiteLLM 1.102.1: Claude Code safeguards on stable + TypeSafe Jev router/guardrails backported

BerriAI shipped LiteLLM v1.102.1 on 2026-09-23 (PyPI litellm 1.102.1). Versus 1.102.0 it backports Anthropic/Bedrock/Vertex safeguards→safeguard_results passthrough so Claude Code Auto mode through a LiteLLM gateway can show Auto mode server: Enabled, and cherry-picks seven TypeSafe Jev changes (passthrough, complexity router, relevance compaction guardrail, auto-router classifier, OpenRouter jev-1.13 pricing, etc.) from the 1.103 RC onto stable/1.102.x. Docker images keep cosign verify instructions.

Key Takeaways

Shipped: v1.102.1 / PyPI 1.102.1
Claude Code: gateway forwards safeguards and returns safeguard_results (#42538) so Auto mode server can stay Enabled
TypeSafe Jev: seven PRs backported to stable/1.102.x (#42595)
Deploy: pip install litellm==1.102.1; cosign-verify ghcr.io/berriai/litellm:v1.102.1
Docs: Proxy Quick Start + Anthropic provider pages

Read full story

Linked Models & Agents:

⚡ Claude⚡ TypeSafe Jev⚡ jev-1.13🤖 Claude Code 🌐 berriai 🌐 Anthropic 🌐 openrouter

#LiteLLM#Claude Code#Safeguards#TypeSafe Jev#Proxy#Gateway#Cosign