DeepSeek

AI lab that releases open-weight models.

5 records2 attack3 capabilityWebsite
Sep 29, 2026
Anthropic assesses open-weight GLM-5.3: exploit results near Mythos Preview, safeguards bypassed in 64% to 100% of simulated trials
CapabilityEvaluation reportAnthropic, US Center for AI Standards and Innovation, Moonshot AI

Anthropic's Frontier Red Team reports that Zhipu AI's open-weight GLM-5.3 developed end-to-end exploits in 50 of 410 ExploitBench attempts, against 56 of 410 for Claude Mythos Preview, and full control-flow hijacks in 4% of trials on a 100-task subset of Anthropic's internal binary-exploitation benchmark, against 6% for Mythos Preview. In a simulated harmful-request test, Anthropic reports the model's refusals were bypassed in 64% to 100% of trials using a cover story, prefilled reasoning, or an abliterated copy of the weights, techniques it says did not work on safeguarded Claude models. All figures are Anthropic's own and were produced on setups the post describes only in part.

Jul 30, 2026
Unit 42 reports an actor ran DeepSeek through Hermes Agent in autonomous exploit attempts that failed; some of its manual attacks succeeded
AttackMisuse reportPalo Alto Networks, DeepSeek, OpenAI

Palo Alto Networks' Unit 42 reports that a Chinese-speaking opportunistic actor used the open-source Hermes Agent framework with DeepSeek as its main autonomous operator, directed over Telegram, to find targets, source public exploits and attempt exploitation; in the recovered session the agent retargeted on its own after failures but compromised nothing, because target configurations blocked the exploits. The actor's confirmed impact, including data exfiltration from three organizations, came from separate manual operations. Unit 42 also reports limited testing of Claude Code, Codex and Qwen Code with client-side permission checks removed, and says Western providers' server-side controls likely limited their usefulness to the actor.

May 1, 2026
CAISI evaluation finds DeepSeek V4 Pro trails US frontier models by about eight months
CapabilityEvaluation reportUS Center for AI Standards and Innovation, DeepSeek, NIST

NIST's Center for AI Standards and Innovation evaluated the open-weight DeepSeek V4 Pro model and reported that it lags leading US models by roughly eight months in aggregate capability. On a cyber capture-the-flag benchmark it scored well below GPT-5.5 and Claude Opus 4.6, and CAISI notes its non-public benchmarks show weaker agentic performance than DeepSeek's self-reported results.

Sep 30, 2025
CAISI evaluation finds DeepSeek models lag US models on cyber tasks and are far easier to hijack
CapabilityEvaluation reportUS Center for AI Standards and Innovation, NIST, DeepSeek

NIST's CAISI evaluated DeepSeek R1, R1-0528 and V3.1 against US reference models across 19 benchmarks, as directed by the AI Action Plan. CAISI reports the largest capability gap on software engineering and cyber tasks, and found DeepSeek-based agents far more likely to follow hijacking instructions and to comply with jailbroken malicious requests.