Model Security

Model security involves protecting machine learning models and digital artifacts against theft, manipulation, and compromise. Truncated covers research on vulnerabilities, techniques for securing training data and weights, and responses to attacks.

Tuesday 3 November

What is memory poisoning and who is at risk?

Cyber attacks concept image showing a red-colored warning symbol hovering above a laptop used by man in dark room.

AI-generated summary Security researchers have released details about a technique known as memory poisoning, which allows attackers to inject malicious or misleading memory items into an artificial intelligence assistant's persistent memory layer. Forcepoint states that the aim of these attacks is to trick artificial intelligence agents into producing false information, creating a persistent risk that can repeatedly output flawed data across future sessions.

Monday 2 November

Preparing our next security sprint to harden OpenAI

AI-generated summary OpenAI announced plans for its next internal security sprint, partnering with Cathedral Systems to test defenses and quadrupling rewards for critical findings in its Security Bug Bounty program. OpenAI says the initiative builds on previous efforts where engineers used Codex to investigate findings and prepare patches as part of an ongoing effort to strengthen systems.

Also covered by Cyber Security News Interesting Engineering The Decoder

Cursor Removes Malicious Claude Code 2.1.313 Extension From Its Marketplace

AI-generated summary According to the report, a malicious Claude Code 2.1.313 extension is rumored to have been distributed through the marketplace before its removal. Cursor says it removed the extension, rebuilt its marketplace after rotating keys, and worked with the hosting provider to take the attacker’s server offline.

Also covered by The Decoder Fast Company Help Net Security
+2 moreArs Technica Cyber Security News

Sunday 1 November

Saturday 31 October

Spooky New Infostealer Malware Uses AI to ‘Autodox’ Victims

AI-generated summary Cisco Talos researchers released findings showing that hackers have started adding artificial intelligence functionality into a new strain of infostealer malware named Volta-Autodoxer. Cisco Talos says the malware compiles stolen data into a dossier and uses commercial large language models to profile victims and quickly surface high-value targets.

Also covered by Cyber Security News IT Pro Help Net Security