Safety & Security

Artificial intelligence safety and security encompasses the technical and policy measures used to mitigate model risks, vulnerabilities, abuse and failures. Truncated covers research developments, threat analyses, defense mechanisms and policy discussions related to reliable deployment.

Today · Wed 11 Nov

Yesterday · Tue 10 Nov

Grok Build coding agent leaks oodles of confidential info, some belonging to SpaceXSI

Grok Build logo

AI-generated summary Research from security firm Claroc shows that the AI coding agent Grok Build from SpaceXSI leaked confidential business information and sensitive data belonging to thousands of users. Claroc found that the platform exposed internal business plans, ad proposals, medical exam results, and employee information because of how link sharing and URL randomness were implemented.

AI-Powered Malware Analysis: From Hidden Phishing Attacks to Faster SOC Response

AI-generated summary ANY.RUN reports that AI-assisted malware analysis combines automated attack execution, interactive investigation, threat intelligence, and AI-generated reporting to help security teams reach malicious activity faster. ANY.RUN says that its new Related Threat Context capability surfaces related sandbox analyses alongside suspicious indicators, connecting suspicious infrastructure to campaigns like SkyW4lker.

Incident Report: October 21st Security Attack

AI-generated summary Railway reports that its October 21st security incident involved a large-scale malicious attack where a threat actor probed routes using agent speed and abliterated models against defenses similar to ARTEX, according to Wiz. Railway states that the forensic investigation indicates the attacker was targeting AI provider credentials to sell to distributed transfer stations for use in distillation.

Also covered by Cyber Security News

Come and Take It

AI-generated summary Users of Anthropic’s Claude and OpenAI’s Codex have reported hitting safety guardrails and account restrictions while attempting AI-powered reverse engineering. OpenAI engineer Tarun Gogineni stated that account restrictions for reverse engineering are largely accidental and that the issue is being fixed.