Safety & Security · Fri 6 Nov

Artificial intelligence safety and security encompasses the technical and policy measures used to mitigate model risks, vulnerabilities, abuse and failures. Truncated covers research developments, threat analyses, defense mechanisms and policy discussions related to reliable deployment.

Friday 6 November

CPython flaw exposes AI inference servers to sandbox escape attacks

AI-generated summary Security researchers at RunSybil say a memory-safety flaw in CPython allows malicious AI model templates to escape code sandboxes and execute arbitrary code inside inference servers. The Python Security Response Team disputed the security implications of the demonstration, stating that executing untrusted Python code within a sandbox is outside CPython’s security threat model.

Also covered by infoworld.com

Anthropic’s AI could suddenly become 'extreme' and 'risky', report warns

AI-generated summary An independent assessment by Model Evaluation and Threat Research found that Anthropic models are accelerating their own development at twice the speed of last year. The study warns that continued recursive self-improvement could potentially lead to the sudden emergence of extreme and risky capabilities.

Also covered by The Verge WeRSM - We are Social Media Fortune

Chainalysis Breach Exposes All Users' Credentials, Forces Shutdown of Key Services

AI-generated summary Blockchain analysis firm Chainalysis revealed that an ongoing investigation into an agentic cyber attack exposed names, usernames, password hashes, and live tokens for all users. Chainalysis stated that it took the Know Your Transaction user interface, API, and login page offline while locking impacted accounts and implementing additional monitoring systems.

Israel’s security leaders aren’t afraid of rogue AI. They’re afraid of permissions.

AI-generated summary Security leaders interviewed for a CTech series express concern about credential risks and permission management regarding artificial intelligence agents rather than rogue artificial intelligence. According to the report, a NeuralTrust survey found that seventy-two percent of enterprises deploy agents while only twenty-nine percent have real security controls.

Your LLM writes good SQL. That’s not the same as safe SQL

AI-generated summary Building an LLM analytics tool on Snowflake Cortex for healthcare engagement and field-performance data showed that accurate text-to-SQL generation can still yield results for the wrong user. A policy-aware approach that validates every query before execution leaked no unauthorized rows and added only about 6.5 milliseconds per query in a synthetic benchmark.

3 charged in scheme to use AI to impersonate CEOs and attorneys to steal $129 million

AI-generated summary Prosecutors said three individuals were indicted on charges of wire fraud and aggravated identity theft after allegedly using artificial intelligence to steal about $129 million. Court documents state that Jacob Soall, Sharon Hazan, and Guy Sheetrit targeted thousands of companies worldwide by impersonating corporate executives and attorneys.

Also covered by SecurityWeek ABC News therecord.media
+7 moreIT Pro CyberScoop NBC News inc.com the Guardian TNW | Artificial-intelligence Help Net Security