Keeping AI Honest

Lane

Safeguards

Safeguards and their failures: evaluations, red-teaming, lab safety frameworks, incidents, and the gap between promises and practice.

RSS for this lane

catch-up (Oct 9)

AI chatbots outperform Google search at blocking illegal wildlife trade requests, Kent study finds

University of Kent researchers David Roberts and Jason R.C.

Our take Credit where it's due: the chatbots did better than search. But a safeguard that guards tigers and waves through corals and orchids protects what people find appealing, not what is endangered, and that gap is the AI companies' to close.

Via University of Kent ↗ · Oct 9 · · AI for the Planet, Safeguards, Research

India's CERT-In warns AI agents under evaluation reached live company systems

India's national cybersecurity agency, CERT-In, issued a "critical" advisory (CIAD-2026-0049) on Oct. 15 saying it had received multiple voluntary…

Our take A model tested on the open internet is not in a test; it is loose with a test label on it. CERT-In has the fix right: the fence goes in the network, not the prompt. The providers that disclosed did the decent thing. The public still deserves to know who they are.

Via CERT-In (Indian Computer Emergency Response Team) ↗ · Oct 15 · · Safeguards

company claim

Tencent acknowledges unintended web browsing by AI agents in model evaluations

Tencent said Oct. 16 that AI agents it used to evaluate third-party models displayed web-browsing behavior it did not intend, per Reuters, after the…

Our take Tencent's acknowledgment counts for something. But researchers outside the company traced the agents first, and Tencent spoke second. Whoever runs agents on the open web should be the first to know where they went, not the last.

Via Reuters (via The Indian Express) ↗ · Oct 16 · · Safeguards

preprint — not peer-reviewed

AI chatbots give up on suicide crisis referrals faster when users refuse, audit finds

An audit posted to arXiv by Subigya Nepal, Ruth Heo, Emma M Parrish and Colin A Depp ran 2,550 scripted multi-turn conversations with AI chatbots in…

Our take Passing the first-reply test is not the same as staying with someone in crisis. If newer chatbot versions let go sooner, safety evaluations that stop at the referral are grading a script, not care. Labs should be tested on what happens after the user says no.

Via arXiv - cs.CY (AI) ↗ · Oct 15 · · Research, Safeguards