AI Risk Atlas Prototype/DemoUnofficial independent experiment. Not an official xAI product. Scores can be wrong.

Back to watch register
19Psychosocial harmBelow the top 20

Adult companion models in a mental-health crisis

CapabilityDomain knowledgeImpact domainBoth

Statement (NASA form)

Given that adults already use companion products as their primary confidant, there is a possibility of a model staying in character through ideation instead of handing off resulting in preventable adult self-harm, without even the thin teen controls.

Likelihood
4Likely
Consequence
4Critical
Urgency
3Priority

The teen case is in the top 20. The adult case is larger and quieter.

Composite 19 = 4×4 + 3

Applicable mitigations

Related on the map