ProposedOn the path to acceptable
Default-on crisis routing for under-18 accounts
Self-harm and violence classifiers fire without a parent having opted in. Fail to a human service.
Who should own it
Consumer labs and app stores
Frontier labs
How quickly it can land
Days
A crash team can ship it inside two weeks.
Expedited implementation
2 weeks
14 calendar days with a crash team
Normal implementation
2 months
60 calendar days as a planned program
Risk this mitigates
25Given that teen-facing chatbots are in production, and the self-harm controls that exist are opt-in for the parent rather than default for the child, there is a possibility of a model becoming the primary confidant during a mental-health crisis without a competent safety net resulting in preventable self-harm, and a generation that learned intimacy from a system with no duty of care.
Residual composite 25 · still above the threshold
Effect if implemented
Applied to every failure scenario on that risk, then re-ranked. Axes are clamped at 1.
- Likelihood
- −1
- Consequence
- −1
- Urgency
- −2