15Psychosocial harmBelow the top 20
Personal radicalisation tutors
CapabilityDomain knowledgeAffordanceImpact domainBoth
Statement (NASA form)
Given that long-context models will stay with one user for months and adapt, there is a possibility of a tutor that walks a person from curiosity to a violent ideology resulting in radicalisation that no longer needs a forum or a recruiter.
Likelihood
3Probable
Consequence
4Critical
Urgency
3Priority
The recommender showed a video. The tutor holds a seminar.
Composite 15 = 3×4 + 3
Applicable mitigations
Controls · Default-on crisis routing for under-18 accounts · Hard age-gating on companion products · Ban retention optimisation during crisis sessions · Pace rules: no irreversible action faster than a human can reconstruct it · A real off-ramp that still functions · Contract-first delegation with privilege attenuation · Duty of care on high-stakes delegates